=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-100627 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.16.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-100627 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.16.0: exit status 80 (9m42.680727906s)
-- stdout --
* [old-k8s-version-100627] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=17240
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/17240-6042/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/17240-6042/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on user configuration
* Starting control plane node old-k8s-version-100627 in cluster old-k8s-version-100627
* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
* Preparing Kubernetes v1.16.0 on CRI-O 1.24.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Configuring RBAC rules ...
* Configuring bridge CNI (Container Networking Interface) ...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
* Verifying Kubernetes components...
* Enabled addons: default-storageclass, storage-provisioner
-- /stdout --
** stderr **
I0919 17:36:57.219771 42957 out.go:296] Setting OutFile to fd 1 ...
I0919 17:36:57.220061 42957 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0919 17:36:57.220071 42957 out.go:309] Setting ErrFile to fd 2...
I0919 17:36:57.220078 42957 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0919 17:36:57.220266 42957 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17240-6042/.minikube/bin
I0919 17:36:57.220905 42957 out.go:303] Setting JSON to false
I0919 17:36:57.222180 42957 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":4767,"bootTime":1695140250,"procs":227,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1042-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0919 17:36:57.222304 42957 start.go:138] virtualization: kvm guest
I0919 17:36:57.225042 42957 out.go:177] * [old-k8s-version-100627] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
I0919 17:36:57.227052 42957 out.go:177] - MINIKUBE_LOCATION=17240
I0919 17:36:57.227050 42957 notify.go:220] Checking for updates...
I0919 17:36:57.228616 42957 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0919 17:36:57.230078 42957 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17240-6042/kubeconfig
I0919 17:36:57.231538 42957 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17240-6042/.minikube
I0919 17:36:57.233022 42957 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0919 17:36:57.234421 42957 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0919 17:36:57.236213 42957 config.go:182] Loaded profile config "cert-expiration-142729": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.2
I0919 17:36:57.236339 42957 config.go:182] Loaded profile config "cert-options-512928": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.2
I0919 17:36:57.236458 42957 config.go:182] Loaded profile config "force-systemd-env-367630": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.2
I0919 17:36:57.236571 42957 driver.go:373] Setting default libvirt URI to qemu:///system
I0919 17:36:57.270414 42957 out.go:177] * Using the kvm2 driver based on user configuration
I0919 17:36:57.271869 42957 start.go:298] selected driver: kvm2
I0919 17:36:57.271885 42957 start.go:902] validating driver "kvm2" against <nil>
I0919 17:36:57.271895 42957 start.go:913] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0919 17:36:57.272595 42957 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0919 17:36:57.272667 42957 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17240-6042/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0919 17:36:57.287444 42957 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.31.2
I0919 17:36:57.287489 42957 start_flags.go:307] no existing cluster config was found, will generate one from the flags
I0919 17:36:57.287736 42957 start_flags.go:922] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0919 17:36:57.287768 42957 cni.go:84] Creating CNI manager for ""
I0919 17:36:57.287779 42957 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0919 17:36:57.287788 42957 start_flags.go:316] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0919 17:36:57.287797 42957 start_flags.go:321] config:
{Name:old-k8s-version-100627 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-100627 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR
untime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
I0919 17:36:57.287926 42957 iso.go:125] acquiring lock: {Name:mk514aa5854fd317cc6dd61e19c3171ab4ae49dd Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0919 17:36:57.289844 42957 out.go:177] * Starting control plane node old-k8s-version-100627 in cluster old-k8s-version-100627
I0919 17:36:57.291143 42957 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
I0919 17:36:57.291184 42957 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17240-6042/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4
I0919 17:36:57.291192 42957 cache.go:57] Caching tarball of preloaded images
I0919 17:36:57.291279 42957 preload.go:174] Found /home/jenkins/minikube-integration/17240-6042/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0919 17:36:57.291292 42957 cache.go:60] Finished verifying existence of preloaded tar for v1.16.0 on crio
I0919 17:36:57.291410 42957 profile.go:148] Saving config to /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/config.json ...
I0919 17:36:57.291433 42957 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/config.json: {Name:mk041e36985762937be200a927b28475db893d72 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0919 17:36:57.291562 42957 start.go:365] acquiring machines lock for old-k8s-version-100627: {Name:mk1dfb481040588be213f94a9badd6ebd691d966 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0919 17:37:33.789228 42957 start.go:369] acquired machines lock for "old-k8s-version-100627" in 36.497587991s
I0919 17:37:33.789292 42957 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-100627 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-100627 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMS
ize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0919 17:37:33.789415 42957 start.go:125] createHost starting for "" (driver="kvm2")
I0919 17:37:33.791688 42957 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0919 17:37:33.791908 42957 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0919 17:37:33.791992 42957 main.go:141] libmachine: Launching plugin server for driver kvm2
I0919 17:37:33.810866 42957 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44839
I0919 17:37:33.811289 42957 main.go:141] libmachine: () Calling .GetVersion
I0919 17:37:33.811874 42957 main.go:141] libmachine: Using API Version 1
I0919 17:37:33.811894 42957 main.go:141] libmachine: () Calling .SetConfigRaw
I0919 17:37:33.812250 42957 main.go:141] libmachine: () Calling .GetMachineName
I0919 17:37:33.812497 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetMachineName
I0919 17:37:33.812659 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .DriverName
I0919 17:37:33.812843 42957 start.go:159] libmachine.API.Create for "old-k8s-version-100627" (driver="kvm2")
I0919 17:37:33.812868 42957 client.go:168] LocalClient.Create starting
I0919 17:37:33.812910 42957 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17240-6042/.minikube/certs/ca.pem
I0919 17:37:33.812954 42957 main.go:141] libmachine: Decoding PEM data...
I0919 17:37:33.812978 42957 main.go:141] libmachine: Parsing certificate...
I0919 17:37:33.813052 42957 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17240-6042/.minikube/certs/cert.pem
I0919 17:37:33.813077 42957 main.go:141] libmachine: Decoding PEM data...
I0919 17:37:33.813096 42957 main.go:141] libmachine: Parsing certificate...
I0919 17:37:33.813121 42957 main.go:141] libmachine: Running pre-create checks...
I0919 17:37:33.813135 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .PreCreateCheck
I0919 17:37:33.813600 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetConfigRaw
I0919 17:37:33.814018 42957 main.go:141] libmachine: Creating machine...
I0919 17:37:33.814031 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .Create
I0919 17:37:33.814173 42957 main.go:141] libmachine: (old-k8s-version-100627) Creating KVM machine...
I0919 17:37:33.815228 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found existing default KVM network
I0919 17:37:33.817478 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:33.817302 43487 network.go:212] skipping subnet 192.168.39.0/24 that is reserved: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
I0919 17:37:33.818507 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:33.818411 43487 network.go:214] skipping subnet 192.168.50.0/24 that is taken: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName:virbr2 IfaceIPv4:192.168.50.1 IfaceMTU:1500 IfaceMAC:52:54:00:11:3a:0c} reservation:<nil>}
I0919 17:37:33.819309 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:33.819229 43487 network.go:214] skipping subnet 192.168.61.0/24 that is taken: &{IP:192.168.61.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.61.0/24 Gateway:192.168.61.1 ClientMin:192.168.61.2 ClientMax:192.168.61.254 Broadcast:192.168.61.255 IsPrivate:true Interface:{IfaceName:virbr3 IfaceIPv4:192.168.61.1 IfaceMTU:1500 IfaceMAC:52:54:00:84:eb:fb} reservation:<nil>}
I0919 17:37:33.820372 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:33.820292 43487 network.go:209] using free private subnet 192.168.72.0/24: &{IP:192.168.72.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.72.0/24 Gateway:192.168.72.1 ClientMin:192.168.72.2 ClientMax:192.168.72.254 Broadcast:192.168.72.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015a70}
I0919 17:37:33.825991 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | trying to create private KVM network mk-old-k8s-version-100627 192.168.72.0/24...
I0919 17:37:33.898879 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | private KVM network mk-old-k8s-version-100627 192.168.72.0/24 created
I0919 17:37:33.898924 42957 main.go:141] libmachine: (old-k8s-version-100627) Setting up store path in /home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627 ...
I0919 17:37:33.898943 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:33.898859 43487 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17240-6042/.minikube
I0919 17:37:33.898971 42957 main.go:141] libmachine: (old-k8s-version-100627) Building disk image from file:///home/jenkins/minikube-integration/17240-6042/.minikube/cache/iso/amd64/minikube-v1.31.0-1695060926-17240-amd64.iso
I0919 17:37:33.898995 42957 main.go:141] libmachine: (old-k8s-version-100627) Downloading /home/jenkins/minikube-integration/17240-6042/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17240-6042/.minikube/cache/iso/amd64/minikube-v1.31.0-1695060926-17240-amd64.iso...
I0919 17:37:34.113314 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:34.113170 43487 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627/id_rsa...
I0919 17:37:34.335920 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:34.335756 43487 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627/old-k8s-version-100627.rawdisk...
I0919 17:37:34.335974 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Writing magic tar header
I0919 17:37:34.335995 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Writing SSH key tar header
I0919 17:37:34.336013 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:34.335862 43487 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627 ...
I0919 17:37:34.336039 42957 main.go:141] libmachine: (old-k8s-version-100627) Setting executable bit set on /home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627 (perms=drwx------)
I0919 17:37:34.336058 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627
I0919 17:37:34.336076 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17240-6042/.minikube/machines
I0919 17:37:34.336090 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17240-6042/.minikube
I0919 17:37:34.336105 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17240-6042
I0919 17:37:34.336120 42957 main.go:141] libmachine: (old-k8s-version-100627) Setting executable bit set on /home/jenkins/minikube-integration/17240-6042/.minikube/machines (perms=drwxr-xr-x)
I0919 17:37:34.336132 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0919 17:37:34.336149 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Checking permissions on dir: /home/jenkins
I0919 17:37:34.336170 42957 main.go:141] libmachine: (old-k8s-version-100627) Setting executable bit set on /home/jenkins/minikube-integration/17240-6042/.minikube (perms=drwxr-xr-x)
I0919 17:37:34.336190 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Checking permissions on dir: /home
I0919 17:37:34.336204 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Skipping /home - not owner
I0919 17:37:34.336218 42957 main.go:141] libmachine: (old-k8s-version-100627) Setting executable bit set on /home/jenkins/minikube-integration/17240-6042 (perms=drwxrwxr-x)
I0919 17:37:34.336230 42957 main.go:141] libmachine: (old-k8s-version-100627) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0919 17:37:34.336289 42957 main.go:141] libmachine: (old-k8s-version-100627) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0919 17:37:34.336322 42957 main.go:141] libmachine: (old-k8s-version-100627) Creating domain...
I0919 17:37:34.337277 42957 main.go:141] libmachine: (old-k8s-version-100627) define libvirt domain using xml:
I0919 17:37:34.337303 42957 main.go:141] libmachine: (old-k8s-version-100627) <domain type='kvm'>
I0919 17:37:34.337315 42957 main.go:141] libmachine: (old-k8s-version-100627) <name>old-k8s-version-100627</name>
I0919 17:37:34.337326 42957 main.go:141] libmachine: (old-k8s-version-100627) <memory unit='MiB'>2200</memory>
I0919 17:37:34.337343 42957 main.go:141] libmachine: (old-k8s-version-100627) <vcpu>2</vcpu>
I0919 17:37:34.337357 42957 main.go:141] libmachine: (old-k8s-version-100627) <features>
I0919 17:37:34.337368 42957 main.go:141] libmachine: (old-k8s-version-100627) <acpi/>
I0919 17:37:34.337384 42957 main.go:141] libmachine: (old-k8s-version-100627) <apic/>
I0919 17:37:34.337393 42957 main.go:141] libmachine: (old-k8s-version-100627) <pae/>
I0919 17:37:34.337398 42957 main.go:141] libmachine: (old-k8s-version-100627)
I0919 17:37:34.337407 42957 main.go:141] libmachine: (old-k8s-version-100627) </features>
I0919 17:37:34.337413 42957 main.go:141] libmachine: (old-k8s-version-100627) <cpu mode='host-passthrough'>
I0919 17:37:34.337428 42957 main.go:141] libmachine: (old-k8s-version-100627)
I0919 17:37:34.337438 42957 main.go:141] libmachine: (old-k8s-version-100627) </cpu>
I0919 17:37:34.337448 42957 main.go:141] libmachine: (old-k8s-version-100627) <os>
I0919 17:37:34.337462 42957 main.go:141] libmachine: (old-k8s-version-100627) <type>hvm</type>
I0919 17:37:34.337478 42957 main.go:141] libmachine: (old-k8s-version-100627) <boot dev='cdrom'/>
I0919 17:37:34.337485 42957 main.go:141] libmachine: (old-k8s-version-100627) <boot dev='hd'/>
I0919 17:37:34.337492 42957 main.go:141] libmachine: (old-k8s-version-100627) <bootmenu enable='no'/>
I0919 17:37:34.337497 42957 main.go:141] libmachine: (old-k8s-version-100627) </os>
I0919 17:37:34.337503 42957 main.go:141] libmachine: (old-k8s-version-100627) <devices>
I0919 17:37:34.337511 42957 main.go:141] libmachine: (old-k8s-version-100627) <disk type='file' device='cdrom'>
I0919 17:37:34.337530 42957 main.go:141] libmachine: (old-k8s-version-100627) <source file='/home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627/boot2docker.iso'/>
I0919 17:37:34.337555 42957 main.go:141] libmachine: (old-k8s-version-100627) <target dev='hdc' bus='scsi'/>
I0919 17:37:34.337569 42957 main.go:141] libmachine: (old-k8s-version-100627) <readonly/>
I0919 17:37:34.337581 42957 main.go:141] libmachine: (old-k8s-version-100627) </disk>
I0919 17:37:34.337592 42957 main.go:141] libmachine: (old-k8s-version-100627) <disk type='file' device='disk'>
I0919 17:37:34.337602 42957 main.go:141] libmachine: (old-k8s-version-100627) <driver name='qemu' type='raw' cache='default' io='threads' />
I0919 17:37:34.337618 42957 main.go:141] libmachine: (old-k8s-version-100627) <source file='/home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627/old-k8s-version-100627.rawdisk'/>
I0919 17:37:34.337637 42957 main.go:141] libmachine: (old-k8s-version-100627) <target dev='hda' bus='virtio'/>
I0919 17:37:34.337651 42957 main.go:141] libmachine: (old-k8s-version-100627) </disk>
I0919 17:37:34.337664 42957 main.go:141] libmachine: (old-k8s-version-100627) <interface type='network'>
I0919 17:37:34.337679 42957 main.go:141] libmachine: (old-k8s-version-100627) <source network='mk-old-k8s-version-100627'/>
I0919 17:37:34.337690 42957 main.go:141] libmachine: (old-k8s-version-100627) <model type='virtio'/>
I0919 17:37:34.337699 42957 main.go:141] libmachine: (old-k8s-version-100627) </interface>
I0919 17:37:34.337714 42957 main.go:141] libmachine: (old-k8s-version-100627) <interface type='network'>
I0919 17:37:34.337729 42957 main.go:141] libmachine: (old-k8s-version-100627) <source network='default'/>
I0919 17:37:34.337742 42957 main.go:141] libmachine: (old-k8s-version-100627) <model type='virtio'/>
I0919 17:37:34.337755 42957 main.go:141] libmachine: (old-k8s-version-100627) </interface>
I0919 17:37:34.337768 42957 main.go:141] libmachine: (old-k8s-version-100627) <serial type='pty'>
I0919 17:37:34.337812 42957 main.go:141] libmachine: (old-k8s-version-100627) <target port='0'/>
I0919 17:37:34.337840 42957 main.go:141] libmachine: (old-k8s-version-100627) </serial>
I0919 17:37:34.337853 42957 main.go:141] libmachine: (old-k8s-version-100627) <console type='pty'>
I0919 17:37:34.337867 42957 main.go:141] libmachine: (old-k8s-version-100627) <target type='serial' port='0'/>
I0919 17:37:34.337881 42957 main.go:141] libmachine: (old-k8s-version-100627) </console>
I0919 17:37:34.337893 42957 main.go:141] libmachine: (old-k8s-version-100627) <rng model='virtio'>
I0919 17:37:34.337911 42957 main.go:141] libmachine: (old-k8s-version-100627) <backend model='random'>/dev/random</backend>
I0919 17:37:34.337927 42957 main.go:141] libmachine: (old-k8s-version-100627) </rng>
I0919 17:37:34.337945 42957 main.go:141] libmachine: (old-k8s-version-100627)
I0919 17:37:34.337957 42957 main.go:141] libmachine: (old-k8s-version-100627)
I0919 17:37:34.337967 42957 main.go:141] libmachine: (old-k8s-version-100627) </devices>
I0919 17:37:34.337979 42957 main.go:141] libmachine: (old-k8s-version-100627) </domain>
I0919 17:37:34.338009 42957 main.go:141] libmachine: (old-k8s-version-100627)
I0919 17:37:34.341988 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:59:9e:6d in network default
I0919 17:37:34.342499 42957 main.go:141] libmachine: (old-k8s-version-100627) Ensuring networks are active...
I0919 17:37:34.342518 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:34.343248 42957 main.go:141] libmachine: (old-k8s-version-100627) Ensuring network default is active
I0919 17:37:34.343601 42957 main.go:141] libmachine: (old-k8s-version-100627) Ensuring network mk-old-k8s-version-100627 is active
I0919 17:37:34.344172 42957 main.go:141] libmachine: (old-k8s-version-100627) Getting domain xml...
I0919 17:37:34.344858 42957 main.go:141] libmachine: (old-k8s-version-100627) Creating domain...
I0919 17:37:35.707310 42957 main.go:141] libmachine: (old-k8s-version-100627) Waiting to get IP...
I0919 17:37:35.708263 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:35.708897 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | unable to find current IP address of domain old-k8s-version-100627 in network mk-old-k8s-version-100627
I0919 17:37:35.708926 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:35.708882 43487 retry.go:31] will retry after 245.540083ms: waiting for machine to come up
I0919 17:37:35.956430 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:35.956940 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | unable to find current IP address of domain old-k8s-version-100627 in network mk-old-k8s-version-100627
I0919 17:37:35.956967 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:35.956894 43487 retry.go:31] will retry after 263.282783ms: waiting for machine to come up
I0919 17:37:36.221417 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:36.221954 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | unable to find current IP address of domain old-k8s-version-100627 in network mk-old-k8s-version-100627
I0919 17:37:36.221983 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:36.221904 43487 retry.go:31] will retry after 296.394237ms: waiting for machine to come up
I0919 17:37:36.520488 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:36.521055 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | unable to find current IP address of domain old-k8s-version-100627 in network mk-old-k8s-version-100627
I0919 17:37:36.521102 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:36.521002 43487 retry.go:31] will retry after 578.041635ms: waiting for machine to come up
I0919 17:37:37.100771 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:37.101345 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | unable to find current IP address of domain old-k8s-version-100627 in network mk-old-k8s-version-100627
I0919 17:37:37.101376 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:37.101291 43487 retry.go:31] will retry after 724.068331ms: waiting for machine to come up
I0919 17:37:37.827288 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:37.827807 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | unable to find current IP address of domain old-k8s-version-100627 in network mk-old-k8s-version-100627
I0919 17:37:37.827835 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:37.827750 43487 retry.go:31] will retry after 611.17761ms: waiting for machine to come up
I0919 17:37:38.440367 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:38.440939 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | unable to find current IP address of domain old-k8s-version-100627 in network mk-old-k8s-version-100627
I0919 17:37:38.440975 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:38.440847 43487 retry.go:31] will retry after 1.07704454s: waiting for machine to come up
I0919 17:37:39.519591 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:39.520252 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | unable to find current IP address of domain old-k8s-version-100627 in network mk-old-k8s-version-100627
I0919 17:37:39.520285 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:39.520208 43487 retry.go:31] will retry after 1.437221515s: waiting for machine to come up
I0919 17:37:40.959238 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:40.959748 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | unable to find current IP address of domain old-k8s-version-100627 in network mk-old-k8s-version-100627
I0919 17:37:40.959773 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:40.959694 43487 retry.go:31] will retry after 1.375412035s: waiting for machine to come up
I0919 17:37:42.337214 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:42.337643 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | unable to find current IP address of domain old-k8s-version-100627 in network mk-old-k8s-version-100627
I0919 17:37:42.337674 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:42.337597 43487 retry.go:31] will retry after 1.98678451s: waiting for machine to come up
I0919 17:37:44.325684 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:44.326182 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | unable to find current IP address of domain old-k8s-version-100627 in network mk-old-k8s-version-100627
I0919 17:37:44.326212 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:44.326133 43487 retry.go:31] will retry after 2.128471411s: waiting for machine to come up
I0919 17:37:46.456445 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:46.457009 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | unable to find current IP address of domain old-k8s-version-100627 in network mk-old-k8s-version-100627
I0919 17:37:46.457053 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:46.456949 43487 retry.go:31] will retry after 3.325529214s: waiting for machine to come up
I0919 17:37:49.784592 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:49.785174 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | unable to find current IP address of domain old-k8s-version-100627 in network mk-old-k8s-version-100627
I0919 17:37:49.785204 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:49.785121 43487 retry.go:31] will retry after 4.044126321s: waiting for machine to come up
I0919 17:37:53.830547 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:53.831117 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | unable to find current IP address of domain old-k8s-version-100627 in network mk-old-k8s-version-100627
I0919 17:37:53.831148 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | I0919 17:37:53.831082 43487 retry.go:31] will retry after 3.657867446s: waiting for machine to come up
I0919 17:37:57.490041 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:57.490659 42957 main.go:141] libmachine: (old-k8s-version-100627) Found IP for machine: 192.168.72.182
I0919 17:37:57.490691 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has current primary IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:57.490701 42957 main.go:141] libmachine: (old-k8s-version-100627) Reserving static IP address...
I0919 17:37:57.491109 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | unable to find host DHCP lease matching {name: "old-k8s-version-100627", mac: "52:54:00:ee:1d:e7", ip: "192.168.72.182"} in network mk-old-k8s-version-100627
I0919 17:37:57.563055 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Getting to WaitForSSH function...
I0919 17:37:57.563091 42957 main.go:141] libmachine: (old-k8s-version-100627) Reserved static IP address: 192.168.72.182
I0919 17:37:57.563118 42957 main.go:141] libmachine: (old-k8s-version-100627) Waiting for SSH to be available...
I0919 17:37:57.565838 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:57.566254 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:minikube Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:57.566287 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:57.566464 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Using SSH client type: external
I0919 17:37:57.566498 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Using SSH private key: /home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627/id_rsa (-rw-------)
I0919 17:37:57.566568 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.72.182 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627/id_rsa -p 22] /usr/bin/ssh <nil>}
I0919 17:37:57.566601 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | About to run SSH command:
I0919 17:37:57.566621 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | exit 0
I0919 17:37:57.652015 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | SSH cmd err, output: <nil>:
I0919 17:37:57.652318 42957 main.go:141] libmachine: (old-k8s-version-100627) KVM machine creation complete!
I0919 17:37:57.652629 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetConfigRaw
I0919 17:37:57.653502 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .DriverName
I0919 17:37:57.654404 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .DriverName
I0919 17:37:57.654584 42957 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I0919 17:37:57.654601 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetState
I0919 17:37:57.655892 42957 main.go:141] libmachine: Detecting operating system of created instance...
I0919 17:37:57.655910 42957 main.go:141] libmachine: Waiting for SSH to be available...
I0919 17:37:57.655919 42957 main.go:141] libmachine: Getting to WaitForSSH function...
I0919 17:37:57.655930 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHHostname
I0919 17:37:57.658119 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:57.658433 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:57.658469 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:57.658556 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHPort
I0919 17:37:57.658729 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:57.658866 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:57.659004 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHUsername
I0919 17:37:57.659145 42957 main.go:141] libmachine: Using SSH client type: native
I0919 17:37:57.659519 42957 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x7f56e0] 0x7f83c0 <nil> [] 0s} 192.168.72.182 22 <nil> <nil>}
I0919 17:37:57.659531 42957 main.go:141] libmachine: About to run SSH command:
exit 0
I0919 17:37:57.771343 42957 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0919 17:37:57.771366 42957 main.go:141] libmachine: Detecting the provisioner...
I0919 17:37:57.771377 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHHostname
I0919 17:37:57.773816 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:57.774137 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:57.774170 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:57.774350 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHPort
I0919 17:37:57.774539 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:57.774659 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:57.774776 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHUsername
I0919 17:37:57.774915 42957 main.go:141] libmachine: Using SSH client type: native
I0919 17:37:57.775211 42957 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x7f56e0] 0x7f83c0 <nil> [] 0s} 192.168.72.182 22 <nil> <nil>}
I0919 17:37:57.775223 42957 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I0919 17:37:57.889740 42957 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-gb090841-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I0919 17:37:57.889822 42957 main.go:141] libmachine: found compatible host: buildroot
I0919 17:37:57.889840 42957 main.go:141] libmachine: Provisioning with buildroot...
I0919 17:37:57.889858 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetMachineName
I0919 17:37:57.890107 42957 buildroot.go:166] provisioning hostname "old-k8s-version-100627"
I0919 17:37:57.890132 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetMachineName
I0919 17:37:57.890272 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHHostname
I0919 17:37:57.892469 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:57.892922 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:57.892961 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:57.893078 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHPort
I0919 17:37:57.893254 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:57.893382 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:57.893556 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHUsername
I0919 17:37:57.893703 42957 main.go:141] libmachine: Using SSH client type: native
I0919 17:37:57.894015 42957 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x7f56e0] 0x7f83c0 <nil> [] 0s} 192.168.72.182 22 <nil> <nil>}
I0919 17:37:57.894028 42957 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-100627 && echo "old-k8s-version-100627" | sudo tee /etc/hostname
I0919 17:37:58.024753 42957 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-100627
I0919 17:37:58.024787 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHHostname
I0919 17:37:58.027439 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.027750 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:58.027797 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.027982 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHPort
I0919 17:37:58.028168 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:58.028342 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:58.028544 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHUsername
I0919 17:37:58.028715 42957 main.go:141] libmachine: Using SSH client type: native
I0919 17:37:58.029043 42957 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x7f56e0] 0x7f83c0 <nil> [] 0s} 192.168.72.182 22 <nil> <nil>}
I0919 17:37:58.029062 42957 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-100627' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-100627/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-100627' | sudo tee -a /etc/hosts;
fi
fi
I0919 17:37:58.149248 42957 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0919 17:37:58.149277 42957 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17240-6042/.minikube CaCertPath:/home/jenkins/minikube-integration/17240-6042/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17240-6042/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17240-6042/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17240-6042/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17240-6042/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17240-6042/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17240-6042/.minikube}
I0919 17:37:58.149334 42957 buildroot.go:174] setting up certificates
I0919 17:37:58.149359 42957 provision.go:83] configureAuth start
I0919 17:37:58.149379 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetMachineName
I0919 17:37:58.149677 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetIP
I0919 17:37:58.152062 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.152424 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:58.152471 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.152547 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHHostname
I0919 17:37:58.154716 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.155013 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:58.155045 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.155236 42957 provision.go:138] copyHostCerts
I0919 17:37:58.155294 42957 exec_runner.go:144] found /home/jenkins/minikube-integration/17240-6042/.minikube/ca.pem, removing ...
I0919 17:37:58.155307 42957 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17240-6042/.minikube/ca.pem
I0919 17:37:58.155374 42957 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17240-6042/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17240-6042/.minikube/ca.pem (1082 bytes)
I0919 17:37:58.155486 42957 exec_runner.go:144] found /home/jenkins/minikube-integration/17240-6042/.minikube/cert.pem, removing ...
I0919 17:37:58.155497 42957 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17240-6042/.minikube/cert.pem
I0919 17:37:58.155532 42957 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17240-6042/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17240-6042/.minikube/cert.pem (1123 bytes)
I0919 17:37:58.155604 42957 exec_runner.go:144] found /home/jenkins/minikube-integration/17240-6042/.minikube/key.pem, removing ...
I0919 17:37:58.155614 42957 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17240-6042/.minikube/key.pem
I0919 17:37:58.155649 42957 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17240-6042/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17240-6042/.minikube/key.pem (1675 bytes)
I0919 17:37:58.155721 42957 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17240-6042/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17240-6042/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17240-6042/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-100627 san=[192.168.72.182 192.168.72.182 localhost 127.0.0.1 minikube old-k8s-version-100627]
I0919 17:37:58.326221 42957 provision.go:172] copyRemoteCerts
I0919 17:37:58.326282 42957 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0919 17:37:58.326310 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHHostname
I0919 17:37:58.329020 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.329407 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:58.329455 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.329620 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHPort
I0919 17:37:58.329770 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:58.329912 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHUsername
I0919 17:37:58.330060 42957 sshutil.go:53] new ssh client: &{IP:192.168.72.182 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627/id_rsa Username:docker}
I0919 17:37:58.413414 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0919 17:37:58.436747 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
I0919 17:37:58.457845 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0919 17:37:58.480645 42957 provision.go:86] duration metric: configureAuth took 331.269887ms
I0919 17:37:58.480670 42957 buildroot.go:189] setting minikube options for container-runtime
I0919 17:37:58.480817 42957 config.go:182] Loaded profile config "old-k8s-version-100627": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0919 17:37:58.480879 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHHostname
I0919 17:37:58.483326 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.483706 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:58.483737 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.483980 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHPort
I0919 17:37:58.484170 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:58.484330 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:58.484499 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHUsername
I0919 17:37:58.484660 42957 main.go:141] libmachine: Using SSH client type: native
I0919 17:37:58.484998 42957 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x7f56e0] 0x7f83c0 <nil> [] 0s} 192.168.72.182 22 <nil> <nil>}
I0919 17:37:58.485026 42957 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0919 17:37:58.785646 42957 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0919 17:37:58.785669 42957 main.go:141] libmachine: Checking connection to Docker...
I0919 17:37:58.785680 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetURL
I0919 17:37:58.786991 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Using libvirt version 6000000
I0919 17:37:58.789153 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.789531 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:58.789566 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.789684 42957 main.go:141] libmachine: Docker is up and running!
I0919 17:37:58.789697 42957 main.go:141] libmachine: Reticulating splines...
I0919 17:37:58.789703 42957 client.go:171] LocalClient.Create took 24.976828179s
I0919 17:37:58.789725 42957 start.go:167] duration metric: libmachine.API.Create for "old-k8s-version-100627" took 24.976884689s
I0919 17:37:58.789734 42957 start.go:300] post-start starting for "old-k8s-version-100627" (driver="kvm2")
I0919 17:37:58.789745 42957 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0919 17:37:58.789761 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .DriverName
I0919 17:37:58.789979 42957 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0919 17:37:58.790008 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHHostname
I0919 17:37:58.791995 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.792365 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:58.792396 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.792572 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHPort
I0919 17:37:58.792749 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:58.792913 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHUsername
I0919 17:37:58.793091 42957 sshutil.go:53] new ssh client: &{IP:192.168.72.182 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627/id_rsa Username:docker}
I0919 17:37:58.878233 42957 ssh_runner.go:195] Run: cat /etc/os-release
I0919 17:37:58.882435 42957 info.go:137] Remote host: Buildroot 2021.02.12
I0919 17:37:58.882455 42957 filesync.go:126] Scanning /home/jenkins/minikube-integration/17240-6042/.minikube/addons for local assets ...
I0919 17:37:58.882524 42957 filesync.go:126] Scanning /home/jenkins/minikube-integration/17240-6042/.minikube/files for local assets ...
I0919 17:37:58.882615 42957 filesync.go:149] local asset: /home/jenkins/minikube-integration/17240-6042/.minikube/files/etc/ssl/certs/132392.pem -> 132392.pem in /etc/ssl/certs
I0919 17:37:58.882743 42957 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0919 17:37:58.891881 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/files/etc/ssl/certs/132392.pem --> /etc/ssl/certs/132392.pem (1708 bytes)
I0919 17:37:58.913648 42957 start.go:303] post-start completed in 123.897754ms
I0919 17:37:58.913702 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetConfigRaw
I0919 17:37:58.914256 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetIP
I0919 17:37:58.916548 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.916866 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:58.916893 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.917107 42957 profile.go:148] Saving config to /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/config.json ...
I0919 17:37:58.917325 42957 start.go:128] duration metric: createHost completed in 25.127900566s
I0919 17:37:58.917354 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHHostname
I0919 17:37:58.919385 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.919788 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:58.919822 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:58.919901 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHPort
I0919 17:37:58.920059 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:58.920189 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:58.920312 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHUsername
I0919 17:37:58.920533 42957 main.go:141] libmachine: Using SSH client type: native
I0919 17:37:58.920882 42957 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x7f56e0] 0x7f83c0 <nil> [] 0s} 192.168.72.182 22 <nil> <nil>}
I0919 17:37:58.920896 42957 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0919 17:37:59.037108 42957 main.go:141] libmachine: SSH cmd err, output: <nil>: 1695145079.015035033
I0919 17:37:59.037132 42957 fix.go:206] guest clock: 1695145079.015035033
I0919 17:37:59.037140 42957 fix.go:219] Guest: 2023-09-19 17:37:59.015035033 +0000 UTC Remote: 2023-09-19 17:37:58.917339103 +0000 UTC m=+61.726190864 (delta=97.69593ms)
I0919 17:37:59.037179 42957 fix.go:190] guest clock delta is within tolerance: 97.69593ms
I0919 17:37:59.037190 42957 start.go:83] releasing machines lock for "old-k8s-version-100627", held for 25.247926167s
I0919 17:37:59.037224 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .DriverName
I0919 17:37:59.037476 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetIP
I0919 17:37:59.040356 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:59.040723 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:59.040755 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:59.040945 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .DriverName
I0919 17:37:59.041505 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .DriverName
I0919 17:37:59.041719 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .DriverName
I0919 17:37:59.041798 42957 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0919 17:37:59.041838 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHHostname
I0919 17:37:59.041959 42957 ssh_runner.go:195] Run: cat /version.json
I0919 17:37:59.041986 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHHostname
I0919 17:37:59.044523 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:59.044739 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:59.044920 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:59.044953 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:59.045107 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:37:59.045135 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:37:59.045177 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHPort
I0919 17:37:59.045288 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHPort
I0919 17:37:59.045387 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:59.045461 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:37:59.045533 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHUsername
I0919 17:37:59.045582 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHUsername
I0919 17:37:59.045663 42957 sshutil.go:53] new ssh client: &{IP:192.168.72.182 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627/id_rsa Username:docker}
I0919 17:37:59.045694 42957 sshutil.go:53] new ssh client: &{IP:192.168.72.182 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627/id_rsa Username:docker}
I0919 17:37:59.130152 42957 ssh_runner.go:195] Run: systemctl --version
I0919 17:37:59.153293 42957 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0919 17:37:59.320811 42957 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0919 17:37:59.326633 42957 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0919 17:37:59.326720 42957 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0919 17:37:59.341233 42957 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0919 17:37:59.341258 42957 start.go:469] detecting cgroup driver to use...
I0919 17:37:59.341389 42957 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0919 17:37:59.357647 42957 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0919 17:37:59.369217 42957 docker.go:196] disabling cri-docker service (if available) ...
I0919 17:37:59.369289 42957 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0919 17:37:59.381024 42957 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0919 17:37:59.392585 42957 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0919 17:37:59.504955 42957 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0919 17:37:59.625913 42957 docker.go:212] disabling docker service ...
I0919 17:37:59.626000 42957 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0919 17:37:59.640356 42957 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0919 17:37:59.654344 42957 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0919 17:37:59.759068 42957 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0919 17:37:59.863020 42957 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0919 17:37:59.876481 42957 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0919 17:37:59.894466 42957 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.1" pause image...
I0919 17:37:59.894516 42957 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I0919 17:37:59.903759 42957 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0919 17:37:59.903821 42957 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0919 17:37:59.913168 42957 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0919 17:37:59.922427 42957 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0919 17:37:59.931438 42957 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0919 17:37:59.940962 42957 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0919 17:37:59.949045 42957 crio.go:148] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0919 17:37:59.949101 42957 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0919 17:37:59.960905 42957 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0919 17:37:59.971864 42957 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0919 17:38:00.100650 42957 ssh_runner.go:195] Run: sudo systemctl restart crio
I0919 17:38:00.285817 42957 start.go:516] Will wait 60s for socket path /var/run/crio/crio.sock
I0919 17:38:00.285886 42957 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0919 17:38:00.291442 42957 start.go:537] Will wait 60s for crictl version
I0919 17:38:00.291503 42957 ssh_runner.go:195] Run: which crictl
I0919 17:38:00.295516 42957 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0919 17:38:00.335107 42957 start.go:553] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.1
RuntimeApiVersion: v1
I0919 17:38:00.335190 42957 ssh_runner.go:195] Run: crio --version
I0919 17:38:00.389127 42957 ssh_runner.go:195] Run: crio --version
I0919 17:38:00.440774 42957 out.go:177] * Preparing Kubernetes v1.16.0 on CRI-O 1.24.1 ...
I0919 17:38:00.442086 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetIP
I0919 17:38:00.445069 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:38:00.445597 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:38:00.445631 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:38:00.445866 42957 ssh_runner.go:195] Run: grep 192.168.72.1 host.minikube.internal$ /etc/hosts
I0919 17:38:00.450232 42957 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.72.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0919 17:38:00.463185 42957 localpath.go:92] copying /home/jenkins/minikube-integration/17240-6042/.minikube/client.crt -> /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/client.crt
I0919 17:38:00.463365 42957 localpath.go:117] copying /home/jenkins/minikube-integration/17240-6042/.minikube/client.key -> /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/client.key
I0919 17:38:00.463473 42957 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
I0919 17:38:00.463513 42957 ssh_runner.go:195] Run: sudo crictl images --output json
I0919 17:38:00.500932 42957 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0919 17:38:00.500990 42957 ssh_runner.go:195] Run: which lz4
I0919 17:38:00.505211 42957 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0919 17:38:00.509548 42957 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0919 17:38:00.509582 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (441050307 bytes)
I0919 17:38:02.343332 42957 crio.go:444] Took 1.838167 seconds to copy over tarball
I0919 17:38:02.343403 42957 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
I0919 17:38:05.361006 42957 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (3.017535731s)
I0919 17:38:05.361047 42957 crio.go:451] Took 3.017694 seconds to extract the tarball
I0919 17:38:05.361062 42957 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0919 17:38:05.400884 42957 ssh_runner.go:195] Run: sudo crictl images --output json
I0919 17:38:05.459846 42957 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.16.0". assuming images are not preloaded.
I0919 17:38:05.459874 42957 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.16.0 registry.k8s.io/kube-controller-manager:v1.16.0 registry.k8s.io/kube-scheduler:v1.16.0 registry.k8s.io/kube-proxy:v1.16.0 registry.k8s.io/pause:3.1 registry.k8s.io/etcd:3.3.15-0 registry.k8s.io/coredns:1.6.2 gcr.io/k8s-minikube/storage-provisioner:v5]
I0919 17:38:05.459923 42957 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0919 17:38:05.459955 42957 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.16.0
I0919 17:38:05.459992 42957 image.go:134] retrieving image: registry.k8s.io/etcd:3.3.15-0
I0919 17:38:05.460015 42957 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.2
I0919 17:38:05.460035 42957 image.go:134] retrieving image: registry.k8s.io/pause:3.1
I0919 17:38:05.460176 42957 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.16.0
I0919 17:38:05.460191 42957 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.16.0
I0919 17:38:05.460197 42957 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.16.0
I0919 17:38:05.463105 42957 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.16.0
I0919 17:38:05.463151 42957 image.go:177] daemon lookup for registry.k8s.io/etcd:3.3.15-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.3.15-0
I0919 17:38:05.463202 42957 image.go:177] daemon lookup for registry.k8s.io/pause:3.1: Error response from daemon: No such image: registry.k8s.io/pause:3.1
I0919 17:38:05.463251 42957 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.2: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.2
I0919 17:38:05.463373 42957 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.16.0
I0919 17:38:05.463394 42957 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.16.0
I0919 17:38:05.463411 42957 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.16.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.16.0
I0919 17:38:05.463450 42957 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0919 17:38:05.610326 42957 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.3.15-0
I0919 17:38:05.612388 42957 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.16.0
I0919 17:38:05.613954 42957 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.2
I0919 17:38:05.614287 42957 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.16.0
I0919 17:38:05.615578 42957 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.1
I0919 17:38:05.616847 42957 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.16.0
I0919 17:38:05.624726 42957 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.16.0
I0919 17:38:05.755265 42957 cache_images.go:116] "registry.k8s.io/etcd:3.3.15-0" needs transfer: "registry.k8s.io/etcd:3.3.15-0" does not exist at hash "b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed" in container runtime
I0919 17:38:05.755315 42957 cri.go:218] Removing image: registry.k8s.io/etcd:3.3.15-0
I0919 17:38:05.755364 42957 ssh_runner.go:195] Run: which crictl
I0919 17:38:05.804149 42957 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.16.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.16.0" does not exist at hash "06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d" in container runtime
I0919 17:38:05.804198 42957 cache_images.go:116] "registry.k8s.io/coredns:1.6.2" needs transfer: "registry.k8s.io/coredns:1.6.2" does not exist at hash "bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b" in container runtime
I0919 17:38:05.804205 42957 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.16.0
I0919 17:38:05.804230 42957 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.16.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.16.0" does not exist at hash "301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a" in container runtime
I0919 17:38:05.804253 42957 ssh_runner.go:195] Run: which crictl
I0919 17:38:05.804259 42957 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.16.0
I0919 17:38:05.804273 42957 cache_images.go:116] "registry.k8s.io/pause:3.1" needs transfer: "registry.k8s.io/pause:3.1" does not exist at hash "da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e" in container runtime
I0919 17:38:05.804318 42957 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.16.0" needs transfer: "registry.k8s.io/kube-proxy:v1.16.0" does not exist at hash "c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384" in container runtime
I0919 17:38:05.804330 42957 cri.go:218] Removing image: registry.k8s.io/pause:3.1
I0919 17:38:05.804304 42957 ssh_runner.go:195] Run: which crictl
I0919 17:38:05.804350 42957 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.16.0
I0919 17:38:05.804364 42957 ssh_runner.go:195] Run: which crictl
I0919 17:38:05.804233 42957 cri.go:218] Removing image: registry.k8s.io/coredns:1.6.2
I0919 17:38:05.804390 42957 ssh_runner.go:195] Run: which crictl
I0919 17:38:05.804413 42957 ssh_runner.go:195] Run: which crictl
I0919 17:38:05.805098 42957 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.16.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.16.0" does not exist at hash "b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e" in container runtime
I0919 17:38:05.805144 42957 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.16.0
I0919 17:38:05.805186 42957 ssh_runner.go:195] Run: which crictl
I0919 17:38:05.817927 42957 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.1
I0919 17:38:05.817955 42957 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.6.2
I0919 17:38:05.817959 42957 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.3.15-0
I0919 17:38:05.817984 42957 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.16.0
I0919 17:38:05.818036 42957 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.16.0
I0919 17:38:05.818054 42957 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.16.0
I0919 17:38:05.818102 42957 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.16.0
I0919 17:38:05.986109 42957 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17240-6042/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0
I0919 17:38:05.986159 42957 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17240-6042/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.16.0
I0919 17:38:05.986219 42957 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17240-6042/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1
I0919 17:38:05.986256 42957 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17240-6042/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.3.15-0
I0919 17:38:05.986334 42957 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/images/pause_3.1
I0919 17:38:05.986366 42957 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17240-6042/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.16.0
I0919 17:38:05.986367 42957 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17240-6042/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.2
I0919 17:38:05.986412 42957 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/17240-6042/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.16.0
I0919 17:38:05.990889 42957 ssh_runner.go:352] existence check for /var/lib/minikube/images/pause_3.1: stat -c "%s %y" /var/lib/minikube/images/pause_3.1: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/images/pause_3.1': No such file or directory
I0919 17:38:05.990922 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1 --> /var/lib/minikube/images/pause_3.1 (318976 bytes)
I0919 17:38:06.016879 42957 crio.go:257] Loading image: /var/lib/minikube/images/pause_3.1
I0919 17:38:06.016949 42957 ssh_runner.go:195] Run: sudo podman load -i /var/lib/minikube/images/pause_3.1
I0919 17:38:06.433305 42957 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0919 17:38:09.079028 42957 ssh_runner.go:235] Completed: sudo podman load -i /var/lib/minikube/images/pause_3.1: (3.062053589s)
I0919 17:38:09.079105 42957 cache_images.go:315] Transferred and loaded /home/jenkins/minikube-integration/17240-6042/.minikube/cache/images/amd64/registry.k8s.io/pause_3.1 from cache
I0919 17:38:09.079059 42957 ssh_runner.go:235] Completed: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5: (2.645718484s)
I0919 17:38:09.079177 42957 cache_images.go:92] LoadImages completed in 3.619287599s
W0919 17:38:09.079255 42957 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17240-6042/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0: no such file or directory
X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/17240-6042/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.16.0: no such file or directory
I0919 17:38:09.079334 42957 ssh_runner.go:195] Run: crio config
I0919 17:38:09.151832 42957 cni.go:84] Creating CNI manager for ""
I0919 17:38:09.151906 42957 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0919 17:38:09.151933 42957 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0919 17:38:09.151958 42957 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.72.182 APIServerPort:8443 KubernetesVersion:v1.16.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-100627 NodeName:old-k8s-version-100627 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.72.182"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.72.182 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt St
aticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0919 17:38:09.152151 42957 kubeadm.go:181] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.72.182
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-100627"
kubeletExtraArgs:
node-ip: 192.168.72.182
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.72.182"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-100627
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.72.182:2381
kubernetesVersion: v1.16.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0919 17:38:09.152258 42957 kubeadm.go:976] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --hostname-override=old-k8s-version-100627 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.72.182
[Install]
config:
{KubernetesVersion:v1.16.0 ClusterName:old-k8s-version-100627 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0919 17:38:09.152324 42957 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.16.0
I0919 17:38:09.162464 42957 binaries.go:44] Found k8s binaries, skipping transfer
I0919 17:38:09.162589 42957 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0919 17:38:09.171249 42957 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (430 bytes)
I0919 17:38:09.187762 42957 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0919 17:38:09.204089 42957 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2181 bytes)
I0919 17:38:09.221779 42957 ssh_runner.go:195] Run: grep 192.168.72.182 control-plane.minikube.internal$ /etc/hosts
I0919 17:38:09.226318 42957 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.72.182 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0919 17:38:09.239575 42957 certs.go:56] Setting up /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627 for IP: 192.168.72.182
I0919 17:38:09.239611 42957 certs.go:190] acquiring lock for shared ca certs: {Name:mkcd9535aaeb523a5533c912732bdd9b445557da Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0919 17:38:09.239796 42957 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/17240-6042/.minikube/ca.key
I0919 17:38:09.239856 42957 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/17240-6042/.minikube/proxy-client-ca.key
I0919 17:38:09.239968 42957 certs.go:315] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/client.key
I0919 17:38:09.240005 42957 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/apiserver.key.3425b032
I0919 17:38:09.240027 42957 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/apiserver.crt.3425b032 with IP's: [192.168.72.182 10.96.0.1 127.0.0.1 10.0.0.1]
I0919 17:38:09.513416 42957 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/apiserver.crt.3425b032 ...
I0919 17:38:09.513453 42957 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/apiserver.crt.3425b032: {Name:mk841ec0f5b4eaa54c1456a6b41ebbc471464400 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0919 17:38:09.513621 42957 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/apiserver.key.3425b032 ...
I0919 17:38:09.513632 42957 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/apiserver.key.3425b032: {Name:mkc92cce2a4435296817bf3053c5aea4cc082978 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0919 17:38:09.513694 42957 certs.go:337] copying /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/apiserver.crt.3425b032 -> /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/apiserver.crt
I0919 17:38:09.513749 42957 certs.go:341] copying /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/apiserver.key.3425b032 -> /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/apiserver.key
I0919 17:38:09.513797 42957 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/proxy-client.key
I0919 17:38:09.513810 42957 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/proxy-client.crt with IP's: []
I0919 17:38:09.734808 42957 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/proxy-client.crt ...
I0919 17:38:09.734836 42957 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/proxy-client.crt: {Name:mk76275133bcab6b3e19bd066d45d4e262de636e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0919 17:38:09.734990 42957 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/proxy-client.key ...
I0919 17:38:09.735001 42957 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/proxy-client.key: {Name:mkf0faaa5a317b5044a3bc06ddf8652b85acea80 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0919 17:38:09.735157 42957 certs.go:437] found cert: /home/jenkins/minikube-integration/17240-6042/.minikube/certs/home/jenkins/minikube-integration/17240-6042/.minikube/certs/13239.pem (1338 bytes)
W0919 17:38:09.735192 42957 certs.go:433] ignoring /home/jenkins/minikube-integration/17240-6042/.minikube/certs/home/jenkins/minikube-integration/17240-6042/.minikube/certs/13239_empty.pem, impossibly tiny 0 bytes
I0919 17:38:09.735202 42957 certs.go:437] found cert: /home/jenkins/minikube-integration/17240-6042/.minikube/certs/home/jenkins/minikube-integration/17240-6042/.minikube/certs/ca-key.pem (1679 bytes)
I0919 17:38:09.735222 42957 certs.go:437] found cert: /home/jenkins/minikube-integration/17240-6042/.minikube/certs/home/jenkins/minikube-integration/17240-6042/.minikube/certs/ca.pem (1082 bytes)
I0919 17:38:09.735246 42957 certs.go:437] found cert: /home/jenkins/minikube-integration/17240-6042/.minikube/certs/home/jenkins/minikube-integration/17240-6042/.minikube/certs/cert.pem (1123 bytes)
I0919 17:38:09.735276 42957 certs.go:437] found cert: /home/jenkins/minikube-integration/17240-6042/.minikube/certs/home/jenkins/minikube-integration/17240-6042/.minikube/certs/key.pem (1675 bytes)
I0919 17:38:09.735328 42957 certs.go:437] found cert: /home/jenkins/minikube-integration/17240-6042/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/17240-6042/.minikube/files/etc/ssl/certs/132392.pem (1708 bytes)
I0919 17:38:09.735890 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0919 17:38:09.761507 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0919 17:38:09.783974 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0919 17:38:09.813971 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/old-k8s-version-100627/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0919 17:38:09.843586 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0919 17:38:09.875518 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0919 17:38:09.903182 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0919 17:38:09.930060 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0919 17:38:09.956746 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0919 17:38:09.981651 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/certs/13239.pem --> /usr/share/ca-certificates/13239.pem (1338 bytes)
I0919 17:38:10.006022 42957 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17240-6042/.minikube/files/etc/ssl/certs/132392.pem --> /usr/share/ca-certificates/132392.pem (1708 bytes)
I0919 17:38:10.033831 42957 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0919 17:38:10.054101 42957 ssh_runner.go:195] Run: openssl version
I0919 17:38:10.061358 42957 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0919 17:38:10.074940 42957 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0919 17:38:10.080941 42957 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Sep 19 16:36 /usr/share/ca-certificates/minikubeCA.pem
I0919 17:38:10.081022 42957 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0919 17:38:10.088347 42957 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0919 17:38:10.101322 42957 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/13239.pem && ln -fs /usr/share/ca-certificates/13239.pem /etc/ssl/certs/13239.pem"
I0919 17:38:10.114258 42957 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/13239.pem
I0919 17:38:10.120390 42957 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Sep 19 16:45 /usr/share/ca-certificates/13239.pem
I0919 17:38:10.120465 42957 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/13239.pem
I0919 17:38:10.127436 42957 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/13239.pem /etc/ssl/certs/51391683.0"
I0919 17:38:10.140898 42957 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/132392.pem && ln -fs /usr/share/ca-certificates/132392.pem /etc/ssl/certs/132392.pem"
I0919 17:38:10.150324 42957 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/132392.pem
I0919 17:38:10.155088 42957 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Sep 19 16:45 /usr/share/ca-certificates/132392.pem
I0919 17:38:10.155129 42957 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/132392.pem
I0919 17:38:10.160750 42957 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/132392.pem /etc/ssl/certs/3ec20f2e.0"
I0919 17:38:10.170308 42957 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
I0919 17:38:10.174420 42957 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
I0919 17:38:10.174475 42957 kubeadm.go:404] StartCluster: {Name:old-k8s-version-100627 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVe
rsion:v1.16.0 ClusterName:old-k8s-version-100627 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.72.182 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
I0919 17:38:10.174546 42957 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0919 17:38:10.174581 42957 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0919 17:38:10.211686 42957 cri.go:89] found id: ""
I0919 17:38:10.211759 42957 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0919 17:38:10.223219 42957 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0919 17:38:10.232247 42957 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0919 17:38:10.244325 42957 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0919 17:38:10.244376 42957 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.16.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU"
I0919 17:38:10.386435 42957 kubeadm.go:322] [init] Using Kubernetes version: v1.16.0
I0919 17:38:10.386501 42957 kubeadm.go:322] [preflight] Running pre-flight checks
I0919 17:38:10.668006 42957 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
I0919 17:38:10.668211 42957 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0919 17:38:10.668351 42957 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0919 17:38:10.909540 42957 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0919 17:38:10.911184 42957 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0919 17:38:10.919504 42957 kubeadm.go:322] [kubelet-start] Activating the kubelet service
I0919 17:38:11.055803 42957 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0919 17:38:11.059075 42957 out.go:204] - Generating certificates and keys ...
I0919 17:38:11.059246 42957 kubeadm.go:322] [certs] Using existing ca certificate authority
I0919 17:38:11.059326 42957 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
I0919 17:38:11.256860 42957 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
I0919 17:38:11.473259 42957 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
I0919 17:38:11.656782 42957 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
I0919 17:38:11.778723 42957 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
I0919 17:38:12.026611 42957 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
I0919 17:38:12.026831 42957 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [old-k8s-version-100627 localhost] and IPs [192.168.72.182 127.0.0.1 ::1]
I0919 17:38:12.110073 42957 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
I0919 17:38:12.110282 42957 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [old-k8s-version-100627 localhost] and IPs [192.168.72.182 127.0.0.1 ::1]
I0919 17:38:12.207298 42957 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
I0919 17:38:12.572237 42957 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
I0919 17:38:12.798761 42957 kubeadm.go:322] [certs] Generating "sa" key and public key
I0919 17:38:12.798896 42957 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0919 17:38:13.067583 42957 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
I0919 17:38:13.212141 42957 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0919 17:38:13.358029 42957 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0919 17:38:13.653617 42957 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0919 17:38:13.654769 42957 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0919 17:38:13.656532 42957 out.go:204] - Booting up control plane ...
I0919 17:38:13.656657 42957 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0919 17:38:13.668462 42957 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0919 17:38:13.675952 42957 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0919 17:38:13.678667 42957 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0919 17:38:13.690291 42957 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0919 17:38:23.193800 42957 kubeadm.go:322] [apiclient] All control plane components are healthy after 9.504744 seconds
I0919 17:38:23.194013 42957 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0919 17:38:23.211500 42957 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config-1.16" in namespace kube-system with the configuration for the kubelets in the cluster
I0919 17:38:23.745389 42957 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
I0919 17:38:23.745650 42957 kubeadm.go:322] [mark-control-plane] Marking the node old-k8s-version-100627 as control-plane by adding the label "node-role.kubernetes.io/master=''"
I0919 17:38:24.260060 42957 kubeadm.go:322] [bootstrap-token] Using token: m3t4au.778p2c7ghycni65s
I0919 17:38:24.261631 42957 out.go:204] - Configuring RBAC rules ...
I0919 17:38:24.261801 42957 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0919 17:38:24.269374 42957 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0919 17:38:24.273369 42957 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0919 17:38:24.276833 42957 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0919 17:38:24.279658 42957 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0919 17:38:24.361807 42957 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
I0919 17:38:24.686749 42957 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
I0919 17:38:24.688005 42957 kubeadm.go:322]
I0919 17:38:24.688101 42957 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
I0919 17:38:24.688132 42957 kubeadm.go:322]
I0919 17:38:24.688240 42957 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
I0919 17:38:24.688250 42957 kubeadm.go:322]
I0919 17:38:24.688286 42957 kubeadm.go:322] mkdir -p $HOME/.kube
I0919 17:38:24.688362 42957 kubeadm.go:322] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0919 17:38:24.688454 42957 kubeadm.go:322] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0919 17:38:24.688468 42957 kubeadm.go:322]
I0919 17:38:24.688533 42957 kubeadm.go:322] You should now deploy a pod network to the cluster.
I0919 17:38:24.688636 42957 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0919 17:38:24.688733 42957 kubeadm.go:322] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0919 17:38:24.688742 42957 kubeadm.go:322]
I0919 17:38:24.688840 42957 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
I0919 17:38:24.688954 42957 kubeadm.go:322] and service account keys on each node and then running the following as root:
I0919 17:38:24.688965 42957 kubeadm.go:322]
I0919 17:38:24.689092 42957 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token m3t4au.778p2c7ghycni65s \
I0919 17:38:24.689224 42957 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:f2604ca04885b266ca3e8571482f33090dfe4d29eb194fffcb041730b5d5ec95 \
I0919 17:38:24.689257 42957 kubeadm.go:322] --control-plane
I0919 17:38:24.689262 42957 kubeadm.go:322]
I0919 17:38:24.689355 42957 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
I0919 17:38:24.689360 42957 kubeadm.go:322]
I0919 17:38:24.689450 42957 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token m3t4au.778p2c7ghycni65s \
I0919 17:38:24.689569 42957 kubeadm.go:322] --discovery-token-ca-cert-hash sha256:f2604ca04885b266ca3e8571482f33090dfe4d29eb194fffcb041730b5d5ec95
I0919 17:38:24.690326 42957 kubeadm.go:322] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0919 17:38:24.690360 42957 cni.go:84] Creating CNI manager for ""
I0919 17:38:24.690380 42957 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0919 17:38:24.692934 42957 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0919 17:38:24.694506 42957 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0919 17:38:24.712985 42957 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
I0919 17:38:24.734854 42957 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0919 17:38:24.734925 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:24.735002 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl label nodes minikube.k8s.io/version=v1.31.2 minikube.k8s.io/commit=4d69d3d50d3fb420e04057e6545e9fd90e260986 minikube.k8s.io/name=old-k8s-version-100627 minikube.k8s.io/updated_at=2023_09_19T17_38_24_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:25.011018 42957 ops.go:34] apiserver oom_adj: -16
I0919 17:38:25.011113 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:25.157574 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:25.790678 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:26.290285 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:26.790721 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:27.290999 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:27.790093 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:28.290887 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:28.790132 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:29.290734 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:29.790430 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:30.290151 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:30.790918 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:31.290201 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:31.790600 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:32.290088 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:32.790910 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:33.290967 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:33.791001 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:34.290050 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:34.790504 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:35.290435 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:35.791036 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:36.290557 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:36.790461 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:37.290588 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:37.791049 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:38.290552 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:38.790117 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:39.290463 42957 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.16.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0919 17:38:39.413074 42957 kubeadm.go:1081] duration metric: took 14.678207906s to wait for elevateKubeSystemPrivileges.
I0919 17:38:39.413105 42957 kubeadm.go:406] StartCluster complete in 29.238635222s
I0919 17:38:39.413121 42957 settings.go:142] acquiring lock: {Name:mk4dea221d84ac7f39978be61fc7eb70647b5155 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0919 17:38:39.413201 42957 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/17240-6042/kubeconfig
I0919 17:38:39.414194 42957 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17240-6042/kubeconfig: {Name:mk436083b52a902b659e099b9770a07ee1ea129c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0919 17:38:39.414419 42957 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0919 17:38:39.414520 42957 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]
I0919 17:38:39.414613 42957 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-100627"
I0919 17:38:39.414619 42957 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-100627"
I0919 17:38:39.414634 42957 addons.go:231] Setting addon storage-provisioner=true in "old-k8s-version-100627"
I0919 17:38:39.414637 42957 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-100627"
I0919 17:38:39.414666 42957 config.go:182] Loaded profile config "old-k8s-version-100627": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.16.0
I0919 17:38:39.414679 42957 host.go:66] Checking if "old-k8s-version-100627" exists ...
I0919 17:38:39.415036 42957 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0919 17:38:39.415070 42957 main.go:141] libmachine: Launching plugin server for driver kvm2
I0919 17:38:39.415117 42957 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0919 17:38:39.415147 42957 main.go:141] libmachine: Launching plugin server for driver kvm2
I0919 17:38:39.431467 42957 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39693
I0919 17:38:39.431507 42957 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42251
I0919 17:38:39.432023 42957 main.go:141] libmachine: () Calling .GetVersion
I0919 17:38:39.432133 42957 main.go:141] libmachine: () Calling .GetVersion
I0919 17:38:39.432501 42957 main.go:141] libmachine: Using API Version 1
I0919 17:38:39.432523 42957 main.go:141] libmachine: () Calling .SetConfigRaw
I0919 17:38:39.432636 42957 main.go:141] libmachine: Using API Version 1
I0919 17:38:39.432648 42957 main.go:141] libmachine: () Calling .SetConfigRaw
I0919 17:38:39.432874 42957 main.go:141] libmachine: () Calling .GetMachineName
I0919 17:38:39.432959 42957 main.go:141] libmachine: () Calling .GetMachineName
I0919 17:38:39.433027 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetState
I0919 17:38:39.433536 42957 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0919 17:38:39.433568 42957 main.go:141] libmachine: Launching plugin server for driver kvm2
I0919 17:38:39.447920 42957 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42977
I0919 17:38:39.448360 42957 main.go:141] libmachine: () Calling .GetVersion
I0919 17:38:39.448770 42957 main.go:141] libmachine: Using API Version 1
I0919 17:38:39.448792 42957 main.go:141] libmachine: () Calling .SetConfigRaw
I0919 17:38:39.449154 42957 main.go:141] libmachine: () Calling .GetMachineName
I0919 17:38:39.449413 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetState
I0919 17:38:39.451111 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .DriverName
I0919 17:38:39.453051 42957 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0919 17:38:39.452322 42957 addons.go:231] Setting addon default-storageclass=true in "old-k8s-version-100627"
I0919 17:38:39.454838 42957 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0919 17:38:39.454855 42957 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0919 17:38:39.454876 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHHostname
I0919 17:38:39.454876 42957 host.go:66] Checking if "old-k8s-version-100627" exists ...
I0919 17:38:39.455325 42957 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0919 17:38:39.455363 42957 main.go:141] libmachine: Launching plugin server for driver kvm2
I0919 17:38:39.458035 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:38:39.458454 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:38:39.458484 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:38:39.458711 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHPort
I0919 17:38:39.458869 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:38:39.459011 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHUsername
I0919 17:38:39.459132 42957 sshutil.go:53] new ssh client: &{IP:192.168.72.182 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627/id_rsa Username:docker}
I0919 17:38:39.471153 42957 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42503
I0919 17:38:39.471619 42957 main.go:141] libmachine: () Calling .GetVersion
I0919 17:38:39.472141 42957 main.go:141] libmachine: Using API Version 1
I0919 17:38:39.472164 42957 main.go:141] libmachine: () Calling .SetConfigRaw
I0919 17:38:39.472553 42957 main.go:141] libmachine: () Calling .GetMachineName
I0919 17:38:39.473123 42957 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0919 17:38:39.473164 42957 main.go:141] libmachine: Launching plugin server for driver kvm2
W0919 17:38:39.477276 42957 kapi.go:245] failed rescaling "coredns" deployment in "kube-system" namespace and "old-k8s-version-100627" context to 1 replicas: non-retryable failure while rescaling coredns deployment: Operation cannot be fulfilled on deployments.apps "coredns": the object has been modified; please apply your changes to the latest version and try again
E0919 17:38:39.477303 42957 start.go:219] Unable to scale down deployment "coredns" in namespace "kube-system" to 1 replica: non-retryable failure while rescaling coredns deployment: Operation cannot be fulfilled on deployments.apps "coredns": the object has been modified; please apply your changes to the latest version and try again
I0919 17:38:39.477326 42957 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.72.182 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0919 17:38:39.478804 42957 out.go:177] * Verifying Kubernetes components...
I0919 17:38:39.480302 42957 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0919 17:38:39.487424 42957 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42427
I0919 17:38:39.487832 42957 main.go:141] libmachine: () Calling .GetVersion
I0919 17:38:39.488209 42957 main.go:141] libmachine: Using API Version 1
I0919 17:38:39.488223 42957 main.go:141] libmachine: () Calling .SetConfigRaw
I0919 17:38:39.488588 42957 main.go:141] libmachine: () Calling .GetMachineName
I0919 17:38:39.488822 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetState
I0919 17:38:39.490381 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .DriverName
I0919 17:38:39.490720 42957 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
I0919 17:38:39.490735 42957 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0919 17:38:39.490754 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHHostname
I0919 17:38:39.493468 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:38:39.493852 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ee:1d:e7", ip: ""} in network mk-old-k8s-version-100627: {Iface:virbr1 ExpiryTime:2023-09-19 18:37:50 +0000 UTC Type:0 Mac:52:54:00:ee:1d:e7 Iaid: IPaddr:192.168.72.182 Prefix:24 Hostname:old-k8s-version-100627 Clientid:01:52:54:00:ee:1d:e7}
I0919 17:38:39.493869 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | domain old-k8s-version-100627 has defined IP address 192.168.72.182 and MAC address 52:54:00:ee:1d:e7 in network mk-old-k8s-version-100627
I0919 17:38:39.494045 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHPort
I0919 17:38:39.494636 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHKeyPath
I0919 17:38:39.494816 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .GetSSHUsername
I0919 17:38:39.494967 42957 sshutil.go:53] new ssh client: &{IP:192.168.72.182 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17240-6042/.minikube/machines/old-k8s-version-100627/id_rsa Username:docker}
I0919 17:38:39.741329 42957 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0919 17:38:39.763969 42957 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.72.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0919 17:38:39.765210 42957 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-100627" to be "Ready" ...
I0919 17:38:39.773614 42957 node_ready.go:49] node "old-k8s-version-100627" has status "Ready":"True"
I0919 17:38:39.773631 42957 node_ready.go:38] duration metric: took 8.393455ms waiting for node "old-k8s-version-100627" to be "Ready" ...
I0919 17:38:39.773640 42957 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0919 17:38:39.782447 42957 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0919 17:38:39.856170 42957 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace to be "Ready" ...
I0919 17:38:40.992036 42957 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.72.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.16.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.228023762s)
I0919 17:38:40.992080 42957 start.go:917] {"host.minikube.internal": 192.168.72.1} host record injected into CoreDNS's ConfigMap
I0919 17:38:40.992182 42957 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.209705689s)
I0919 17:38:40.992205 42957 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.16.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.250830159s)
I0919 17:38:40.992293 42957 main.go:141] libmachine: Making call to close driver server
I0919 17:38:40.992314 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .Close
I0919 17:38:40.992302 42957 main.go:141] libmachine: Making call to close driver server
I0919 17:38:40.992351 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .Close
I0919 17:38:40.992780 42957 main.go:141] libmachine: Successfully made call to close driver server
I0919 17:38:40.992797 42957 main.go:141] libmachine: Making call to close connection to plugin binary
I0919 17:38:40.992807 42957 main.go:141] libmachine: Making call to close driver server
I0919 17:38:40.992815 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .Close
I0919 17:38:40.992894 42957 main.go:141] libmachine: Successfully made call to close driver server
I0919 17:38:40.992921 42957 main.go:141] libmachine: Making call to close connection to plugin binary
I0919 17:38:40.992932 42957 main.go:141] libmachine: Making call to close driver server
I0919 17:38:40.992941 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .Close
I0919 17:38:40.993334 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Closing plugin on server side
I0919 17:38:40.993388 42957 main.go:141] libmachine: Successfully made call to close driver server
I0919 17:38:40.993409 42957 main.go:141] libmachine: Making call to close connection to plugin binary
I0919 17:38:40.993432 42957 main.go:141] libmachine: Making call to close driver server
I0919 17:38:40.993442 42957 main.go:141] libmachine: (old-k8s-version-100627) Calling .Close
I0919 17:38:40.993703 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Closing plugin on server side
I0919 17:38:40.993748 42957 main.go:141] libmachine: Successfully made call to close driver server
I0919 17:38:40.993765 42957 main.go:141] libmachine: Making call to close connection to plugin binary
I0919 17:38:40.994378 42957 main.go:141] libmachine: (old-k8s-version-100627) DBG | Closing plugin on server side
I0919 17:38:40.994380 42957 main.go:141] libmachine: Successfully made call to close driver server
I0919 17:38:40.994395 42957 main.go:141] libmachine: Making call to close connection to plugin binary
I0919 17:38:40.996603 42957 out.go:177] * Enabled addons: default-storageclass, storage-provisioner
I0919 17:38:40.998464 42957 addons.go:502] enable addons completed in 1.583954285s: enabled=[default-storageclass storage-provisioner]
I0919 17:38:41.923945 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:38:44.424320 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:38:46.925846 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:38:49.423753 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:38:51.425573 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:38:53.926839 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:38:56.423833 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:38:58.925038 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:01.430112 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:03.950388 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:06.424479 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:08.923940 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:11.421192 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:13.422862 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:15.422923 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:17.424193 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:19.922650 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:21.923279 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:23.924166 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:26.423320 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:28.922964 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:31.420958 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:33.428292 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:35.922464 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:38.424092 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:40.922909 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:43.421968 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:45.422192 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:47.422261 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:49.921704 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:52.422677 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:54.423692 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:56.922166 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:39:58.923769 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:00.924303 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:03.423348 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:05.922232 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:07.923635 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:10.422513 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:12.424976 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:14.923211 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:17.422498 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:19.422782 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:21.920894 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:23.922261 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:26.421761 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:28.923660 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:31.421074 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:33.423859 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:35.923692 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:38.423144 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:40.923016 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:43.426187 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:45.921546 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:47.922751 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:50.421465 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:52.423495 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:54.921504 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:57.422176 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:40:59.423503 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:01.922877 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:03.923132 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:05.924374 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:08.422381 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:10.429579 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:12.921554 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:14.921664 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:16.921835 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:19.421476 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:21.422127 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:23.921572 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:25.921991 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:28.421928 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:30.422061 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:32.920954 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:34.921011 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:36.921182 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:38.921456 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:40.921831 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:43.421114 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:45.421643 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:47.422869 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:49.920872 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:51.921571 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:54.422383 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:56.922734 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:41:59.421026 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:01.422201 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:03.922291 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:06.421328 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:08.422222 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:10.422312 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:12.921027 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:14.921552 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:16.921763 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:18.922006 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:20.923075 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:23.421889 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:25.922273 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:28.423125 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:30.922362 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:33.422227 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:35.921346 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:38.421794 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:39.857192 42957 pod_ready.go:81] duration metric: took 4m0.000984137s waiting for pod "coredns-5644d7b6d9-4mh4f" in "kube-system" namespace to be "Ready" ...
E0919 17:42:39.857235 42957 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0919 17:42:39.857244 42957 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace to be "Ready" ...
I0919 17:42:41.876965 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:43.888180 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:46.376263 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:48.376923 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:50.378297 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:52.878797 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:55.376648 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:57.377288 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:42:59.377506 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:01.877466 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:04.375899 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:06.377125 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:08.385032 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:10.877372 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:12.877913 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:15.376877 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:17.377168 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:19.876635 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:21.877310 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:24.377510 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:26.876453 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:28.877691 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:31.378134 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:33.878580 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:36.375767 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:38.379611 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:40.877240 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:42.883891 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:45.380816 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:47.878580 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:50.377009 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:52.378152 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:54.876756 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:56.877611 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:59.378184 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:01.876872 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:03.877276 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:05.877317 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:07.877444 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:09.878968 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:12.376921 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:14.876969 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:17.376230 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:19.377830 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:21.877906 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:23.878491 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:25.879531 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:28.375826 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:30.377657 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:32.878209 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:35.376578 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:37.377019 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:39.877984 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:41.881884 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:44.377586 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:46.377884 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:48.877801 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:51.377416 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:53.876874 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:55.876962 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:57.877638 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:59.878164 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:01.879235 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:04.377757 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:06.877198 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:08.877418 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:10.878338 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:13.376800 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:15.877398 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:17.878181 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:20.376596 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:22.376944 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:24.878244 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:27.377379 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:29.876657 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:31.876765 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:33.877071 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:36.376822 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:38.877479 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:41.376856 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:43.377597 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:45.877024 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:48.377283 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:50.377961 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:52.877056 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:54.877674 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:57.377616 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:59.876532 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:01.876764 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:03.878819 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:06.377546 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:08.877406 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:10.877528 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:12.877952 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:15.377993 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:17.875912 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:19.877080 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:22.377093 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:24.878340 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:27.377076 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:29.880578 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:32.378323 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:34.877137 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:37.380435 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:39.857402 42957 pod_ready.go:81] duration metric: took 4m0.000143248s waiting for pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace to be "Ready" ...
E0919 17:46:39.857441 42957 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0919 17:46:39.857470 42957 pod_ready.go:38] duration metric: took 8m0.083821212s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0919 17:46:39.859655 42957 out.go:177]
W0919 17:46:39.861310 42957 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: extra waiting: timed out waiting 6m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: extra waiting: timed out waiting 6m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
W0919 17:46:39.861333 42957 out.go:239] *
*
W0919 17:46:39.862218 42957 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0919 17:46:39.863771 42957 out.go:177]
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-100627 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=kvm2 --container-runtime=crio --kubernetes-version=v1.16.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-100627 -n old-k8s-version-100627
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/FirstStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p old-k8s-version-100627 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p old-k8s-version-100627 logs -n 25: (1.084277624s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/FirstStart logs:
-- stdout --
*
* ==> Audit <==
* |---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| ssh | -p cilium-648984 sudo crio | cilium-648984 | jenkins | v1.31.2 | 19 Sep 23 17:36 UTC | |
| | config | | | | | |
| delete | -p cilium-648984 | cilium-648984 | jenkins | v1.31.2 | 19 Sep 23 17:36 UTC | 19 Sep 23 17:36 UTC |
| start | -p old-k8s-version-100627 | old-k8s-version-100627 | jenkins | v1.31.2 | 19 Sep 23 17:36 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.16.0 | | | | | |
| ssh | cert-options-512928 ssh | cert-options-512928 | jenkins | v1.31.2 | 19 Sep 23 17:37 UTC | 19 Sep 23 17:37 UTC |
| | openssl x509 -text -noout -in | | | | | |
| | /var/lib/minikube/certs/apiserver.crt | | | | | |
| ssh | -p cert-options-512928 -- sudo | cert-options-512928 | jenkins | v1.31.2 | 19 Sep 23 17:37 UTC | 19 Sep 23 17:37 UTC |
| | cat /etc/kubernetes/admin.conf | | | | | |
| delete | -p cert-options-512928 | cert-options-512928 | jenkins | v1.31.2 | 19 Sep 23 17:37 UTC | 19 Sep 23 17:37 UTC |
| start | -p no-preload-215748 | no-preload-215748 | jenkins | v1.31.2 | 19 Sep 23 17:37 UTC | 19 Sep 23 17:39 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --preload=false --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.2 | | | | | |
| delete | -p force-systemd-env-367630 | force-systemd-env-367630 | jenkins | v1.31.2 | 19 Sep 23 17:37 UTC | 19 Sep 23 17:37 UTC |
| start | -p embed-certs-415155 | embed-certs-415155 | jenkins | v1.31.2 | 19 Sep 23 17:37 UTC | 19 Sep 23 17:39 UTC |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.2 | | | | | |
| start | -p cert-expiration-142729 | cert-expiration-142729 | jenkins | v1.31.2 | 19 Sep 23 17:39 UTC | 19 Sep 23 17:40 UTC |
| | --memory=2048 | | | | | |
| | --cert-expiration=8760h | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| addons | enable metrics-server -p embed-certs-415155 | embed-certs-415155 | jenkins | v1.31.2 | 19 Sep 23 17:39 UTC | 19 Sep 23 17:39 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p embed-certs-415155 | embed-certs-415155 | jenkins | v1.31.2 | 19 Sep 23 17:39 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| delete | -p cert-expiration-142729 | cert-expiration-142729 | jenkins | v1.31.2 | 19 Sep 23 17:40 UTC | 19 Sep 23 17:40 UTC |
| delete | -p | disable-driver-mounts-140688 | jenkins | v1.31.2 | 19 Sep 23 17:40 UTC | 19 Sep 23 17:40 UTC |
| | disable-driver-mounts-140688 | | | | | |
| start | -p | default-k8s-diff-port-415555 | jenkins | v1.31.2 | 19 Sep 23 17:40 UTC | 19 Sep 23 17:41 UTC |
| | default-k8s-diff-port-415555 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.2 | | | | | |
| addons | enable metrics-server -p no-preload-215748 | no-preload-215748 | jenkins | v1.31.2 | 19 Sep 23 17:40 UTC | 19 Sep 23 17:40 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p no-preload-215748 | no-preload-215748 | jenkins | v1.31.2 | 19 Sep 23 17:40 UTC | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable metrics-server -p default-k8s-diff-port-415555 | default-k8s-diff-port-415555 | jenkins | v1.31.2 | 19 Sep 23 17:41 UTC | 19 Sep 23 17:41 UTC |
| | --images=MetricsServer=registry.k8s.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p | default-k8s-diff-port-415555 | jenkins | v1.31.2 | 19 Sep 23 17:41 UTC | |
| | default-k8s-diff-port-415555 | | | | | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p embed-certs-415155 | embed-certs-415155 | jenkins | v1.31.2 | 19 Sep 23 17:42 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p embed-certs-415155 | embed-certs-415155 | jenkins | v1.31.2 | 19 Sep 23 17:42 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.2 | | | | | |
| addons | enable dashboard -p no-preload-215748 | no-preload-215748 | jenkins | v1.31.2 | 19 Sep 23 17:42 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p no-preload-215748 | no-preload-215748 | jenkins | v1.31.2 | 19 Sep 23 17:42 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --preload=false --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.2 | | | | | |
| addons | enable dashboard -p default-k8s-diff-port-415555 | default-k8s-diff-port-415555 | jenkins | v1.31.2 | 19 Sep 23 17:43 UTC | |
| | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 | | | | | |
| start | -p | default-k8s-diff-port-415555 | jenkins | v1.31.2 | 19 Sep 23 17:43 UTC | |
| | default-k8s-diff-port-415555 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.28.2 | | | | | |
|---------|--------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
*
* ==> Last Start <==
* Log file created at: 2023/09/19 17:43:53
Running on machine: ubuntu-20-agent-10
Binary: Built with gc go1.21.1 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0919 17:43:53.143776 46282 out.go:296] Setting OutFile to fd 1 ...
I0919 17:43:53.143989 46282 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0919 17:43:53.143999 46282 out.go:309] Setting ErrFile to fd 2...
I0919 17:43:53.144004 46282 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0919 17:43:53.144206 46282 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17240-6042/.minikube/bin
I0919 17:43:53.144773 46282 out.go:303] Setting JSON to false
I0919 17:43:53.145692 46282 start.go:128] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":5183,"bootTime":1695140250,"procs":215,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1042-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0919 17:43:53.145746 46282 start.go:138] virtualization: kvm guest
I0919 17:43:53.147852 46282 out.go:177] * [default-k8s-diff-port-415555] minikube v1.31.2 on Ubuntu 20.04 (kvm/amd64)
I0919 17:43:53.149321 46282 notify.go:220] Checking for updates...
I0919 17:43:53.149323 46282 out.go:177] - MINIKUBE_LOCATION=17240
I0919 17:43:53.150664 46282 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0919 17:43:53.151992 46282 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17240-6042/kubeconfig
I0919 17:43:53.153130 46282 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17240-6042/.minikube
I0919 17:43:53.154338 46282 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0919 17:43:53.155518 46282 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0919 17:43:53.157161 46282 config.go:182] Loaded profile config "default-k8s-diff-port-415555": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.2
I0919 17:43:53.157518 46282 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0919 17:43:53.157579 46282 main.go:141] libmachine: Launching plugin server for driver kvm2
I0919 17:43:53.174263 46282 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40369
I0919 17:43:53.174724 46282 main.go:141] libmachine: () Calling .GetVersion
I0919 17:43:53.175213 46282 main.go:141] libmachine: Using API Version 1
I0919 17:43:53.175236 46282 main.go:141] libmachine: () Calling .SetConfigRaw
I0919 17:43:53.175561 46282 main.go:141] libmachine: () Calling .GetMachineName
I0919 17:43:53.175741 46282 main.go:141] libmachine: (default-k8s-diff-port-415555) Calling .DriverName
I0919 17:43:53.175946 46282 driver.go:373] Setting default libvirt URI to qemu:///system
I0919 17:43:53.176264 46282 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0919 17:43:53.176289 46282 main.go:141] libmachine: Launching plugin server for driver kvm2
I0919 17:43:53.190580 46282 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42477
I0919 17:43:53.190951 46282 main.go:141] libmachine: () Calling .GetVersion
I0919 17:43:53.191398 46282 main.go:141] libmachine: Using API Version 1
I0919 17:43:53.191426 46282 main.go:141] libmachine: () Calling .SetConfigRaw
I0919 17:43:53.191709 46282 main.go:141] libmachine: () Calling .GetMachineName
I0919 17:43:53.191859 46282 main.go:141] libmachine: (default-k8s-diff-port-415555) Calling .DriverName
I0919 17:43:53.227664 46282 out.go:177] * Using the kvm2 driver based on existing profile
I0919 17:43:53.229039 46282 start.go:298] selected driver: kvm2
I0919 17:43:53.229054 46282 start.go:902] validating driver "kvm2" against &{Name:default-k8s-diff-port-415555 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuber
netesConfig:{KubernetesVersion:v1.28.2 ClusterName:default-k8s-diff-port-415555 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.61.228 Port:8444 KubernetesVersion:v1.28.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRe
quested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
I0919 17:43:53.229153 46282 start.go:913] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0919 17:43:53.229787 46282 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0919 17:43:53.229863 46282 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17240-6042/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0919 17:43:53.244494 46282 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.31.2
I0919 17:43:53.244985 46282 start_flags.go:922] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0919 17:43:53.245035 46282 cni.go:84] Creating CNI manager for ""
I0919 17:43:53.245053 46282 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0919 17:43:53.245074 46282 start_flags.go:321] config:
{Name:default-k8s-diff-port-415555 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:default-k8s-diff-port-41555
5 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8444 NodeName:} Nodes:[{Name: IP:192.168.61.228 Port:8444 KubernetesVersion:v1.28.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/
home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
I0919 17:43:53.245267 46282 iso.go:125] acquiring lock: {Name:mk514aa5854fd317cc6dd61e19c3171ab4ae49dd Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0919 17:43:53.247015 46282 out.go:177] * Starting control plane node default-k8s-diff-port-415555 in cluster default-k8s-diff-port-415555
I0919 17:43:51.156669 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:43:52.378152 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:54.876756 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:56.877611 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:43:53.248233 46282 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime crio
I0919 17:43:53.248265 46282 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17240-6042/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-cri-o-overlay-amd64.tar.lz4
I0919 17:43:53.248275 46282 cache.go:57] Caching tarball of preloaded images
I0919 17:43:53.248361 46282 preload.go:174] Found /home/jenkins/minikube-integration/17240-6042/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0919 17:43:53.248372 46282 cache.go:60] Finished verifying existence of preloaded tar for v1.28.2 on crio
I0919 17:43:53.248543 46282 profile.go:148] Saving config to /home/jenkins/minikube-integration/17240-6042/.minikube/profiles/default-k8s-diff-port-415555/config.json ...
I0919 17:43:53.248757 46282 start.go:365] acquiring machines lock for default-k8s-diff-port-415555: {Name:mk1dfb481040588be213f94a9badd6ebd691d966 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0919 17:43:57.236656 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:44:00.308642 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:43:59.378184 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:01.876872 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:03.877276 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:05.877317 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:06.388660 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:44:09.460728 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:44:07.877444 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:09.878968 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:12.376921 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:14.876969 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:15.540630 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:44:18.612632 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:44:17.376230 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:19.377830 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:21.877906 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:24.692718 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:44:23.878491 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:25.879531 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:27.764733 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:44:28.375826 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:30.377657 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:33.844621 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:44:32.878209 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:35.376578 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:36.916606 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:44:37.377019 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:39.877984 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:41.881884 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:43.000617 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:44:44.377586 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:46.377884 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:46.068692 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:44:48.877801 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:51.377416 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:52.148692 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:44:55.220700 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:44:53.876874 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:55.876962 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:57.877638 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:44:59.878164 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:01.879235 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:01.300709 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:45:04.372652 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:45:04.377757 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:06.877198 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:10.452748 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:45:08.877418 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:10.878338 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:13.524717 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:45:13.376800 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:15.877398 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:19.604627 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:45:17.878181 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:20.376596 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:22.676664 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:45:22.376944 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:24.878244 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:28.756666 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:45:27.377379 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:29.876657 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:31.876765 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:31.828681 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:45:33.877071 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:36.376822 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:37.908665 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:45:38.877479 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:41.376856 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:40.980679 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:45:43.377597 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:45.877024 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:47.060675 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:45:50.132695 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:45:48.377283 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:50.377961 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:52.877056 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:54.877674 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:56.212702 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:45:59.284606 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:45:57.377616 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:45:59.876532 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:01.876764 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:05.364635 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:46:03.878819 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:06.377546 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:08.436674 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:46:08.877406 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:10.877528 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:14.516652 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:46:12.877952 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:15.377993 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:17.588657 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:46:17.875912 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:19.877080 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:23.668636 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:46:22.377093 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:24.878340 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:26.740703 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:46:27.377076 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:29.880578 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:32.820616 45696 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.50.6:22: connect: no route to host
I0919 17:46:32.378323 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:34.877137 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:37.380435 42957 pod_ready.go:102] pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace has status "Ready":"False"
I0919 17:46:39.857402 42957 pod_ready.go:81] duration metric: took 4m0.000143248s waiting for pod "coredns-5644d7b6d9-wqwp7" in "kube-system" namespace to be "Ready" ...
E0919 17:46:39.857441 42957 pod_ready.go:66] WaitExtra: waitPodCondition: context deadline exceeded
I0919 17:46:39.857470 42957 pod_ready.go:38] duration metric: took 8m0.083821212s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0919 17:46:39.859655 42957 out.go:177]
W0919 17:46:39.861310 42957 out.go:239] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: extra waiting: timed out waiting 6m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
W0919 17:46:39.861333 42957 out.go:239] *
W0919 17:46:39.862218 42957 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0919 17:46:39.863771 42957 out.go:177]
*
* ==> CRI-O <==
* -- Journal begins at Tue 2023-09-19 17:37:46 UTC, ends at Tue 2023-09-19 17:46:40 UTC. --
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.534788400Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1695145600534775519,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:106105,},InodesUsed:&UInt64Value{Value:59,},},},}" file="go-grpc-middleware/chain.go:25" id=ef08be2c-8b6a-46c4-abc4-afe7c6a2f795 name=/runtime.v1.ImageService/ImageFsInfo
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.535686915Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=6b7a275a-3d1b-4885-b7ac-0f61b89de68f name=/runtime.v1.RuntimeService/ListContainers
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.535736681Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=6b7a275a-3d1b-4885-b7ac-0f61b89de68f name=/runtime.v1.RuntimeService/ListContainers
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.535967942Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:cd3a2ff2dd02e68c9b36e67c2c8dbc23f784290a9e267a61863b3333bfe1841b,PodSandboxId:315fa8a919150756461960541a15bd0ee34b4f7bd648ce66f7b675f55d3f0969,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1695145121868019830,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 00e5e0c9-0453-440b-aa5c-e6811f428297,},Annotations:map[string]string{io.kubernetes.container.hash: c35ed1a9,io.kubernetes.container.restartCount: 0,io
.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5569a3d30ac5e669b8c8e01adb637c6964c5cc884711f295389e897409ee82b7,PodSandboxId:9fbd081ea40c0c09858c664ed414c5f2be3cb9735c48045c6137f23fd3829b15,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:cbceafaf273cb8f988bbb745cdf92224e481bbd1f26ccc750aecc6614bbf1a5c,State:CONTAINER_RUNNING,CreatedAt:1695145121375501629,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-j7kqn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 79381ec1-45a7-4424-8383-f97b530979d3,},Annotations:map[string]string{io.kubernetes.container.hash: 9ba77119,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0658611b1a00c3a12d3672173ded580b9dc0251c9b76468f95f5710ae53d6c1d,PodSandboxId:5d88ab4de24ffd6b21267bb2352bf505dd1247b93d50f22d4cb2e00d86791427,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1695145120570775835,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-wqwp7,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8756ca49-2953-422d-a534-6d1fa5655fbb,},Annotations:map[string]string{io.kubernetes.container.hash: 271b83d9,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"contai
nerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6545ae30fe659fbc649a68019833b3b9678bfaa082261d4c173519d92cc5983b,PodSandboxId:253eecfb31e2f4bee63f0d50aec37451f8e4fab1f1ad242114c19ade5ae93b38,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1695145120635632430,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-4mh4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 382ef590-a6ef-4402-8762-1649f060fbc4,},Annotat
ions:map[string]string{io.kubernetes.container.hash: 271b83d9,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ccd79e316d5ce66d282cf16f6ff2fd0e30a9c1588bc2025d86073f3ede3044a4,PodSandboxId:15fce98f19e25215d034ad81e017f798c0e49d20882abdd7a9faf115398e4d9d,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa,State:CONTAINER_RUNNING,CreatedAt:1695145096348692277,Labels:map[string]string{io.kubernetes.cont
ainer.name: etcd,io.kubernetes.pod.name: etcd-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b1a8584b7a2f3994535e7ec284367ee,},Annotations:map[string]string{io.kubernetes.container.hash: 84c4f7f8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72b50e541945c0acfe76f2984549e3bab1be1c9b1bda344701ac6a759e922772,PodSandboxId:386f3a0175c04ffcd2289f5a9b1480b70355711ebd73ee4b0995ea5bcb3f01cb,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:21942b42625f47a378008272b5b0b7e0c7f0e1be42569b6163796cebfad4bbf4,State:CONTAINER_RUNNING,CreatedAt:1695145094934102850,Labels:map[string]string{io.kubernetes.container.name: k
ube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7376ddb4f190a0ded9394063437bcb4e,},Annotations:map[string]string{io.kubernetes.container.hash: 8f61a3f7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1dfbf825cc4c1f6a4592aafb2ce7ca1ec620ce2fb0fb00cc80254a5c5208f3bf,PodSandboxId:757f7d97ffec6eec36c4ffc497210c15387eeb9c05ffb3ecbf7c7c949b3b5d9f,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:094023ab9cd02059eb0295d234ff9ea321e0e22e4813986d7f1a1ac4dc1990d0,State:CONTAINER_RUNNING,CreatedAt:1695145094708352030,Labels:map[string]string{io.kubernetes.container.
name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b3d303074fe0ca1d42a8bd9ed248df09,},Annotations:map[string]string{io.kubernetes.container.hash: 69e1a0b8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:782cd602a9a0a32020d1c1e29d23b93a30d0d1d4d18686ac5fb908d92733b171,PodSandboxId:e0a8651c19fd4a234a597dcc2608b414f3b275411ae0e086c143b3ffd9b8d22d,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_RUNNING,CreatedAt:1695145094536317875,Labels:map[string]string{io.kubernetes.container.name: kube-
apiserver,io.kubernetes.pod.name: kube-apiserver-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 07ab9b7d9d902c2a45d50d3a2fa34072,},Annotations:map[string]string{io.kubernetes.container.hash: 8e6ab6ae,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=6b7a275a-3d1b-4885-b7ac-0f61b89de68f name=/runtime.v1.RuntimeService/ListContainers
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.577280394Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=471f6b35-5fa4-40b8-9781-82db10fa5159 name=/runtime.v1.RuntimeService/Version
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.577334387Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=471f6b35-5fa4-40b8-9781-82db10fa5159 name=/runtime.v1.RuntimeService/Version
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.578450748Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=e4befdc2-09a5-420b-8a9d-9d9493b41e1c name=/runtime.v1.ImageService/ImageFsInfo
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.578946714Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1695145600578851668,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:106105,},InodesUsed:&UInt64Value{Value:59,},},},}" file="go-grpc-middleware/chain.go:25" id=e4befdc2-09a5-420b-8a9d-9d9493b41e1c name=/runtime.v1.ImageService/ImageFsInfo
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.579846894Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=8888c7d5-bd1a-4c8c-a68d-e16eeb178dae name=/runtime.v1.RuntimeService/ListContainers
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.579976757Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=8888c7d5-bd1a-4c8c-a68d-e16eeb178dae name=/runtime.v1.RuntimeService/ListContainers
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.580141367Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:cd3a2ff2dd02e68c9b36e67c2c8dbc23f784290a9e267a61863b3333bfe1841b,PodSandboxId:315fa8a919150756461960541a15bd0ee34b4f7bd648ce66f7b675f55d3f0969,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1695145121868019830,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 00e5e0c9-0453-440b-aa5c-e6811f428297,},Annotations:map[string]string{io.kubernetes.container.hash: c35ed1a9,io.kubernetes.container.restartCount: 0,io
.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5569a3d30ac5e669b8c8e01adb637c6964c5cc884711f295389e897409ee82b7,PodSandboxId:9fbd081ea40c0c09858c664ed414c5f2be3cb9735c48045c6137f23fd3829b15,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:cbceafaf273cb8f988bbb745cdf92224e481bbd1f26ccc750aecc6614bbf1a5c,State:CONTAINER_RUNNING,CreatedAt:1695145121375501629,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-j7kqn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 79381ec1-45a7-4424-8383-f97b530979d3,},Annotations:map[string]string{io.kubernetes.container.hash: 9ba77119,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0658611b1a00c3a12d3672173ded580b9dc0251c9b76468f95f5710ae53d6c1d,PodSandboxId:5d88ab4de24ffd6b21267bb2352bf505dd1247b93d50f22d4cb2e00d86791427,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1695145120570775835,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-wqwp7,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8756ca49-2953-422d-a534-6d1fa5655fbb,},Annotations:map[string]string{io.kubernetes.container.hash: 271b83d9,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"contai
nerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6545ae30fe659fbc649a68019833b3b9678bfaa082261d4c173519d92cc5983b,PodSandboxId:253eecfb31e2f4bee63f0d50aec37451f8e4fab1f1ad242114c19ade5ae93b38,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1695145120635632430,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-4mh4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 382ef590-a6ef-4402-8762-1649f060fbc4,},Annotat
ions:map[string]string{io.kubernetes.container.hash: 271b83d9,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ccd79e316d5ce66d282cf16f6ff2fd0e30a9c1588bc2025d86073f3ede3044a4,PodSandboxId:15fce98f19e25215d034ad81e017f798c0e49d20882abdd7a9faf115398e4d9d,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa,State:CONTAINER_RUNNING,CreatedAt:1695145096348692277,Labels:map[string]string{io.kubernetes.cont
ainer.name: etcd,io.kubernetes.pod.name: etcd-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b1a8584b7a2f3994535e7ec284367ee,},Annotations:map[string]string{io.kubernetes.container.hash: 84c4f7f8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72b50e541945c0acfe76f2984549e3bab1be1c9b1bda344701ac6a759e922772,PodSandboxId:386f3a0175c04ffcd2289f5a9b1480b70355711ebd73ee4b0995ea5bcb3f01cb,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:21942b42625f47a378008272b5b0b7e0c7f0e1be42569b6163796cebfad4bbf4,State:CONTAINER_RUNNING,CreatedAt:1695145094934102850,Labels:map[string]string{io.kubernetes.container.name: k
ube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7376ddb4f190a0ded9394063437bcb4e,},Annotations:map[string]string{io.kubernetes.container.hash: 8f61a3f7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1dfbf825cc4c1f6a4592aafb2ce7ca1ec620ce2fb0fb00cc80254a5c5208f3bf,PodSandboxId:757f7d97ffec6eec36c4ffc497210c15387eeb9c05ffb3ecbf7c7c949b3b5d9f,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:094023ab9cd02059eb0295d234ff9ea321e0e22e4813986d7f1a1ac4dc1990d0,State:CONTAINER_RUNNING,CreatedAt:1695145094708352030,Labels:map[string]string{io.kubernetes.container.
name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b3d303074fe0ca1d42a8bd9ed248df09,},Annotations:map[string]string{io.kubernetes.container.hash: 69e1a0b8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:782cd602a9a0a32020d1c1e29d23b93a30d0d1d4d18686ac5fb908d92733b171,PodSandboxId:e0a8651c19fd4a234a597dcc2608b414f3b275411ae0e086c143b3ffd9b8d22d,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_RUNNING,CreatedAt:1695145094536317875,Labels:map[string]string{io.kubernetes.container.name: kube-
apiserver,io.kubernetes.pod.name: kube-apiserver-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 07ab9b7d9d902c2a45d50d3a2fa34072,},Annotations:map[string]string{io.kubernetes.container.hash: 8e6ab6ae,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=8888c7d5-bd1a-4c8c-a68d-e16eeb178dae name=/runtime.v1.RuntimeService/ListContainers
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.625122117Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=2f4c0832-6bb1-4655-b9bb-7873a0f00333 name=/runtime.v1.RuntimeService/Version
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.625178635Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=2f4c0832-6bb1-4655-b9bb-7873a0f00333 name=/runtime.v1.RuntimeService/Version
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.626981486Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=ab53b6e7-85f3-49ae-bf57-c749c543f80a name=/runtime.v1.ImageService/ImageFsInfo
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.627325941Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1695145600627313052,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:106105,},InodesUsed:&UInt64Value{Value:59,},},},}" file="go-grpc-middleware/chain.go:25" id=ab53b6e7-85f3-49ae-bf57-c749c543f80a name=/runtime.v1.ImageService/ImageFsInfo
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.627972408Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=f9a7b17d-4733-46a7-b2de-580f82fa9579 name=/runtime.v1.RuntimeService/ListContainers
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.628023355Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=f9a7b17d-4733-46a7-b2de-580f82fa9579 name=/runtime.v1.RuntimeService/ListContainers
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.628194831Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:cd3a2ff2dd02e68c9b36e67c2c8dbc23f784290a9e267a61863b3333bfe1841b,PodSandboxId:315fa8a919150756461960541a15bd0ee34b4f7bd648ce66f7b675f55d3f0969,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1695145121868019830,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 00e5e0c9-0453-440b-aa5c-e6811f428297,},Annotations:map[string]string{io.kubernetes.container.hash: c35ed1a9,io.kubernetes.container.restartCount: 0,io
.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5569a3d30ac5e669b8c8e01adb637c6964c5cc884711f295389e897409ee82b7,PodSandboxId:9fbd081ea40c0c09858c664ed414c5f2be3cb9735c48045c6137f23fd3829b15,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:cbceafaf273cb8f988bbb745cdf92224e481bbd1f26ccc750aecc6614bbf1a5c,State:CONTAINER_RUNNING,CreatedAt:1695145121375501629,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-j7kqn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 79381ec1-45a7-4424-8383-f97b530979d3,},Annotations:map[string]string{io.kubernetes.container.hash: 9ba77119,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0658611b1a00c3a12d3672173ded580b9dc0251c9b76468f95f5710ae53d6c1d,PodSandboxId:5d88ab4de24ffd6b21267bb2352bf505dd1247b93d50f22d4cb2e00d86791427,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1695145120570775835,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-wqwp7,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8756ca49-2953-422d-a534-6d1fa5655fbb,},Annotations:map[string]string{io.kubernetes.container.hash: 271b83d9,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"contai
nerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6545ae30fe659fbc649a68019833b3b9678bfaa082261d4c173519d92cc5983b,PodSandboxId:253eecfb31e2f4bee63f0d50aec37451f8e4fab1f1ad242114c19ade5ae93b38,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1695145120635632430,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-4mh4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 382ef590-a6ef-4402-8762-1649f060fbc4,},Annotat
ions:map[string]string{io.kubernetes.container.hash: 271b83d9,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ccd79e316d5ce66d282cf16f6ff2fd0e30a9c1588bc2025d86073f3ede3044a4,PodSandboxId:15fce98f19e25215d034ad81e017f798c0e49d20882abdd7a9faf115398e4d9d,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa,State:CONTAINER_RUNNING,CreatedAt:1695145096348692277,Labels:map[string]string{io.kubernetes.cont
ainer.name: etcd,io.kubernetes.pod.name: etcd-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b1a8584b7a2f3994535e7ec284367ee,},Annotations:map[string]string{io.kubernetes.container.hash: 84c4f7f8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72b50e541945c0acfe76f2984549e3bab1be1c9b1bda344701ac6a759e922772,PodSandboxId:386f3a0175c04ffcd2289f5a9b1480b70355711ebd73ee4b0995ea5bcb3f01cb,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:21942b42625f47a378008272b5b0b7e0c7f0e1be42569b6163796cebfad4bbf4,State:CONTAINER_RUNNING,CreatedAt:1695145094934102850,Labels:map[string]string{io.kubernetes.container.name: k
ube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7376ddb4f190a0ded9394063437bcb4e,},Annotations:map[string]string{io.kubernetes.container.hash: 8f61a3f7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1dfbf825cc4c1f6a4592aafb2ce7ca1ec620ce2fb0fb00cc80254a5c5208f3bf,PodSandboxId:757f7d97ffec6eec36c4ffc497210c15387eeb9c05ffb3ecbf7c7c949b3b5d9f,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:094023ab9cd02059eb0295d234ff9ea321e0e22e4813986d7f1a1ac4dc1990d0,State:CONTAINER_RUNNING,CreatedAt:1695145094708352030,Labels:map[string]string{io.kubernetes.container.
name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b3d303074fe0ca1d42a8bd9ed248df09,},Annotations:map[string]string{io.kubernetes.container.hash: 69e1a0b8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:782cd602a9a0a32020d1c1e29d23b93a30d0d1d4d18686ac5fb908d92733b171,PodSandboxId:e0a8651c19fd4a234a597dcc2608b414f3b275411ae0e086c143b3ffd9b8d22d,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_RUNNING,CreatedAt:1695145094536317875,Labels:map[string]string{io.kubernetes.container.name: kube-
apiserver,io.kubernetes.pod.name: kube-apiserver-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 07ab9b7d9d902c2a45d50d3a2fa34072,},Annotations:map[string]string{io.kubernetes.container.hash: 8e6ab6ae,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=f9a7b17d-4733-46a7-b2de-580f82fa9579 name=/runtime.v1.RuntimeService/ListContainers
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.667177547Z" level=debug msg="Request: &VersionRequest{Version:,}" file="go-grpc-middleware/chain.go:25" id=22c9fe91-78a4-4c5e-a705-1aa9d5af99bb name=/runtime.v1.RuntimeService/Version
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.667235430Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.24.1,RuntimeApiVersion:v1,}" file="go-grpc-middleware/chain.go:25" id=22c9fe91-78a4-4c5e-a705-1aa9d5af99bb name=/runtime.v1.RuntimeService/Version
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.669097896Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="go-grpc-middleware/chain.go:25" id=fb8264e8-9394-4fad-b306-145e9b5f9571 name=/runtime.v1.ImageService/ImageFsInfo
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.669428646Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1695145600669418735,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:106105,},InodesUsed:&UInt64Value{Value:59,},},},}" file="go-grpc-middleware/chain.go:25" id=fb8264e8-9394-4fad-b306-145e9b5f9571 name=/runtime.v1.ImageService/ImageFsInfo
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.670147472Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="go-grpc-middleware/chain.go:25" id=9e44360f-9c7c-4e83-97f3-a51602b83991 name=/runtime.v1.RuntimeService/ListContainers
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.670193187Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:58" id=9e44360f-9c7c-4e83-97f3-a51602b83991 name=/runtime.v1.RuntimeService/ListContainers
Sep 19 17:46:40 old-k8s-version-100627 crio[715]: time="2023-09-19 17:46:40.670351365Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:cd3a2ff2dd02e68c9b36e67c2c8dbc23f784290a9e267a61863b3333bfe1841b,PodSandboxId:315fa8a919150756461960541a15bd0ee34b4f7bd648ce66f7b675f55d3f0969,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},},ImageRef:gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944,State:CONTAINER_RUNNING,CreatedAt:1695145121868019830,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 00e5e0c9-0453-440b-aa5c-e6811f428297,},Annotations:map[string]string{io.kubernetes.container.hash: c35ed1a9,io.kubernetes.container.restartCount: 0,io
.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5569a3d30ac5e669b8c8e01adb637c6964c5cc884711f295389e897409ee82b7,PodSandboxId:9fbd081ea40c0c09858c664ed414c5f2be3cb9735c48045c6137f23fd3829b15,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-proxy@sha256:cbceafaf273cb8f988bbb745cdf92224e481bbd1f26ccc750aecc6614bbf1a5c,State:CONTAINER_RUNNING,CreatedAt:1695145121375501629,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-j7kqn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 79381ec1-45a7-4424-8383-f97b530979d3,},Annotations:map[string]string{io.kubernetes.container.hash: 9ba77119,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessage
Path: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0658611b1a00c3a12d3672173ded580b9dc0251c9b76468f95f5710ae53d6c1d,PodSandboxId:5d88ab4de24ffd6b21267bb2352bf505dd1247b93d50f22d4cb2e00d86791427,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1695145120570775835,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-wqwp7,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8756ca49-2953-422d-a534-6d1fa5655fbb,},Annotations:map[string]string{io.kubernetes.container.hash: 271b83d9,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"contai
nerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6545ae30fe659fbc649a68019833b3b9678bfaa082261d4c173519d92cc5983b,PodSandboxId:253eecfb31e2f4bee63f0d50aec37451f8e4fab1f1ad242114c19ade5ae93b38,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5,State:CONTAINER_RUNNING,CreatedAt:1695145120635632430,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-5644d7b6d9-4mh4f,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 382ef590-a6ef-4402-8762-1649f060fbc4,},Annotat
ions:map[string]string{io.kubernetes.container.hash: 271b83d9,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ccd79e316d5ce66d282cf16f6ff2fd0e30a9c1588bc2025d86073f3ede3044a4,PodSandboxId:15fce98f19e25215d034ad81e017f798c0e49d20882abdd7a9faf115398e4d9d,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa,State:CONTAINER_RUNNING,CreatedAt:1695145096348692277,Labels:map[string]string{io.kubernetes.cont
ainer.name: etcd,io.kubernetes.pod.name: etcd-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7b1a8584b7a2f3994535e7ec284367ee,},Annotations:map[string]string{io.kubernetes.container.hash: 84c4f7f8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:72b50e541945c0acfe76f2984549e3bab1be1c9b1bda344701ac6a759e922772,PodSandboxId:386f3a0175c04ffcd2289f5a9b1480b70355711ebd73ee4b0995ea5bcb3f01cb,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-controller-manager@sha256:21942b42625f47a378008272b5b0b7e0c7f0e1be42569b6163796cebfad4bbf4,State:CONTAINER_RUNNING,CreatedAt:1695145094934102850,Labels:map[string]string{io.kubernetes.container.name: k
ube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 7376ddb4f190a0ded9394063437bcb4e,},Annotations:map[string]string{io.kubernetes.container.hash: 8f61a3f7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1dfbf825cc4c1f6a4592aafb2ce7ca1ec620ce2fb0fb00cc80254a5c5208f3bf,PodSandboxId:757f7d97ffec6eec36c4ffc497210c15387eeb9c05ffb3ecbf7c7c949b3b5d9f,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-scheduler@sha256:094023ab9cd02059eb0295d234ff9ea321e0e22e4813986d7f1a1ac4dc1990d0,State:CONTAINER_RUNNING,CreatedAt:1695145094708352030,Labels:map[string]string{io.kubernetes.container.
name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b3d303074fe0ca1d42a8bd9ed248df09,},Annotations:map[string]string{io.kubernetes.container.hash: 69e1a0b8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:782cd602a9a0a32020d1c1e29d23b93a30d0d1d4d18686ac5fb908d92733b171,PodSandboxId:e0a8651c19fd4a234a597dcc2608b414f3b275411ae0e086c143b3ffd9b8d22d,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e,Annotations:map[string]string{},},ImageRef:k8s.gcr.io/kube-apiserver@sha256:f1f91e317568f866cf9e270bd4827a25993c7ccb7cffa1842eefee92a28388d6,State:CONTAINER_RUNNING,CreatedAt:1695145094536317875,Labels:map[string]string{io.kubernetes.container.name: kube-
apiserver,io.kubernetes.pod.name: kube-apiserver-old-k8s-version-100627,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 07ab9b7d9d902c2a45d50d3a2fa34072,},Annotations:map[string]string{io.kubernetes.container.hash: 8e6ab6ae,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="go-grpc-middleware/chain.go:25" id=9e44360f-9c7c-4e83-97f3-a51602b83991 name=/runtime.v1.RuntimeService/ListContainers
*
* ==> container status <==
* CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
cd3a2ff2dd02e 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562 7 minutes ago Running storage-provisioner 0 315fa8a919150 storage-provisioner
5569a3d30ac5e c21b0c7400f988db4777858edd13b6d3930d62d7ccf026d2415485a52037f384 7 minutes ago Running kube-proxy 0 9fbd081ea40c0 kube-proxy-j7kqn
6545ae30fe659 bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b 8 minutes ago Running coredns 0 253eecfb31e2f coredns-5644d7b6d9-4mh4f
0658611b1a00c bf261d157914477ee1a5969d28ec687f3fbfc9fb5a664b22df78e57023b0e03b 8 minutes ago Running coredns 0 5d88ab4de24ff coredns-5644d7b6d9-wqwp7
ccd79e316d5ce b2756210eeabf84f3221da9959e9483f3919dc2aaab4cd45e7cd072fcbde27ed 8 minutes ago Running etcd 0 15fce98f19e25 etcd-old-k8s-version-100627
72b50e541945c 06a629a7e51cdcc81a5ed6a3e6650348312f20c954ac52ee489a023628ec9c7d 8 minutes ago Running kube-controller-manager 0 386f3a0175c04 kube-controller-manager-old-k8s-version-100627
1dfbf825cc4c1 301ddc62b80b16315d3c2653cf3888370394277afb3187614cfa20edc352ca0a 8 minutes ago Running kube-scheduler 0 757f7d97ffec6 kube-scheduler-old-k8s-version-100627
782cd602a9a0a b305571ca60a5a7818bda47da122683d75e8a1907475681ee8b1efbd06bff12e 8 minutes ago Running kube-apiserver 0 e0a8651c19fd4 kube-apiserver-old-k8s-version-100627
*
* ==> coredns [0658611b1a00c3a12d3672173ded580b9dc0251c9b76468f95f5710ae53d6c1d] <==
* 2023-09-19T17:42:33.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:42:43.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:42:53.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:43:03.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:43:13.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:43:23.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:43:33.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:43:43.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:43:53.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:44:03.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:44:13.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:44:23.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:44:33.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:44:43.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:44:53.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:45:03.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:45:13.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:45:23.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:45:33.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:45:43.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:45:53.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:46:03.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:46:13.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:46:23.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:46:33.204Z [INFO] plugin/ready: Still waiting on: "kubernetes"
*
* ==> coredns [6545ae30fe659fbc649a68019833b3b9678bfaa082261d4c173519d92cc5983b] <==
* 2023-09-19T17:42:36.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:42:46.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:42:56.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:43:06.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:43:16.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:43:26.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:43:36.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:43:46.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:43:56.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:44:06.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:44:16.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:44:26.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:44:36.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:44:46.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:44:56.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:45:06.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:45:16.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:45:26.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:45:36.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:45:46.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:45:56.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:46:06.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:46:16.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:46:26.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
2023-09-19T17:46:36.530Z [INFO] plugin/ready: Still waiting on: "kubernetes"
*
* ==> describe nodes <==
* Name: old-k8s-version-100627
Roles: master
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=old-k8s-version-100627
kubernetes.io/os=linux
minikube.k8s.io/commit=4d69d3d50d3fb420e04057e6545e9fd90e260986
minikube.k8s.io/name=old-k8s-version-100627
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2023_09_19T17_38_24_0700
minikube.k8s.io/version=v1.31.2
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 19 Sep 2023 17:38:19 +0000
Taints: <none>
Unschedulable: false
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Tue, 19 Sep 2023 17:46:30 +0000 Tue, 19 Sep 2023 17:38:14 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Tue, 19 Sep 2023 17:46:30 +0000 Tue, 19 Sep 2023 17:38:14 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Tue, 19 Sep 2023 17:46:30 +0000 Tue, 19 Sep 2023 17:38:14 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Tue, 19 Sep 2023 17:46:30 +0000 Tue, 19 Sep 2023 17:38:29 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.72.182
Hostname: old-k8s-version-100627
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165900Ki
pods: 110
System Info:
Machine ID: 60319d8735584b7ab7f14de7c68a7260
System UUID: 60319d87-3558-4b7a-b7f1-4de7c68a7260
Boot ID: bee3bafc-3dc6-4b62-9560-f22cc2d7bbea
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.1
Kubelet Version: v1.16.0
Kube-Proxy Version: v1.16.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (8 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system coredns-5644d7b6d9-4mh4f 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 8m1s
kube-system coredns-5644d7b6d9-wqwp7 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 8m1s
kube-system etcd-old-k8s-version-100627 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m1s
kube-system kube-apiserver-old-k8s-version-100627 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m56s
kube-system kube-controller-manager-old-k8s-version-100627 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 7m14s
kube-system kube-proxy-j7kqn 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m1s
kube-system kube-scheduler-old-k8s-version-100627 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 6m54s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 8m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%!)(MISSING) 0 (0%!)(MISSING)
memory 140Mi (6%!)(MISSING) 340Mi (16%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 8m27s (x8 over 8m27s) kubelet, old-k8s-version-100627 Node old-k8s-version-100627 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 8m27s (x8 over 8m27s) kubelet, old-k8s-version-100627 Node old-k8s-version-100627 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 8m27s (x7 over 8m27s) kubelet, old-k8s-version-100627 Node old-k8s-version-100627 status is now: NodeHasSufficientPID
Normal Starting 7m59s kube-proxy, old-k8s-version-100627 Starting kube-proxy.
*
* ==> dmesg <==
* [Sep19 17:37] You have booted with nomodeset. This means your GPU drivers are DISABLED
[ +0.000000] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.078577] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +4.542832] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.473933] systemd-fstab-generator[113]: Ignoring "noauto" for root device
[ +0.149977] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000001] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +5.113853] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000008] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)
[ +7.810829] systemd-fstab-generator[641]: Ignoring "noauto" for root device
[ +0.111629] systemd-fstab-generator[652]: Ignoring "noauto" for root device
[ +0.148622] systemd-fstab-generator[665]: Ignoring "noauto" for root device
[ +0.104170] systemd-fstab-generator[676]: Ignoring "noauto" for root device
[ +0.231359] systemd-fstab-generator[700]: Ignoring "noauto" for root device
[Sep19 17:38] systemd-fstab-generator[1040]: Ignoring "noauto" for root device
[ +2.377261] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
[Sep19 17:39] kauditd_printk_skb: 13 callbacks suppressed
*
* ==> etcd [ccd79e316d5ce66d282cf16f6ff2fd0e30a9c1588bc2025d86073f3ede3044a4] <==
* 2023-09-19 17:38:16.463365 I | etcdserver: ff4c26660998c2c8 as single-node; fast-forwarding 9 ticks (election ticks 10)
2023-09-19 17:38:16.463804 I | etcdserver/membership: added member ff4c26660998c2c8 [https://192.168.72.182:2380] to cluster 1c15affd5c0f3dba
2023-09-19 17:38:16.465161 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, ca = , trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file =
2023-09-19 17:38:16.465335 I | embed: listening for metrics on http://192.168.72.182:2381
2023-09-19 17:38:16.465435 I | embed: listening for metrics on http://127.0.0.1:2381
2023-09-19 17:38:16.550150 I | raft: ff4c26660998c2c8 is starting a new election at term 1
2023-09-19 17:38:16.550253 I | raft: ff4c26660998c2c8 became candidate at term 2
2023-09-19 17:38:16.550290 I | raft: ff4c26660998c2c8 received MsgVoteResp from ff4c26660998c2c8 at term 2
2023-09-19 17:38:16.550320 I | raft: ff4c26660998c2c8 became leader at term 2
2023-09-19 17:38:16.550344 I | raft: raft.node: ff4c26660998c2c8 elected leader ff4c26660998c2c8 at term 2
2023-09-19 17:38:16.550670 I | etcdserver: setting up the initial cluster version to 3.3
2023-09-19 17:38:16.552627 N | etcdserver/membership: set the initial cluster version to 3.3
2023-09-19 17:38:16.552797 I | etcdserver/api: enabled capabilities for version 3.3
2023-09-19 17:38:16.553137 I | etcdserver: published {Name:old-k8s-version-100627 ClientURLs:[https://192.168.72.182:2379]} to cluster 1c15affd5c0f3dba
2023-09-19 17:38:16.553250 I | embed: ready to serve client requests
2023-09-19 17:38:16.556326 I | embed: serving client requests on 127.0.0.1:2379
2023-09-19 17:38:16.556626 I | embed: ready to serve client requests
2023-09-19 17:38:16.560592 I | embed: serving client requests on 192.168.72.182:2379
2023-09-19 17:38:30.156692 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/default/default\" " with result "range_response_count:0 size:5" took too long (240.921568ms) to execute
2023-09-19 17:38:38.176075 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/default/default\" " with result "range_response_count:0 size:5" took too long (242.448456ms) to execute
2023-09-19 17:38:38.176239 W | etcdserver: request "header:<ID:14035620720868131846 > lease_revoke:<id:42c88aae857502ee>" with result "size:28" took too long (207.665995ms) to execute
2023-09-19 17:38:38.176474 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kube-system/endpoint-controller\" " with result "range_response_count:0 size:5" took too long (176.188393ms) to execute
2023-09-19 17:38:38.884670 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kube-system/certificate-controller\" " with result "range_response_count:1 size:263" took too long (134.704768ms) to execute
2023-09-19 17:38:56.796009 W | etcdserver: read-only range request "key:\"/registry/jobs/\" range_end:\"/registry/jobs0\" limit:500 " with result "range_response_count:0 size:5" took too long (228.124951ms) to execute
2023-09-19 17:40:38.862535 W | etcdserver: read-only range request "key:\"/registry/storageclasses\" range_end:\"/registry/storageclasset\" count_only:true " with result "range_response_count:0 size:7" took too long (104.260758ms) to execute
*
* ==> kernel <==
* 17:46:41 up 9 min, 0 users, load average: 0.23, 0.32, 0.19
Linux old-k8s-version-100627 5.10.57 #1 SMP Mon Sep 18 23:12:38 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
*
* ==> kube-apiserver [782cd602a9a0a32020d1c1e29d23b93a30d0d1d4d18686ac5fb908d92733b171] <==
* I0919 17:38:19.621956 1 apiapproval_controller.go:185] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0919 17:38:19.622047 1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0919 17:38:19.622051 1 shared_informer.go:197] Waiting for caches to sync for crd-autoregister
I0919 17:38:19.689811 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0919 17:38:19.690019 1 cache.go:39] Caches are synced for AvailableConditionController controller
I0919 17:38:19.690047 1 cache.go:39] Caches are synced for autoregister controller
E0919 17:38:19.698125 1 controller.go:154] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.72.182, ResourceVersion: 0, AdditionalErrorMsg:
I0919 17:38:19.723952 1 shared_informer.go:204] Caches are synced for crd-autoregister
I0919 17:38:20.583216 1 controller.go:107] OpenAPI AggregationController: Processing item
I0919 17:38:20.583279 1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0919 17:38:20.583295 1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0919 17:38:20.615769 1 storage_scheduling.go:139] created PriorityClass system-node-critical with value 2000001000
I0919 17:38:20.658919 1 storage_scheduling.go:139] created PriorityClass system-cluster-critical with value 2000000000
I0919 17:38:20.658962 1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.
I0919 17:38:22.367159 1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0919 17:38:22.647294 1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0919 17:38:22.924945 1 lease.go:222] Resetting endpoints for master service "kubernetes" to [192.168.72.182]
I0919 17:38:22.925625 1 controller.go:606] quota admission added evaluator for: endpoints
I0919 17:38:22.996358 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0919 17:38:23.903731 1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0919 17:38:24.335373 1 controller.go:606] quota admission added evaluator for: deployments.apps
I0919 17:38:24.666554 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0919 17:38:39.091965 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0919 17:38:39.155559 1 controller.go:606] quota admission added evaluator for: events.events.k8s.io
I0919 17:38:39.418724 1 controller.go:606] quota admission added evaluator for: replicasets.apps
*
* ==> kube-controller-manager [72b50e541945c0acfe76f2984549e3bab1be1c9b1bda344701ac6a759e922772] <==
* I0919 17:38:39.175439 1 range_allocator.go:359] Set node old-k8s-version-100627 PodCIDR to [10.244.0.0/24]
E0919 17:38:39.183679 1 clusterroleaggregation_controller.go:180] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
E0919 17:38:39.192328 1 clusterroleaggregation_controller.go:180] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
E0919 17:38:39.211033 1 daemon_controller.go:302] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"/apis/apps/v1/namespaces/kube-system/daemonsets/kube-proxy", UID:"e34d60ec-a40b-49ad-8c5d-48743f561cc4", ResourceVersion:"214", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63830741904, loc:(*time.Location)(0x7776000)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0xc0010e9860), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Names
pace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeS
ource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0xc00118a940), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0010e9880), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolu
meSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIV
olumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0010e98a0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.A
zureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.16.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc0010e98e0)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMo
de)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc000adf8b0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc001965768), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"beta.kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServic
eAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc001186f60), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy
{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0xc0000b2a48)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0xc0019657a8)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
E0919 17:38:39.223158 1 clusterroleaggregation_controller.go:180] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
E0919 17:38:39.226674 1 clusterroleaggregation_controller.go:180] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
E0919 17:38:39.232108 1 daemon_controller.go:302] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"/apis/apps/v1/namespaces/kube-system/daemonsets/kube-proxy", UID:"e34d60ec-a40b-49ad-8c5d-48743f561cc4", ResourceVersion:"302", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63830741904, loc:(*time.Location)(0x7776000)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0xc0008eb5e0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Names
pace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeS
ource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0xc001234300), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0008eb640), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolu
meSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIV
olumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0008eb6a0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.A
zureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.16.0", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc0008eb740)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMo
de)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc000c2d450), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc000ff0868), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"beta.kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServic
eAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc000f3d1a0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy
{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0xc0013ffc68)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0xc000ff08d8)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:1, NumberReady:0, ObservedGeneration:1, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:1, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
I0919 17:38:39.391440 1 shared_informer.go:204] Caches are synced for certificate
I0919 17:38:39.393914 1 shared_informer.go:204] Caches are synced for certificate
I0919 17:38:39.413384 1 shared_informer.go:204] Caches are synced for deployment
I0919 17:38:39.424230 1 log.go:172] [INFO] signed certificate with serial number 562132878288470005005945764890910827329382968291
I0919 17:38:39.442397 1 event.go:255] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"coredns", UID:"82b5bd0f-d42e-4be7-9b41-8c3c06d06980", APIVersion:"apps/v1", ResourceVersion:"201", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set coredns-5644d7b6d9 to 2
I0919 17:38:39.501447 1 shared_informer.go:204] Caches are synced for ReplicaSet
I0919 17:38:39.504142 1 shared_informer.go:204] Caches are synced for disruption
I0919 17:38:39.504219 1 disruption.go:341] Sending events to api server.
I0919 17:38:39.522146 1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-5644d7b6d9", UID:"a3b69ca5-82b2-424f-8386-c62c0930371e", APIVersion:"apps/v1", ResourceVersion:"324", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: coredns-5644d7b6d9-wqwp7
I0919 17:38:39.565328 1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-5644d7b6d9", UID:"a3b69ca5-82b2-424f-8386-c62c0930371e", APIVersion:"apps/v1", ResourceVersion:"324", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: coredns-5644d7b6d9-4mh4f
I0919 17:38:39.600660 1 shared_informer.go:204] Caches are synced for garbage collector
I0919 17:38:39.600723 1 garbagecollector.go:139] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0919 17:38:39.604715 1 shared_informer.go:204] Caches are synced for endpoint
I0919 17:38:39.607121 1 shared_informer.go:204] Caches are synced for resource quota
I0919 17:38:39.642559 1 shared_informer.go:204] Caches are synced for garbage collector
I0919 17:38:39.642739 1 shared_informer.go:204] Caches are synced for resource quota
*
* ==> kube-proxy [5569a3d30ac5e669b8c8e01adb637c6964c5cc884711f295389e897409ee82b7] <==
* W0919 17:38:41.705471 1 server_others.go:329] Flag proxy-mode="" unknown, assuming iptables proxy
I0919 17:38:41.713542 1 node.go:135] Successfully retrieved node IP: 192.168.72.182
I0919 17:38:41.713612 1 server_others.go:149] Using iptables Proxier.
I0919 17:38:41.713981 1 server.go:529] Version: v1.16.0
I0919 17:38:41.718100 1 config.go:131] Starting endpoints config controller
I0919 17:38:41.718142 1 shared_informer.go:197] Waiting for caches to sync for endpoints config
I0919 17:38:41.721155 1 config.go:313] Starting service config controller
I0919 17:38:41.721202 1 shared_informer.go:197] Waiting for caches to sync for service config
I0919 17:38:41.821472 1 shared_informer.go:204] Caches are synced for service config
I0919 17:38:41.826316 1 shared_informer.go:204] Caches are synced for endpoints config
*
* ==> kube-scheduler [1dfbf825cc4c1f6a4592aafb2ce7ca1ec620ce2fb0fb00cc80254a5c5208f3bf] <==
* W0919 17:38:19.699076 1 authentication.go:79] Authentication is disabled
I0919 17:38:19.699216 1 deprecated_insecure_serving.go:51] Serving healthz insecurely on [::]:10251
I0919 17:38:19.706919 1 secure_serving.go:123] Serving securely on 127.0.0.1:10259
E0919 17:38:19.752325 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0919 17:38:19.752463 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0919 17:38:19.752528 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0919 17:38:19.752573 1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0919 17:38:19.752613 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0919 17:38:19.752848 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0919 17:38:19.753021 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0919 17:38:19.753146 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0919 17:38:19.753208 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0919 17:38:19.753620 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0919 17:38:19.763973 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0919 17:38:20.756203 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0919 17:38:20.756482 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0919 17:38:20.758258 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0919 17:38:20.759434 1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0919 17:38:20.759511 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0919 17:38:20.761224 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0919 17:38:20.763344 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0919 17:38:20.763410 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0919 17:38:20.764428 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0919 17:38:20.765352 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0919 17:38:20.766474 1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
*
* ==> kubelet <==
* -- Journal begins at Tue 2023-09-19 17:37:46 UTC, ends at Tue 2023-09-19 17:46:41 UTC. --
Sep 19 17:38:20 old-k8s-version-100627 kubelet[1071]: E0919 17:38:20.140668 1071 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"old-k8s-version-100627.17865d7b2ab9998f", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"old-k8s-version-100627", UID:"old-k8s-version-100627", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node old-k8s-version-100627 status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:
"kubelet", Host:"old-k8s-version-100627"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc13a950153b6a78f, ext:207354962, loc:(*time.Location)(0x797f100)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc13a95015778bdc4, ext:270406268, loc:(*time.Location)(0x797f100)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 19 17:38:20 old-k8s-version-100627 kubelet[1071]: E0919 17:38:20.196412 1071 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"old-k8s-version-100627.17865d7b2ab9a6b9", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"old-k8s-version-100627", UID:"old-k8s-version-100627", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node old-k8s-version-100627 status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"k
ubelet", Host:"old-k8s-version-100627"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc13a950153b6b4b9, ext:207358320, loc:(*time.Location)(0x797f100)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc13a95015778c8d8, ext:270409104, loc:(*time.Location)(0x797f100)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 19 17:38:20 old-k8s-version-100627 kubelet[1071]: E0919 17:38:20.260636 1071 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"old-k8s-version-100627.17865d7b2ab98230", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"old-k8s-version-100627", UID:"old-k8s-version-100627", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node old-k8s-version-100627 status is now: NodeHasSufficientMemory", Source:v1.EventSource{Compon
ent:"kubelet", Host:"old-k8s-version-100627"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc13a950153b69030, ext:207348979, loc:(*time.Location)(0x797f100)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc13a9501638b7abe, ext:472960897, loc:(*time.Location)(0x797f100)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 19 17:38:20 old-k8s-version-100627 kubelet[1071]: E0919 17:38:20.663848 1071 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"old-k8s-version-100627.17865d7b2ab9998f", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"old-k8s-version-100627", UID:"old-k8s-version-100627", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node old-k8s-version-100627 status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:
"kubelet", Host:"old-k8s-version-100627"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc13a950153b6a78f, ext:207354962, loc:(*time.Location)(0x797f100)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc13a9501638b9a92, ext:472969044, loc:(*time.Location)(0x797f100)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 19 17:38:21 old-k8s-version-100627 kubelet[1071]: E0919 17:38:21.061383 1071 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"old-k8s-version-100627.17865d7b2ab9a6b9", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"old-k8s-version-100627", UID:"old-k8s-version-100627", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node old-k8s-version-100627 status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"k
ubelet", Host:"old-k8s-version-100627"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc13a950153b6b4b9, ext:207358320, loc:(*time.Location)(0x797f100)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc13a9501638baa0d, ext:472973005, loc:(*time.Location)(0x797f100)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 19 17:38:21 old-k8s-version-100627 kubelet[1071]: E0919 17:38:21.460799 1071 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"old-k8s-version-100627.17865d7b2ab9a6b9", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"old-k8s-version-100627", UID:"old-k8s-version-100627", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node old-k8s-version-100627 status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"k
ubelet", Host:"old-k8s-version-100627"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc13a950153b6b4b9, ext:207358320, loc:(*time.Location)(0x797f100)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc13a9501693f8d0a, ext:568648133, loc:(*time.Location)(0x797f100)}}, Count:4, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 19 17:38:21 old-k8s-version-100627 kubelet[1071]: E0919 17:38:21.862600 1071 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"old-k8s-version-100627.17865d7b2ab98230", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"old-k8s-version-100627", UID:"old-k8s-version-100627", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node old-k8s-version-100627 status is now: NodeHasSufficientMemory", Source:v1.EventSource{Compon
ent:"kubelet", Host:"old-k8s-version-100627"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc13a950153b69030, ext:207348979, loc:(*time.Location)(0x797f100)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc13a9501693f61d8, ext:568637074, loc:(*time.Location)(0x797f100)}}, Count:4, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 19 17:38:22 old-k8s-version-100627 kubelet[1071]: E0919 17:38:22.261128 1071 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"old-k8s-version-100627.17865d7b2ab9998f", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"old-k8s-version-100627", UID:"old-k8s-version-100627", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node old-k8s-version-100627 status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:
"kubelet", Host:"old-k8s-version-100627"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc13a950153b6a78f, ext:207354962, loc:(*time.Location)(0x797f100)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc13a9501693f7d22, ext:568644070, loc:(*time.Location)(0x797f100)}}, Count:4, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 19 17:38:22 old-k8s-version-100627 kubelet[1071]: E0919 17:38:22.661061 1071 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"old-k8s-version-100627.17865d7b2ab9a6b9", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"old-k8s-version-100627", UID:"old-k8s-version-100627", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node old-k8s-version-100627 status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"k
ubelet", Host:"old-k8s-version-100627"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc13a950153b6b4b9, ext:207358320, loc:(*time.Location)(0x797f100)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc13a950169ac729d, ext:575784791, loc:(*time.Location)(0x797f100)}}, Count:5, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 19 17:38:23 old-k8s-version-100627 kubelet[1071]: E0919 17:38:23.354035 1071 kubelet.go:2187] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Sep 19 17:38:39 old-k8s-version-100627 kubelet[1071]: I0919 17:38:39.180818 1071 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "lib-modules" (UniqueName: "kubernetes.io/host-path/79381ec1-45a7-4424-8383-f97b530979d3-lib-modules") pod "kube-proxy-j7kqn" (UID: "79381ec1-45a7-4424-8383-f97b530979d3")
Sep 19 17:38:39 old-k8s-version-100627 kubelet[1071]: I0919 17:38:39.180945 1071 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-proxy" (UniqueName: "kubernetes.io/configmap/79381ec1-45a7-4424-8383-f97b530979d3-kube-proxy") pod "kube-proxy-j7kqn" (UID: "79381ec1-45a7-4424-8383-f97b530979d3")
Sep 19 17:38:39 old-k8s-version-100627 kubelet[1071]: I0919 17:38:39.181009 1071 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-proxy-token-kpbrd" (UniqueName: "kubernetes.io/secret/79381ec1-45a7-4424-8383-f97b530979d3-kube-proxy-token-kpbrd") pod "kube-proxy-j7kqn" (UID: "79381ec1-45a7-4424-8383-f97b530979d3")
Sep 19 17:38:39 old-k8s-version-100627 kubelet[1071]: I0919 17:38:39.181049 1071 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "xtables-lock" (UniqueName: "kubernetes.io/host-path/79381ec1-45a7-4424-8383-f97b530979d3-xtables-lock") pod "kube-proxy-j7kqn" (UID: "79381ec1-45a7-4424-8383-f97b530979d3")
Sep 19 17:38:39 old-k8s-version-100627 kubelet[1071]: I0919 17:38:39.271329 1071 kuberuntime_manager.go:961] updating runtime config through cri with podcidr 10.244.0.0/24
Sep 19 17:38:39 old-k8s-version-100627 kubelet[1071]: I0919 17:38:39.272390 1071 kubelet_network.go:77] Setting Pod CIDR: -> 10.244.0.0/24
Sep 19 17:38:39 old-k8s-version-100627 kubelet[1071]: W0919 17:38:39.498609 1071 container.go:409] Failed to create summary reader for "/kubepods/besteffort/pod79381ec1-45a7-4424-8383-f97b530979d3/crio-conmon-9fbd081ea40c0c09858c664ed414c5f2be3cb9735c48045c6137f23fd3829b15": none of the resources are being tracked.
Sep 19 17:38:39 old-k8s-version-100627 kubelet[1071]: I0919 17:38:39.582138 1071 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "config-volume" (UniqueName: "kubernetes.io/configmap/8756ca49-2953-422d-a534-6d1fa5655fbb-config-volume") pod "coredns-5644d7b6d9-wqwp7" (UID: "8756ca49-2953-422d-a534-6d1fa5655fbb")
Sep 19 17:38:39 old-k8s-version-100627 kubelet[1071]: I0919 17:38:39.582172 1071 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "coredns-token-8dhqs" (UniqueName: "kubernetes.io/secret/8756ca49-2953-422d-a534-6d1fa5655fbb-coredns-token-8dhqs") pod "coredns-5644d7b6d9-wqwp7" (UID: "8756ca49-2953-422d-a534-6d1fa5655fbb")
Sep 19 17:38:39 old-k8s-version-100627 kubelet[1071]: I0919 17:38:39.682509 1071 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "config-volume" (UniqueName: "kubernetes.io/configmap/382ef590-a6ef-4402-8762-1649f060fbc4-config-volume") pod "coredns-5644d7b6d9-4mh4f" (UID: "382ef590-a6ef-4402-8762-1649f060fbc4")
Sep 19 17:38:39 old-k8s-version-100627 kubelet[1071]: I0919 17:38:39.682586 1071 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "coredns-token-8dhqs" (UniqueName: "kubernetes.io/secret/382ef590-a6ef-4402-8762-1649f060fbc4-coredns-token-8dhqs") pod "coredns-5644d7b6d9-4mh4f" (UID: "382ef590-a6ef-4402-8762-1649f060fbc4")
Sep 19 17:38:41 old-k8s-version-100627 kubelet[1071]: I0919 17:38:41.087133 1071 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "tmp" (UniqueName: "kubernetes.io/host-path/00e5e0c9-0453-440b-aa5c-e6811f428297-tmp") pod "storage-provisioner" (UID: "00e5e0c9-0453-440b-aa5c-e6811f428297")
Sep 19 17:38:41 old-k8s-version-100627 kubelet[1071]: I0919 17:38:41.087243 1071 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "storage-provisioner-token-8wj7g" (UniqueName: "kubernetes.io/secret/00e5e0c9-0453-440b-aa5c-e6811f428297-storage-provisioner-token-8wj7g") pod "storage-provisioner" (UID: "00e5e0c9-0453-440b-aa5c-e6811f428297")
Sep 19 17:38:43 old-k8s-version-100627 kubelet[1071]: I0919 17:38:43.222180 1071 transport.go:132] certificate rotation detected, shutting down client connections to start using new credentials
Sep 19 17:43:13 old-k8s-version-100627 kubelet[1071]: E0919 17:43:13.353055 1071 container_manager_linux.go:510] failed to find cgroups of kubelet - cpu and memory cgroup hierarchy not unified. cpu: /, memory: /system.slice/kubelet.service
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-100627 -n old-k8s-version-100627
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-100627 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestStartStop/group/old-k8s-version/serial/FirstStart FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (584.44s)