=== RUN TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run: out/minikube-linux-amd64 start -p functional-453214 --alsologtostderr -v=8
E0305 01:52:10.322044 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:52:10.327790 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:52:10.338004 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:52:10.358286 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:52:10.398570 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:52:10.478871 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:52:10.639238 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:52:10.959778 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:52:11.600791 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:52:12.881285 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:52:15.443035 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:52:20.563625 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:52:30.804301 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:52:51.285046 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:53:32.245729 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:54:54.166679 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:57:10.322315 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 01:57:38.007821 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
E0305 02:02:10.321676 13668 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/addons-139295/client.crt: no such file or directory
functional_test.go:655: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-453214 --alsologtostderr -v=8: exit status 109 (13m59.108569241s)
-- stdout --
* [functional-453214] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=17909
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/17909-6453/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-6453/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the kvm2 driver based on existing profile
* Starting "functional-453214" primary control-plane node in "functional-453214" cluster
* Updating the running kvm2 "functional-453214" VM ...
* Preparing Kubernetes v1.28.4 on CRI-O 1.29.1 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Generating certificates and keys ...
- Booting up control plane ...
-- /stdout --
** stderr **
I0305 01:50:37.798632 19549 out.go:291] Setting OutFile to fd 1 ...
I0305 01:50:37.798725 19549 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0305 01:50:37.798733 19549 out.go:304] Setting ErrFile to fd 2...
I0305 01:50:37.798737 19549 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0305 01:50:37.798921 19549 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-6453/.minikube/bin
I0305 01:50:37.799427 19549 out.go:298] Setting JSON to false
I0305 01:50:37.800234 19549 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":1984,"bootTime":1709601454,"procs":180,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0305 01:50:37.800292 19549 start.go:139] virtualization: kvm guest
I0305 01:50:37.802451 19549 out.go:177] * [functional-453214] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0305 01:50:37.803876 19549 out.go:177] - MINIKUBE_LOCATION=17909
I0305 01:50:37.803844 19549 notify.go:220] Checking for updates...
I0305 01:50:37.805080 19549 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0305 01:50:37.806462 19549 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-6453/kubeconfig
I0305 01:50:37.807684 19549 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-6453/.minikube
I0305 01:50:37.808716 19549 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0305 01:50:37.809774 19549 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0305 01:50:37.811335 19549 config.go:182] Loaded profile config "functional-453214": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0305 01:50:37.811428 19549 driver.go:392] Setting default libvirt URI to qemu:///system
I0305 01:50:37.811778 19549 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0305 01:50:37.811838 19549 main.go:141] libmachine: Launching plugin server for driver kvm2
I0305 01:50:37.826017 19549 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37485
I0305 01:50:37.826412 19549 main.go:141] libmachine: () Calling .GetVersion
I0305 01:50:37.826870 19549 main.go:141] libmachine: Using API Version 1
I0305 01:50:37.826888 19549 main.go:141] libmachine: () Calling .SetConfigRaw
I0305 01:50:37.827290 19549 main.go:141] libmachine: () Calling .GetMachineName
I0305 01:50:37.827476 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:37.861083 19549 out.go:177] * Using the kvm2 driver based on existing profile
I0305 01:50:37.862378 19549 start.go:297] selected driver: kvm2
I0305 01:50:37.862396 19549 start.go:901] validating driver "kvm2" against &{Name:functional-453214 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:functional-453214 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.62 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L Mount
GID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0305 01:50:37.862492 19549 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0305 01:50:37.862809 19549 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0305 01:50:37.862896 19549 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-6453/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0305 01:50:37.877502 19549 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0305 01:50:37.878197 19549 cni.go:84] Creating CNI manager for ""
I0305 01:50:37.878213 19549 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0305 01:50:37.878262 19549 start.go:340] cluster config:
{Name:functional-453214 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-453214 Namespace:default APIServer
HAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.62 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p
MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0305 01:50:37.878354 19549 iso.go:125] acquiring lock: {Name:mkf3f500c52164425f7db4bab55368d9b35643c9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0305 01:50:37.880055 19549 out.go:177] * Starting "functional-453214" primary control-plane node in "functional-453214" cluster
I0305 01:50:37.881210 19549 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0305 01:50:37.881237 19549 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-6453/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0305 01:50:37.881243 19549 cache.go:56] Caching tarball of preloaded images
I0305 01:50:37.881320 19549 preload.go:173] Found /home/jenkins/minikube-integration/17909-6453/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0305 01:50:37.881333 19549 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0305 01:50:37.881415 19549 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/config.json ...
I0305 01:50:37.881576 19549 start.go:360] acquireMachinesLock for functional-453214: {Name:mk8af9b6c4528f2050a2046e5c3c2bdca8c52f85 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0305 01:50:37.881615 19549 start.go:364] duration metric: took 22.492µs to acquireMachinesLock for "functional-453214"
I0305 01:50:37.881628 19549 start.go:96] Skipping create...Using existing machine configuration
I0305 01:50:37.881635 19549 fix.go:54] fixHost starting:
I0305 01:50:37.881877 19549 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0305 01:50:37.881904 19549 main.go:141] libmachine: Launching plugin server for driver kvm2
I0305 01:50:37.895399 19549 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43199
I0305 01:50:37.895741 19549 main.go:141] libmachine: () Calling .GetVersion
I0305 01:50:37.896180 19549 main.go:141] libmachine: Using API Version 1
I0305 01:50:37.896209 19549 main.go:141] libmachine: () Calling .SetConfigRaw
I0305 01:50:37.896480 19549 main.go:141] libmachine: () Calling .GetMachineName
I0305 01:50:37.896646 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:37.896794 19549 main.go:141] libmachine: (functional-453214) Calling .GetState
I0305 01:50:37.898123 19549 fix.go:112] recreateIfNeeded on functional-453214: state=Running err=<nil>
W0305 01:50:37.898152 19549 fix.go:138] unexpected machine state, will restart: <nil>
I0305 01:50:37.900017 19549 out.go:177] * Updating the running kvm2 "functional-453214" VM ...
I0305 01:50:37.901195 19549 machine.go:94] provisionDockerMachine start ...
I0305 01:50:37.901223 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:37.901393 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:37.903584 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:37.903966 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:37.903993 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:37.904093 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:37.904238 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:37.904375 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:37.904489 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:37.904604 19549 main.go:141] libmachine: Using SSH client type: native
I0305 01:50:37.904777 19549 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.62 22 <nil> <nil>}
I0305 01:50:37.904788 19549 main.go:141] libmachine: About to run SSH command:
hostname
I0305 01:50:38.007224 19549 main.go:141] libmachine: SSH cmd err, output: <nil>: functional-453214
I0305 01:50:38.007256 19549 main.go:141] libmachine: (functional-453214) Calling .GetMachineName
I0305 01:50:38.007508 19549 buildroot.go:166] provisioning hostname "functional-453214"
I0305 01:50:38.007550 19549 main.go:141] libmachine: (functional-453214) Calling .GetMachineName
I0305 01:50:38.007740 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:38.010576 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.010952 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:38.010980 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.011118 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:38.011343 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:38.011517 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:38.011632 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:38.011837 19549 main.go:141] libmachine: Using SSH client type: native
I0305 01:50:38.011988 19549 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.62 22 <nil> <nil>}
I0305 01:50:38.012002 19549 main.go:141] libmachine: About to run SSH command:
sudo hostname functional-453214 && echo "functional-453214" | sudo tee /etc/hostname
I0305 01:50:38.135252 19549 main.go:141] libmachine: SSH cmd err, output: <nil>: functional-453214
I0305 01:50:38.135279 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:38.137978 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.138434 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:38.138457 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.138641 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:38.138825 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:38.139012 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:38.139168 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:38.139316 19549 main.go:141] libmachine: Using SSH client type: native
I0305 01:50:38.139480 19549 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.62 22 <nil> <nil>}
I0305 01:50:38.139496 19549 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sfunctional-453214' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 functional-453214/g' /etc/hosts;
else
echo '127.0.1.1 functional-453214' | sudo tee -a /etc/hosts;
fi
fi
I0305 01:50:38.243381 19549 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0305 01:50:38.243410 19549 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-6453/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-6453/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-6453/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-6453/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-6453/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-6453/.minikube}
I0305 01:50:38.243434 19549 buildroot.go:174] setting up certificates
I0305 01:50:38.243443 19549 provision.go:84] configureAuth start
I0305 01:50:38.243454 19549 main.go:141] libmachine: (functional-453214) Calling .GetMachineName
I0305 01:50:38.243709 19549 main.go:141] libmachine: (functional-453214) Calling .GetIP
I0305 01:50:38.246286 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.246644 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:38.246670 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.246848 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:38.249142 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.249449 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:38.249476 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.249589 19549 provision.go:143] copyHostCerts
I0305 01:50:38.249633 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17909-6453/.minikube/ca.pem
I0305 01:50:38.249659 19549 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-6453/.minikube/ca.pem, removing ...
I0305 01:50:38.249668 19549 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-6453/.minikube/ca.pem
I0305 01:50:38.249726 19549 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-6453/.minikube/ca.pem (1078 bytes)
I0305 01:50:38.249831 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17909-6453/.minikube/cert.pem
I0305 01:50:38.249852 19549 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-6453/.minikube/cert.pem, removing ...
I0305 01:50:38.249856 19549 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-6453/.minikube/cert.pem
I0305 01:50:38.249879 19549 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-6453/.minikube/cert.pem (1123 bytes)
I0305 01:50:38.249939 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17909-6453/.minikube/key.pem
I0305 01:50:38.249955 19549 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-6453/.minikube/key.pem, removing ...
I0305 01:50:38.249959 19549 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-6453/.minikube/key.pem
I0305 01:50:38.249979 19549 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-6453/.minikube/key.pem (1679 bytes)
I0305 01:50:38.250035 19549 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-6453/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca-key.pem org=jenkins.functional-453214 san=[127.0.0.1 192.168.39.62 functional-453214 localhost minikube]
I0305 01:50:38.509908 19549 provision.go:177] copyRemoteCerts
I0305 01:50:38.509961 19549 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0305 01:50:38.509982 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:38.512509 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.512760 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:38.512796 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.512984 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:38.513187 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:38.513368 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:38.513522 19549 sshutil.go:53] new ssh client: &{IP:192.168.39.62 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-6453/.minikube/machines/functional-453214/id_rsa Username:docker}
I0305 01:50:38.604495 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0305 01:50:38.604567 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0305 01:50:38.635467 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0305 01:50:38.635533 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0305 01:50:38.662174 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/machines/server.pem -> /etc/docker/server.pem
I0305 01:50:38.662236 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0305 01:50:38.692321 19549 provision.go:87] duration metric: took 448.863621ms to configureAuth
I0305 01:50:38.692350 19549 buildroot.go:189] setting minikube options for container-runtime
I0305 01:50:38.692575 19549 config.go:182] Loaded profile config "functional-453214": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0305 01:50:38.692642 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:38.695368 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.695818 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:38.695846 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.695987 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:38.696199 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:38.696380 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:38.696547 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:38.696680 19549 main.go:141] libmachine: Using SSH client type: native
I0305 01:50:38.696854 19549 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.62 22 <nil> <nil>}
I0305 01:50:38.696875 19549 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0305 01:50:44.256069 19549 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0305 01:50:44.256094 19549 machine.go:97] duration metric: took 6.354877147s to provisionDockerMachine
I0305 01:50:44.256108 19549 start.go:293] postStartSetup for "functional-453214" (driver="kvm2")
I0305 01:50:44.256137 19549 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0305 01:50:44.256154 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:44.256449 19549 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0305 01:50:44.256483 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:44.259076 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.259470 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:44.259493 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.259663 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:44.259841 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:44.260020 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:44.260177 19549 sshutil.go:53] new ssh client: &{IP:192.168.39.62 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-6453/.minikube/machines/functional-453214/id_rsa Username:docker}
I0305 01:50:44.345657 19549 ssh_runner.go:195] Run: cat /etc/os-release
I0305 01:50:44.350432 19549 command_runner.go:130] > NAME=Buildroot
I0305 01:50:44.350448 19549 command_runner.go:130] > VERSION=2023.02.9-dirty
I0305 01:50:44.350455 19549 command_runner.go:130] > ID=buildroot
I0305 01:50:44.350464 19549 command_runner.go:130] > VERSION_ID=2023.02.9
I0305 01:50:44.350471 19549 command_runner.go:130] > PRETTY_NAME="Buildroot 2023.02.9"
I0305 01:50:44.350507 19549 info.go:137] Remote host: Buildroot 2023.02.9
I0305 01:50:44.350520 19549 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-6453/.minikube/addons for local assets ...
I0305 01:50:44.350583 19549 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-6453/.minikube/files for local assets ...
I0305 01:50:44.350684 19549 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/ssl/certs/136682.pem -> 136682.pem in /etc/ssl/certs
I0305 01:50:44.350694 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/ssl/certs/136682.pem -> /etc/ssl/certs/136682.pem
I0305 01:50:44.350777 19549 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/test/nested/copy/13668/hosts -> hosts in /etc/test/nested/copy/13668
I0305 01:50:44.350784 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/test/nested/copy/13668/hosts -> /etc/test/nested/copy/13668/hosts
I0305 01:50:44.350834 19549 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs /etc/test/nested/copy/13668
I0305 01:50:44.361617 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/ssl/certs/136682.pem --> /etc/ssl/certs/136682.pem (1708 bytes)
I0305 01:50:44.387106 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/test/nested/copy/13668/hosts --> /etc/test/nested/copy/13668/hosts (40 bytes)
I0305 01:50:44.412357 19549 start.go:296] duration metric: took 156.236276ms for postStartSetup
I0305 01:50:44.412396 19549 fix.go:56] duration metric: took 6.530758617s for fixHost
I0305 01:50:44.412419 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:44.414901 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.415245 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:44.415276 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.415458 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:44.415610 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:44.415766 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:44.415902 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:44.416045 19549 main.go:141] libmachine: Using SSH client type: native
I0305 01:50:44.416191 19549 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.62 22 <nil> <nil>}
I0305 01:50:44.416200 19549 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0305 01:50:44.519680 19549 main.go:141] libmachine: SSH cmd err, output: <nil>: 1709603444.511434672
I0305 01:50:44.519700 19549 fix.go:216] guest clock: 1709603444.511434672
I0305 01:50:44.519706 19549 fix.go:229] Guest: 2024-03-05 01:50:44.511434672 +0000 UTC Remote: 2024-03-05 01:50:44.412400695 +0000 UTC m=+6.660150955 (delta=99.033977ms)
I0305 01:50:44.519722 19549 fix.go:200] guest clock delta is within tolerance: 99.033977ms
I0305 01:50:44.519727 19549 start.go:83] releasing machines lock for "functional-453214", held for 6.638103225s
I0305 01:50:44.519742 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:44.519963 19549 main.go:141] libmachine: (functional-453214) Calling .GetIP
I0305 01:50:44.522672 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.523059 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:44.523086 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.523237 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:44.523723 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:44.523892 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:44.523982 19549 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0305 01:50:44.524029 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:44.524079 19549 ssh_runner.go:195] Run: cat /version.json
I0305 01:50:44.524103 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:44.526353 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.526626 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:44.526649 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.526816 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:44.526822 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.526992 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:44.527161 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:44.527165 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:44.527190 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.527321 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:44.527385 19549 sshutil.go:53] new ssh client: &{IP:192.168.39.62 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-6453/.minikube/machines/functional-453214/id_rsa Username:docker}
I0305 01:50:44.527486 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:44.527626 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:44.527752 19549 sshutil.go:53] new ssh client: &{IP:192.168.39.62 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-6453/.minikube/machines/functional-453214/id_rsa Username:docker}
I0305 01:50:44.603587 19549 command_runner.go:130] > {"iso_version": "v1.32.1-1708638130-18020", "kicbase_version": "v0.0.42-1708008208-17936", "minikube_version": "v1.32.0", "commit": "d80143d2abd5a004b09b48bbc118a104326900af"}
I0305 01:50:44.603717 19549 ssh_runner.go:195] Run: systemctl --version
I0305 01:50:44.691362 19549 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.
I0305 01:50:44.691453 19549 command_runner.go:130] > systemd 252 (252)
I0305 01:50:44.691488 19549 command_runner.go:130] > -PAM -AUDIT -SELINUX -APPARMOR -IMA -SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL -ELFUTILS -FIDO2 -IDN2 -IDN +IPTC +KMOD -LIBCRYPTSETUP +LIBFDISK -PCRE2 -PWQUALITY -P11KIT -QRENCODE -TPM2 -BZIP2 +LZ4 +XZ +ZLIB -ZSTD -BPF_FRAMEWORK -XKBCOMMON -UTMP -SYSVINIT default-hierarchy=unified
I0305 01:50:44.691558 19549 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0305 01:50:45.134690 19549 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0305 01:50:45.181405 19549 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory
W0305 01:50:45.181550 19549 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0305 01:50:45.181619 19549 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0305 01:50:45.286735 19549 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0305 01:50:45.286762 19549 start.go:494] detecting cgroup driver to use...
I0305 01:50:45.286849 19549 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0305 01:50:45.368992 19549 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0305 01:50:45.400016 19549 docker.go:217] disabling cri-docker service (if available) ...
I0305 01:50:45.400075 19549 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0305 01:50:45.436572 19549 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0305 01:50:45.489234 19549 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0305 01:50:45.831587 19549 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0305 01:50:46.049566 19549 docker.go:233] disabling docker service ...
I0305 01:50:46.049638 19549 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0305 01:50:46.071083 19549 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0305 01:50:46.085594 19549 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0305 01:50:46.309056 19549 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0305 01:50:46.543874 19549 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0305 01:50:46.562757 19549 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0305 01:50:46.590376 19549 command_runner.go:130] > runtime-endpoint: unix:///var/run/crio/crio.sock
I0305 01:50:46.593415 19549 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0305 01:50:46.593465 19549 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0305 01:50:46.607821 19549 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0305 01:50:46.607887 19549 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0305 01:50:46.620478 19549 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0305 01:50:46.633949 19549 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0305 01:50:46.653629 19549 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0305 01:50:46.667872 19549 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0305 01:50:46.679020 19549 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1
I0305 01:50:46.679332 19549 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0305 01:50:46.690667 19549 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0305 01:50:46.942123 19549 ssh_runner.go:195] Run: sudo systemctl restart crio
I0305 01:52:17.457991 19549 ssh_runner.go:235] Completed: sudo systemctl restart crio: (1m30.515831874s)
I0305 01:52:17.458035 19549 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0305 01:52:17.458108 19549 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0305 01:52:17.464794 19549 command_runner.go:130] > File: /var/run/crio/crio.sock
I0305 01:52:17.464819 19549 command_runner.go:130] > Size: 0 Blocks: 0 IO Block: 4096 socket
I0305 01:52:17.464834 19549 command_runner.go:130] > Device: 0,22 Inode: 1660 Links: 1
I0305 01:52:17.464844 19549 command_runner.go:130] > Access: (0660/srw-rw----) Uid: ( 0/ root) Gid: ( 0/ root)
I0305 01:52:17.464852 19549 command_runner.go:130] > Access: 2024-03-05 01:52:17.318719892 +0000
I0305 01:52:17.464860 19549 command_runner.go:130] > Modify: 2024-03-05 01:52:17.318719892 +0000
I0305 01:52:17.464869 19549 command_runner.go:130] > Change: 2024-03-05 01:52:17.318719892 +0000
I0305 01:52:17.464879 19549 command_runner.go:130] > Birth: -
I0305 01:52:17.464960 19549 start.go:562] Will wait 60s for crictl version
I0305 01:52:17.465014 19549 ssh_runner.go:195] Run: which crictl
I0305 01:52:17.469733 19549 command_runner.go:130] > /usr/bin/crictl
I0305 01:52:17.469779 19549 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0305 01:52:17.522820 19549 command_runner.go:130] > Version: 0.1.0
I0305 01:52:17.522839 19549 command_runner.go:130] > RuntimeName: cri-o
I0305 01:52:17.522844 19549 command_runner.go:130] > RuntimeVersion: 1.29.1
I0305 01:52:17.522848 19549 command_runner.go:130] > RuntimeApiVersion: v1
I0305 01:52:17.522917 19549 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0305 01:52:17.522980 19549 ssh_runner.go:195] Run: crio --version
I0305 01:52:17.556867 19549 command_runner.go:130] > crio version 1.29.1
I0305 01:52:17.556885 19549 command_runner.go:130] > Version: 1.29.1
I0305 01:52:17.556891 19549 command_runner.go:130] > GitCommit: unknown
I0305 01:52:17.556894 19549 command_runner.go:130] > GitCommitDate: unknown
I0305 01:52:17.556904 19549 command_runner.go:130] > GitTreeState: clean
I0305 01:52:17.556909 19549 command_runner.go:130] > BuildDate: 2024-02-23T03:27:48Z
I0305 01:52:17.556913 19549 command_runner.go:130] > GoVersion: go1.21.6
I0305 01:52:17.556917 19549 command_runner.go:130] > Compiler: gc
I0305 01:52:17.556921 19549 command_runner.go:130] > Platform: linux/amd64
I0305 01:52:17.556925 19549 command_runner.go:130] > Linkmode: dynamic
I0305 01:52:17.556931 19549 command_runner.go:130] > BuildTags:
I0305 01:52:17.556935 19549 command_runner.go:130] > containers_image_ostree_stub
I0305 01:52:17.556940 19549 command_runner.go:130] > exclude_graphdriver_btrfs
I0305 01:52:17.556943 19549 command_runner.go:130] > btrfs_noversion
I0305 01:52:17.556946 19549 command_runner.go:130] > exclude_graphdriver_devicemapper
I0305 01:52:17.556950 19549 command_runner.go:130] > libdm_no_deferred_remove
I0305 01:52:17.556954 19549 command_runner.go:130] > seccomp
I0305 01:52:17.556958 19549 command_runner.go:130] > LDFlags: unknown
I0305 01:52:17.556962 19549 command_runner.go:130] > SeccompEnabled: true
I0305 01:52:17.556969 19549 command_runner.go:130] > AppArmorEnabled: false
I0305 01:52:17.557047 19549 ssh_runner.go:195] Run: crio --version
I0305 01:52:17.587472 19549 command_runner.go:130] > crio version 1.29.1
I0305 01:52:17.587493 19549 command_runner.go:130] > Version: 1.29.1
I0305 01:52:17.587500 19549 command_runner.go:130] > GitCommit: unknown
I0305 01:52:17.587504 19549 command_runner.go:130] > GitCommitDate: unknown
I0305 01:52:17.587508 19549 command_runner.go:130] > GitTreeState: clean
I0305 01:52:17.587513 19549 command_runner.go:130] > BuildDate: 2024-02-23T03:27:48Z
I0305 01:52:17.587518 19549 command_runner.go:130] > GoVersion: go1.21.6
I0305 01:52:17.587521 19549 command_runner.go:130] > Compiler: gc
I0305 01:52:17.587526 19549 command_runner.go:130] > Platform: linux/amd64
I0305 01:52:17.587531 19549 command_runner.go:130] > Linkmode: dynamic
I0305 01:52:17.587559 19549 command_runner.go:130] > BuildTags:
I0305 01:52:17.587567 19549 command_runner.go:130] > containers_image_ostree_stub
I0305 01:52:17.587586 19549 command_runner.go:130] > exclude_graphdriver_btrfs
I0305 01:52:17.587590 19549 command_runner.go:130] > btrfs_noversion
I0305 01:52:17.587594 19549 command_runner.go:130] > exclude_graphdriver_devicemapper
I0305 01:52:17.587601 19549 command_runner.go:130] > libdm_no_deferred_remove
I0305 01:52:17.587604 19549 command_runner.go:130] > seccomp
I0305 01:52:17.587608 19549 command_runner.go:130] > LDFlags: unknown
I0305 01:52:17.587612 19549 command_runner.go:130] > SeccompEnabled: true
I0305 01:52:17.587619 19549 command_runner.go:130] > AppArmorEnabled: false
I0305 01:52:17.591508 19549 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.29.1 ...
I0305 01:52:17.592747 19549 main.go:141] libmachine: (functional-453214) Calling .GetIP
I0305 01:52:17.595353 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:52:17.595686 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:52:17.595713 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:52:17.595868 19549 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0305 01:52:17.600720 19549 command_runner.go:130] > 192.168.39.1 host.minikube.internal
I0305 01:52:17.600822 19549 kubeadm.go:877] updating cluster {Name:functional-453214 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.28.4 ClusterName:functional-453214 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.62 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0305 01:52:17.600951 19549 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0305 01:52:17.601017 19549 ssh_runner.go:195] Run: sudo crictl images --output json
I0305 01:52:17.645481 19549 command_runner.go:130] > {
I0305 01:52:17.645510 19549 command_runner.go:130] > "images": [
I0305 01:52:17.645516 19549 command_runner.go:130] > {
I0305 01:52:17.645528 19549 command_runner.go:130] > "id": "c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc",
I0305 01:52:17.645536 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.645546 19549 command_runner.go:130] > "docker.io/kindest/kindnetd:v20230809-80a64d96"
I0305 01:52:17.645554 19549 command_runner.go:130] > ],
I0305 01:52:17.645562 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.645578 19549 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052",
I0305 01:52:17.645590 19549 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:a315b9c49a50d5e126e1b5fa5ef0eae2a9b367c9c4f868e897d772b142372bb4"
I0305 01:52:17.645598 19549 command_runner.go:130] > ],
I0305 01:52:17.645605 19549 command_runner.go:130] > "size": "65258016",
I0305 01:52:17.645615 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.645625 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.645642 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.645652 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.645660 19549 command_runner.go:130] > },
I0305 01:52:17.645666 19549 command_runner.go:130] > {
I0305 01:52:17.645677 19549 command_runner.go:130] > "id": "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562",
I0305 01:52:17.645687 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.645710 19549 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner:v5"
I0305 01:52:17.645720 19549 command_runner.go:130] > ],
I0305 01:52:17.645727 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.645738 19549 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944",
I0305 01:52:17.645751 19549 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f"
I0305 01:52:17.645759 19549 command_runner.go:130] > ],
I0305 01:52:17.645769 19549 command_runner.go:130] > "size": "31470524",
I0305 01:52:17.645779 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.645796 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.645805 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.645811 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.645816 19549 command_runner.go:130] > },
I0305 01:52:17.645822 19549 command_runner.go:130] > {
I0305 01:52:17.645828 19549 command_runner.go:130] > "id": "ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc",
I0305 01:52:17.645834 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.645840 19549 command_runner.go:130] > "registry.k8s.io/coredns/coredns:v1.10.1"
I0305 01:52:17.645846 19549 command_runner.go:130] > ],
I0305 01:52:17.645851 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.645861 19549 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e",
I0305 01:52:17.645870 19549 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:be7652ce0b43b1339f3d14d9b14af9f588578011092c1f7893bd55432d83a378"
I0305 01:52:17.645876 19549 command_runner.go:130] > ],
I0305 01:52:17.645880 19549 command_runner.go:130] > "size": "53621675",
I0305 01:52:17.645886 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.645890 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.645896 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.645899 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.645903 19549 command_runner.go:130] > },
I0305 01:52:17.645906 19549 command_runner.go:130] > {
I0305 01:52:17.645915 19549 command_runner.go:130] > "id": "73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9",
I0305 01:52:17.645921 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.645926 19549 command_runner.go:130] > "registry.k8s.io/etcd:3.5.9-0"
I0305 01:52:17.645932 19549 command_runner.go:130] > ],
I0305 01:52:17.645936 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.645945 19549 command_runner.go:130] > "registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15",
I0305 01:52:17.645953 19549 command_runner.go:130] > "registry.k8s.io/etcd@sha256:e013d0d5e4e25d00c61a7ff839927a1f36479678f11e49502b53a5e0b14f10c3"
I0305 01:52:17.645965 19549 command_runner.go:130] > ],
I0305 01:52:17.645976 19549 command_runner.go:130] > "size": "295456551",
I0305 01:52:17.645982 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.645986 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.645989 19549 command_runner.go:130] > },
I0305 01:52:17.645995 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.646000 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.646006 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.646009 19549 command_runner.go:130] > },
I0305 01:52:17.646015 19549 command_runner.go:130] > {
I0305 01:52:17.646022 19549 command_runner.go:130] > "id": "7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257",
I0305 01:52:17.646028 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.646033 19549 command_runner.go:130] > "registry.k8s.io/kube-apiserver:v1.28.4"
I0305 01:52:17.646038 19549 command_runner.go:130] > ],
I0305 01:52:17.646042 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.646052 19549 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499",
I0305 01:52:17.646061 19549 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:5b28a364467cf7e134343bb3ee2c6d40682b473a743a72142c7bbe25767d36eb"
I0305 01:52:17.646066 19549 command_runner.go:130] > ],
I0305 01:52:17.646070 19549 command_runner.go:130] > "size": "127226832",
I0305 01:52:17.646074 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.646081 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.646084 19549 command_runner.go:130] > },
I0305 01:52:17.646090 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.646094 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.646100 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.646104 19549 command_runner.go:130] > },
I0305 01:52:17.646109 19549 command_runner.go:130] > {
I0305 01:52:17.646115 19549 command_runner.go:130] > "id": "d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591",
I0305 01:52:17.646121 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.646126 19549 command_runner.go:130] > "registry.k8s.io/kube-controller-manager:v1.28.4"
I0305 01:52:17.646132 19549 command_runner.go:130] > ],
I0305 01:52:17.646136 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.646145 19549 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c",
I0305 01:52:17.646154 19549 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:c173b92b1ac1ac50de36a9d8d3af6377cbb7bbd930f42d4332cbaea521c57232"
I0305 01:52:17.646168 19549 command_runner.go:130] > ],
I0305 01:52:17.646179 19549 command_runner.go:130] > "size": "123261750",
I0305 01:52:17.646188 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.646200 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.646206 19549 command_runner.go:130] > },
I0305 01:52:17.646210 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.646216 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.646224 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.646237 19549 command_runner.go:130] > },
I0305 01:52:17.646243 19549 command_runner.go:130] > {
I0305 01:52:17.646249 19549 command_runner.go:130] > "id": "83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e",
I0305 01:52:17.646256 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.646261 19549 command_runner.go:130] > "registry.k8s.io/kube-proxy:v1.28.4"
I0305 01:52:17.646270 19549 command_runner.go:130] > ],
I0305 01:52:17.646276 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.646285 19549 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e",
I0305 01:52:17.646295 19549 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:e63408a0f5068a7e9d4b34fd72b4a2b0e5512509b53cd2123a37fc991b0ef532"
I0305 01:52:17.646300 19549 command_runner.go:130] > ],
I0305 01:52:17.646305 19549 command_runner.go:130] > "size": "74749335",
I0305 01:52:17.646310 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.646314 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.646320 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.646324 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.646329 19549 command_runner.go:130] > },
I0305 01:52:17.646332 19549 command_runner.go:130] > {
I0305 01:52:17.646338 19549 command_runner.go:130] > "id": "e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1",
I0305 01:52:17.646344 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.646349 19549 command_runner.go:130] > "registry.k8s.io/kube-scheduler:v1.28.4"
I0305 01:52:17.646355 19549 command_runner.go:130] > ],
I0305 01:52:17.646359 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.646381 19549 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba",
I0305 01:52:17.646390 19549 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:d994c8a78e8cb1ec189fabfd258ff002cccdeb63678fad08ec0fba32298ffe32"
I0305 01:52:17.646396 19549 command_runner.go:130] > ],
I0305 01:52:17.646400 19549 command_runner.go:130] > "size": "61551410",
I0305 01:52:17.646406 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.646409 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.646415 19549 command_runner.go:130] > },
I0305 01:52:17.646419 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.646423 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.646433 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.646438 19549 command_runner.go:130] > },
I0305 01:52:17.646441 19549 command_runner.go:130] > {
I0305 01:52:17.646450 19549 command_runner.go:130] > "id": "e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c",
I0305 01:52:17.646454 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.646458 19549 command_runner.go:130] > "registry.k8s.io/pause:3.9"
I0305 01:52:17.646464 19549 command_runner.go:130] > ],
I0305 01:52:17.646468 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.646477 19549 command_runner.go:130] > "registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097",
I0305 01:52:17.646486 19549 command_runner.go:130] > "registry.k8s.io/pause@sha256:8d4106c88ec0bd28001e34c975d65175d994072d65341f62a8ab0754b0fafe10"
I0305 01:52:17.646491 19549 command_runner.go:130] > ],
I0305 01:52:17.646495 19549 command_runner.go:130] > "size": "750414",
I0305 01:52:17.646502 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.646508 19549 command_runner.go:130] > "value": "65535"
I0305 01:52:17.646516 19549 command_runner.go:130] > },
I0305 01:52:17.646525 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.646537 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.646546 19549 command_runner.go:130] > "pinned": true
I0305 01:52:17.646554 19549 command_runner.go:130] > }
I0305 01:52:17.646560 19549 command_runner.go:130] > ]
I0305 01:52:17.646568 19549 command_runner.go:130] > }
I0305 01:52:17.646726 19549 crio.go:496] all images are preloaded for cri-o runtime.
I0305 01:52:17.646739 19549 crio.go:415] Images already preloaded, skipping extraction
I0305 01:52:17.646787 19549 ssh_runner.go:195] Run: sudo crictl images --output json
I0305 01:52:17.683548 19549 command_runner.go:130] > {
I0305 01:52:17.683564 19549 command_runner.go:130] > "images": [
I0305 01:52:17.683568 19549 command_runner.go:130] > {
I0305 01:52:17.683575 19549 command_runner.go:130] > "id": "c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc",
I0305 01:52:17.683580 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.683585 19549 command_runner.go:130] > "docker.io/kindest/kindnetd:v20230809-80a64d96"
I0305 01:52:17.683588 19549 command_runner.go:130] > ],
I0305 01:52:17.683592 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.683600 19549 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052",
I0305 01:52:17.683611 19549 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:a315b9c49a50d5e126e1b5fa5ef0eae2a9b367c9c4f868e897d772b142372bb4"
I0305 01:52:17.683614 19549 command_runner.go:130] > ],
I0305 01:52:17.683619 19549 command_runner.go:130] > "size": "65258016",
I0305 01:52:17.683622 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.683626 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.683633 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.683637 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.683640 19549 command_runner.go:130] > },
I0305 01:52:17.683644 19549 command_runner.go:130] > {
I0305 01:52:17.683650 19549 command_runner.go:130] > "id": "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562",
I0305 01:52:17.683654 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.683660 19549 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner:v5"
I0305 01:52:17.683665 19549 command_runner.go:130] > ],
I0305 01:52:17.683678 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.683690 19549 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944",
I0305 01:52:17.683697 19549 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f"
I0305 01:52:17.683700 19549 command_runner.go:130] > ],
I0305 01:52:17.683707 19549 command_runner.go:130] > "size": "31470524",
I0305 01:52:17.683711 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.683716 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.683722 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.683728 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.683733 19549 command_runner.go:130] > },
I0305 01:52:17.683738 19549 command_runner.go:130] > {
I0305 01:52:17.683751 19549 command_runner.go:130] > "id": "ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc",
I0305 01:52:17.683758 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.683767 19549 command_runner.go:130] > "registry.k8s.io/coredns/coredns:v1.10.1"
I0305 01:52:17.683770 19549 command_runner.go:130] > ],
I0305 01:52:17.683774 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.683782 19549 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e",
I0305 01:52:17.683802 19549 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:be7652ce0b43b1339f3d14d9b14af9f588578011092c1f7893bd55432d83a378"
I0305 01:52:17.683812 19549 command_runner.go:130] > ],
I0305 01:52:17.683821 19549 command_runner.go:130] > "size": "53621675",
I0305 01:52:17.683827 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.683837 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.683843 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.683864 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.683873 19549 command_runner.go:130] > },
I0305 01:52:17.683883 19549 command_runner.go:130] > {
I0305 01:52:17.683891 19549 command_runner.go:130] > "id": "73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9",
I0305 01:52:17.683895 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.683903 19549 command_runner.go:130] > "registry.k8s.io/etcd:3.5.9-0"
I0305 01:52:17.683908 19549 command_runner.go:130] > ],
I0305 01:52:17.683912 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.683921 19549 command_runner.go:130] > "registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15",
I0305 01:52:17.683927 19549 command_runner.go:130] > "registry.k8s.io/etcd@sha256:e013d0d5e4e25d00c61a7ff839927a1f36479678f11e49502b53a5e0b14f10c3"
I0305 01:52:17.683941 19549 command_runner.go:130] > ],
I0305 01:52:17.683947 19549 command_runner.go:130] > "size": "295456551",
I0305 01:52:17.683951 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.683957 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.683960 19549 command_runner.go:130] > },
I0305 01:52:17.683966 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.683971 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.683977 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.683980 19549 command_runner.go:130] > },
I0305 01:52:17.683986 19549 command_runner.go:130] > {
I0305 01:52:17.683992 19549 command_runner.go:130] > "id": "7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257",
I0305 01:52:17.683999 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.684004 19549 command_runner.go:130] > "registry.k8s.io/kube-apiserver:v1.28.4"
I0305 01:52:17.684009 19549 command_runner.go:130] > ],
I0305 01:52:17.684014 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.684023 19549 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499",
I0305 01:52:17.684030 19549 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:5b28a364467cf7e134343bb3ee2c6d40682b473a743a72142c7bbe25767d36eb"
I0305 01:52:17.684035 19549 command_runner.go:130] > ],
I0305 01:52:17.684039 19549 command_runner.go:130] > "size": "127226832",
I0305 01:52:17.684045 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.684049 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.684054 19549 command_runner.go:130] > },
I0305 01:52:17.684058 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.684065 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.684069 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.684075 19549 command_runner.go:130] > },
I0305 01:52:17.684083 19549 command_runner.go:130] > {
I0305 01:52:17.684092 19549 command_runner.go:130] > "id": "d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591",
I0305 01:52:17.684098 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.684103 19549 command_runner.go:130] > "registry.k8s.io/kube-controller-manager:v1.28.4"
I0305 01:52:17.684111 19549 command_runner.go:130] > ],
I0305 01:52:17.684115 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.684125 19549 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c",
I0305 01:52:17.684134 19549 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:c173b92b1ac1ac50de36a9d8d3af6377cbb7bbd930f42d4332cbaea521c57232"
I0305 01:52:17.684140 19549 command_runner.go:130] > ],
I0305 01:52:17.684144 19549 command_runner.go:130] > "size": "123261750",
I0305 01:52:17.684149 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.684153 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.684158 19549 command_runner.go:130] > },
I0305 01:52:17.684162 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.684168 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.684172 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.684177 19549 command_runner.go:130] > },
I0305 01:52:17.684181 19549 command_runner.go:130] > {
I0305 01:52:17.684187 19549 command_runner.go:130] > "id": "83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e",
I0305 01:52:17.684193 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.684198 19549 command_runner.go:130] > "registry.k8s.io/kube-proxy:v1.28.4"
I0305 01:52:17.684203 19549 command_runner.go:130] > ],
I0305 01:52:17.684207 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.684216 19549 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e",
I0305 01:52:17.684225 19549 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:e63408a0f5068a7e9d4b34fd72b4a2b0e5512509b53cd2123a37fc991b0ef532"
I0305 01:52:17.684231 19549 command_runner.go:130] > ],
I0305 01:52:17.684235 19549 command_runner.go:130] > "size": "74749335",
I0305 01:52:17.684242 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.684245 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.684252 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.684255 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.684261 19549 command_runner.go:130] > },
I0305 01:52:17.684264 19549 command_runner.go:130] > {
I0305 01:52:17.684272 19549 command_runner.go:130] > "id": "e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1",
I0305 01:52:17.684277 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.684281 19549 command_runner.go:130] > "registry.k8s.io/kube-scheduler:v1.28.4"
I0305 01:52:17.684291 19549 command_runner.go:130] > ],
I0305 01:52:17.684298 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.684316 19549 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba",
I0305 01:52:17.684325 19549 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:d994c8a78e8cb1ec189fabfd258ff002cccdeb63678fad08ec0fba32298ffe32"
I0305 01:52:17.684331 19549 command_runner.go:130] > ],
I0305 01:52:17.684335 19549 command_runner.go:130] > "size": "61551410",
I0305 01:52:17.684341 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.684345 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.684350 19549 command_runner.go:130] > },
I0305 01:52:17.684354 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.684360 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.684364 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.684368 19549 command_runner.go:130] > },
I0305 01:52:17.684371 19549 command_runner.go:130] > {
I0305 01:52:17.684377 19549 command_runner.go:130] > "id": "e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c",
I0305 01:52:17.684385 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.684392 19549 command_runner.go:130] > "registry.k8s.io/pause:3.9"
I0305 01:52:17.684396 19549 command_runner.go:130] > ],
I0305 01:52:17.684402 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.684408 19549 command_runner.go:130] > "registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097",
I0305 01:52:17.684417 19549 command_runner.go:130] > "registry.k8s.io/pause@sha256:8d4106c88ec0bd28001e34c975d65175d994072d65341f62a8ab0754b0fafe10"
I0305 01:52:17.684422 19549 command_runner.go:130] > ],
I0305 01:52:17.684426 19549 command_runner.go:130] > "size": "750414",
I0305 01:52:17.684432 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.684436 19549 command_runner.go:130] > "value": "65535"
I0305 01:52:17.684441 19549 command_runner.go:130] > },
I0305 01:52:17.684445 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.684449 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.684455 19549 command_runner.go:130] > "pinned": true
I0305 01:52:17.684458 19549 command_runner.go:130] > }
I0305 01:52:17.684462 19549 command_runner.go:130] > ]
I0305 01:52:17.684465 19549 command_runner.go:130] > }
I0305 01:52:17.684572 19549 crio.go:496] all images are preloaded for cri-o runtime.
I0305 01:52:17.684583 19549 cache_images.go:84] Images are preloaded, skipping loading
I0305 01:52:17.684589 19549 kubeadm.go:928] updating node { 192.168.39.62 8441 v1.28.4 crio true true} ...
I0305 01:52:17.684695 19549 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=functional-453214 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.62
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:functional-453214 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0305 01:52:17.684758 19549 ssh_runner.go:195] Run: crio config
I0305 01:52:17.728968 19549 command_runner.go:130] > # The CRI-O configuration file specifies all of the available configuration
I0305 01:52:17.729000 19549 command_runner.go:130] > # options and command-line flags for the crio(8) OCI Kubernetes Container Runtime
I0305 01:52:17.729012 19549 command_runner.go:130] > # daemon, but in a TOML format that can be more easily modified and versioned.
I0305 01:52:17.729016 19549 command_runner.go:130] > #
I0305 01:52:17.729031 19549 command_runner.go:130] > # Please refer to crio.conf(5) for details of all configuration options.
I0305 01:52:17.729041 19549 command_runner.go:130] > # CRI-O supports partial configuration reload during runtime, which can be
I0305 01:52:17.729053 19549 command_runner.go:130] > # done by sending SIGHUP to the running process. Currently supported options
I0305 01:52:17.729062 19549 command_runner.go:130] > # are explicitly mentioned with: 'This option supports live configuration
I0305 01:52:17.729070 19549 command_runner.go:130] > # reload'.
I0305 01:52:17.729080 19549 command_runner.go:130] > # CRI-O reads its storage defaults from the containers-storage.conf(5) file
I0305 01:52:17.729091 19549 command_runner.go:130] > # located at /etc/containers/storage.conf. Modify this storage configuration if
I0305 01:52:17.729101 19549 command_runner.go:130] > # you want to change the system's defaults. If you want to modify storage just
I0305 01:52:17.729118 19549 command_runner.go:130] > # for CRI-O, you can change the storage configuration options here.
I0305 01:52:17.729126 19549 command_runner.go:130] > [crio]
I0305 01:52:17.729134 19549 command_runner.go:130] > # Path to the "root directory". CRI-O stores all of its data, including
I0305 01:52:17.729142 19549 command_runner.go:130] > # containers images, in this directory.
I0305 01:52:17.729146 19549 command_runner.go:130] > root = "/var/lib/containers/storage"
I0305 01:52:17.729158 19549 command_runner.go:130] > # Path to the "run directory". CRI-O stores all of its state in this directory.
I0305 01:52:17.729165 19549 command_runner.go:130] > runroot = "/var/run/containers/storage"
I0305 01:52:17.729173 19549 command_runner.go:130] > # Path to the "imagestore". If CRI-O stores all of its images in this directory differently than Root.
I0305 01:52:17.729179 19549 command_runner.go:130] > # imagestore = ""
I0305 01:52:17.729185 19549 command_runner.go:130] > # Storage driver used to manage the storage of images and containers. Please
I0305 01:52:17.729192 19549 command_runner.go:130] > # refer to containers-storage.conf(5) to see all available storage drivers.
I0305 01:52:17.729197 19549 command_runner.go:130] > storage_driver = "overlay"
I0305 01:52:17.729208 19549 command_runner.go:130] > # List to pass options to the storage driver. Please refer to
I0305 01:52:17.729228 19549 command_runner.go:130] > # containers-storage.conf(5) to see all available storage options.
I0305 01:52:17.729239 19549 command_runner.go:130] > storage_option = [
I0305 01:52:17.729250 19549 command_runner.go:130] > "overlay.mountopt=nodev,metacopy=on",
I0305 01:52:17.729255 19549 command_runner.go:130] > ]
I0305 01:52:17.729272 19549 command_runner.go:130] > # The default log directory where all logs will go unless directly specified by
I0305 01:52:17.729289 19549 command_runner.go:130] > # the kubelet. The log directory specified must be an absolute directory.
I0305 01:52:17.729301 19549 command_runner.go:130] > # log_dir = "/var/log/crio/pods"
I0305 01:52:17.729311 19549 command_runner.go:130] > # Location for CRI-O to lay down the temporary version file.
I0305 01:52:17.729323 19549 command_runner.go:130] > # It is used to check if crio wipe should wipe containers, which should
I0305 01:52:17.729338 19549 command_runner.go:130] > # always happen on a node reboot
I0305 01:52:17.729348 19549 command_runner.go:130] > # version_file = "/var/run/crio/version"
I0305 01:52:17.729368 19549 command_runner.go:130] > # Location for CRI-O to lay down the persistent version file.
I0305 01:52:17.729382 19549 command_runner.go:130] > # It is used to check if crio wipe should wipe images, which should
I0305 01:52:17.729391 19549 command_runner.go:130] > # only happen when CRI-O has been upgraded
I0305 01:52:17.729401 19549 command_runner.go:130] > version_file_persist = "/var/lib/crio/version"
I0305 01:52:17.729414 19549 command_runner.go:130] > # InternalWipe is whether CRI-O should wipe containers and images after a reboot when the server starts.
I0305 01:52:17.729429 19549 command_runner.go:130] > # If set to false, one must use the external command 'crio wipe' to wipe the containers and images in these situations.
I0305 01:52:17.729442 19549 command_runner.go:130] > # internal_wipe = true
I0305 01:52:17.729462 19549 command_runner.go:130] > # InternalRepair is whether CRI-O should check if the container and image storage was corrupted after a sudden restart.
I0305 01:52:17.729476 19549 command_runner.go:130] > # If it was, CRI-O also attempts to repair the storage.
I0305 01:52:17.729486 19549 command_runner.go:130] > # internal_repair = false
I0305 01:52:17.729492 19549 command_runner.go:130] > # Location for CRI-O to lay down the clean shutdown file.
I0305 01:52:17.729498 19549 command_runner.go:130] > # It is used to check whether crio had time to sync before shutting down.
I0305 01:52:17.729504 19549 command_runner.go:130] > # If not found, crio wipe will clear the storage directory.
I0305 01:52:17.729513 19549 command_runner.go:130] > # clean_shutdown_file = "/var/lib/crio/clean.shutdown"
I0305 01:52:17.729521 19549 command_runner.go:130] > # The crio.api table contains settings for the kubelet/gRPC interface.
I0305 01:52:17.729525 19549 command_runner.go:130] > [crio.api]
I0305 01:52:17.729530 19549 command_runner.go:130] > # Path to AF_LOCAL socket on which CRI-O will listen.
I0305 01:52:17.729537 19549 command_runner.go:130] > # listen = "/var/run/crio/crio.sock"
I0305 01:52:17.729542 19549 command_runner.go:130] > # IP address on which the stream server will listen.
I0305 01:52:17.729547 19549 command_runner.go:130] > # stream_address = "127.0.0.1"
I0305 01:52:17.729553 19549 command_runner.go:130] > # The port on which the stream server will listen. If the port is set to "0", then
I0305 01:52:17.729560 19549 command_runner.go:130] > # CRI-O will allocate a random free port number.
I0305 01:52:17.729565 19549 command_runner.go:130] > # stream_port = "0"
I0305 01:52:17.729577 19549 command_runner.go:130] > # Enable encrypted TLS transport of the stream server.
I0305 01:52:17.729593 19549 command_runner.go:130] > # stream_enable_tls = false
I0305 01:52:17.729606 19549 command_runner.go:130] > # Length of time until open streams terminate due to lack of activity
I0305 01:52:17.729616 19549 command_runner.go:130] > # stream_idle_timeout = ""
I0305 01:52:17.729626 19549 command_runner.go:130] > # Path to the x509 certificate file used to serve the encrypted stream. This
I0305 01:52:17.729639 19549 command_runner.go:130] > # file can change, and CRI-O will automatically pick up the changes within 5
I0305 01:52:17.729650 19549 command_runner.go:130] > # minutes.
I0305 01:52:17.729656 19549 command_runner.go:130] > # stream_tls_cert = ""
I0305 01:52:17.729662 19549 command_runner.go:130] > # Path to the key file used to serve the encrypted stream. This file can
I0305 01:52:17.729670 19549 command_runner.go:130] > # change and CRI-O will automatically pick up the changes within 5 minutes.
I0305 01:52:17.729676 19549 command_runner.go:130] > # stream_tls_key = ""
I0305 01:52:17.729687 19549 command_runner.go:130] > # Path to the x509 CA(s) file used to verify and authenticate client
I0305 01:52:17.729695 19549 command_runner.go:130] > # communication with the encrypted stream. This file can change and CRI-O will
I0305 01:52:17.729711 19549 command_runner.go:130] > # automatically pick up the changes within 5 minutes.
I0305 01:52:17.729717 19549 command_runner.go:130] > # stream_tls_ca = ""
I0305 01:52:17.729726 19549 command_runner.go:130] > # Maximum grpc send message size in bytes. If not set or <=0, then CRI-O will default to 80 * 1024 * 1024.
I0305 01:52:17.729733 19549 command_runner.go:130] > grpc_max_send_msg_size = 16777216
I0305 01:52:17.729744 19549 command_runner.go:130] > # Maximum grpc receive message size. If not set or <= 0, then CRI-O will default to 80 * 1024 * 1024.
I0305 01:52:17.729755 19549 command_runner.go:130] > grpc_max_recv_msg_size = 16777216
I0305 01:52:17.729768 19549 command_runner.go:130] > # The crio.runtime table contains settings pertaining to the OCI runtime used
I0305 01:52:17.729780 19549 command_runner.go:130] > # and options for how to set up and manage the OCI runtime.
I0305 01:52:17.729789 19549 command_runner.go:130] > [crio.runtime]
I0305 01:52:17.729798 19549 command_runner.go:130] > # A list of ulimits to be set in containers by default, specified as
I0305 01:52:17.729810 19549 command_runner.go:130] > # "<ulimit name>=<soft limit>:<hard limit>", for example:
I0305 01:52:17.729817 19549 command_runner.go:130] > # "nofile=1024:2048"
I0305 01:52:17.729823 19549 command_runner.go:130] > # If nothing is set here, settings will be inherited from the CRI-O daemon
I0305 01:52:17.729829 19549 command_runner.go:130] > # default_ulimits = [
I0305 01:52:17.729832 19549 command_runner.go:130] > # ]
I0305 01:52:17.729838 19549 command_runner.go:130] > # If true, the runtime will not use pivot_root, but instead use MS_MOVE.
I0305 01:52:17.729846 19549 command_runner.go:130] > # no_pivot = false
I0305 01:52:17.729852 19549 command_runner.go:130] > # decryption_keys_path is the path where the keys required for
I0305 01:52:17.729857 19549 command_runner.go:130] > # image decryption are stored. This option supports live configuration reload.
I0305 01:52:17.729865 19549 command_runner.go:130] > # decryption_keys_path = "/etc/crio/keys/"
I0305 01:52:17.729875 19549 command_runner.go:130] > # Path to the conmon binary, used for monitoring the OCI runtime.
I0305 01:52:17.729886 19549 command_runner.go:130] > # Will be searched for using $PATH if empty.
I0305 01:52:17.729899 19549 command_runner.go:130] > # This option is currently deprecated, and will be replaced with RuntimeHandler.MonitorEnv.
I0305 01:52:17.729911 19549 command_runner.go:130] > conmon = "/usr/libexec/crio/conmon"
I0305 01:52:17.729921 19549 command_runner.go:130] > # Cgroup setting for conmon
I0305 01:52:17.729932 19549 command_runner.go:130] > # This option is currently deprecated, and will be replaced with RuntimeHandler.MonitorCgroup.
I0305 01:52:17.729940 19549 command_runner.go:130] > conmon_cgroup = "pod"
I0305 01:52:17.729950 19549 command_runner.go:130] > # Environment variable list for the conmon process, used for passing necessary
I0305 01:52:17.729962 19549 command_runner.go:130] > # environment variables to conmon or the runtime.
I0305 01:52:17.729976 19549 command_runner.go:130] > # This option is currently deprecated, and will be replaced with RuntimeHandler.MonitorEnv.
I0305 01:52:17.729985 19549 command_runner.go:130] > conmon_env = [
I0305 01:52:17.730000 19549 command_runner.go:130] > "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
I0305 01:52:17.730008 19549 command_runner.go:130] > ]
I0305 01:52:17.730017 19549 command_runner.go:130] > # Additional environment variables to set for all the
I0305 01:52:17.730038 19549 command_runner.go:130] > # containers. These are overridden if set in the
I0305 01:52:17.730051 19549 command_runner.go:130] > # container image spec or in the container runtime configuration.
I0305 01:52:17.730060 19549 command_runner.go:130] > # default_env = [
I0305 01:52:17.730063 19549 command_runner.go:130] > # ]
I0305 01:52:17.730069 19549 command_runner.go:130] > # If true, SELinux will be used for pod separation on the host.
I0305 01:52:17.730083 19549 command_runner.go:130] > # This option is deprecated, and be interpreted from whether SELinux is enabled on the host in the future.
I0305 01:52:17.730095 19549 command_runner.go:130] > # selinux = false
I0305 01:52:17.730104 19549 command_runner.go:130] > # Path to the seccomp.json profile which is used as the default seccomp profile
I0305 01:52:17.730118 19549 command_runner.go:130] > # for the runtime. If not specified, then the internal default seccomp profile
I0305 01:52:17.730130 19549 command_runner.go:130] > # will be used. This option supports live configuration reload.
I0305 01:52:17.730139 19549 command_runner.go:130] > # seccomp_profile = ""
I0305 01:52:17.730151 19549 command_runner.go:130] > # Changes the meaning of an empty seccomp profile. By default
I0305 01:52:17.730173 19549 command_runner.go:130] > # (and according to CRI spec), an empty profile means unconfined.
I0305 01:52:17.730186 19549 command_runner.go:130] > # This option tells CRI-O to treat an empty profile as the default profile,
I0305 01:52:17.730197 19549 command_runner.go:130] > # which might increase security.
I0305 01:52:17.730208 19549 command_runner.go:130] > # This option is currently deprecated,
I0305 01:52:17.730218 19549 command_runner.go:130] > # and will be replaced by the SeccompDefault FeatureGate in Kubernetes.
I0305 01:52:17.730243 19549 command_runner.go:130] > seccomp_use_default_when_empty = false
I0305 01:52:17.730253 19549 command_runner.go:130] > # Used to change the name of the default AppArmor profile of CRI-O. The default
I0305 01:52:17.730267 19549 command_runner.go:130] > # profile name is "crio-default". This profile only takes effect if the user
I0305 01:52:17.730280 19549 command_runner.go:130] > # does not specify a profile via the Kubernetes Pod's metadata annotation. If
I0305 01:52:17.730292 19549 command_runner.go:130] > # the profile is set to "unconfined", then this equals to disabling AppArmor.
I0305 01:52:17.730303 19549 command_runner.go:130] > # This option supports live configuration reload.
I0305 01:52:17.730312 19549 command_runner.go:130] > # apparmor_profile = "crio-default"
I0305 01:52:17.730323 19549 command_runner.go:130] > # Path to the blockio class configuration file for configuring
I0305 01:52:17.730327 19549 command_runner.go:130] > # the cgroup blockio controller.
I0305 01:52:17.730335 19549 command_runner.go:130] > # blockio_config_file = ""
I0305 01:52:17.730346 19549 command_runner.go:130] > # Reload blockio-config-file and rescan blockio devices in the system before applying
I0305 01:52:17.730357 19549 command_runner.go:130] > # blockio parameters.
I0305 01:52:17.730364 19549 command_runner.go:130] > # blockio_reload = false
I0305 01:52:17.730375 19549 command_runner.go:130] > # Used to change irqbalance service config file path which is used for configuring
I0305 01:52:17.730384 19549 command_runner.go:130] > # irqbalance daemon.
I0305 01:52:17.730393 19549 command_runner.go:130] > # irqbalance_config_file = "/etc/sysconfig/irqbalance"
I0305 01:52:17.730405 19549 command_runner.go:130] > # irqbalance_config_restore_file allows to set a cpu mask CRI-O should
I0305 01:52:17.730418 19549 command_runner.go:130] > # restore as irqbalance config at startup. Set to empty string to disable this flow entirely.
I0305 01:52:17.730430 19549 command_runner.go:130] > # By default, CRI-O manages the irqbalance configuration to enable dynamic IRQ pinning.
I0305 01:52:17.730445 19549 command_runner.go:130] > # irqbalance_config_restore_file = "/etc/sysconfig/orig_irq_banned_cpus"
I0305 01:52:17.730455 19549 command_runner.go:130] > # Path to the RDT configuration file for configuring the resctrl pseudo-filesystem.
I0305 01:52:17.730468 19549 command_runner.go:130] > # This option supports live configuration reload.
I0305 01:52:17.730475 19549 command_runner.go:130] > # rdt_config_file = ""
I0305 01:52:17.730488 19549 command_runner.go:130] > # Cgroup management implementation used for the runtime.
I0305 01:52:17.730498 19549 command_runner.go:130] > cgroup_manager = "cgroupfs"
I0305 01:52:17.730534 19549 command_runner.go:130] > # Specify whether the image pull must be performed in a separate cgroup.
I0305 01:52:17.730544 19549 command_runner.go:130] > # separate_pull_cgroup = ""
I0305 01:52:17.730553 19549 command_runner.go:130] > # List of default capabilities for containers. If it is empty or commented out,
I0305 01:52:17.730566 19549 command_runner.go:130] > # only the capabilities defined in the containers json file by the user/kube
I0305 01:52:17.730575 19549 command_runner.go:130] > # will be added.
I0305 01:52:17.730584 19549 command_runner.go:130] > # default_capabilities = [
I0305 01:52:17.730596 19549 command_runner.go:130] > # "CHOWN",
I0305 01:52:17.730605 19549 command_runner.go:130] > # "DAC_OVERRIDE",
I0305 01:52:17.730610 19549 command_runner.go:130] > # "FSETID",
I0305 01:52:17.730618 19549 command_runner.go:130] > # "FOWNER",
I0305 01:52:17.730624 19549 command_runner.go:130] > # "SETGID",
I0305 01:52:17.730631 19549 command_runner.go:130] > # "SETUID",
I0305 01:52:17.730634 19549 command_runner.go:130] > # "SETPCAP",
I0305 01:52:17.730640 19549 command_runner.go:130] > # "NET_BIND_SERVICE",
I0305 01:52:17.730649 19549 command_runner.go:130] > # "KILL",
I0305 01:52:17.730655 19549 command_runner.go:130] > # ]
I0305 01:52:17.730670 19549 command_runner.go:130] > # Add capabilities to the inheritable set, as well as the default group of permitted, bounding and effective.
I0305 01:52:17.730684 19549 command_runner.go:130] > # If capabilities are expected to work for non-root users, this option should be set.
I0305 01:52:17.730698 19549 command_runner.go:130] > # add_inheritable_capabilities = false
I0305 01:52:17.730711 19549 command_runner.go:130] > # List of default sysctls. If it is empty or commented out, only the sysctls
I0305 01:52:17.730723 19549 command_runner.go:130] > # defined in the container json file by the user/kube will be added.
I0305 01:52:17.730733 19549 command_runner.go:130] > # default_sysctls = [
I0305 01:52:17.730739 19549 command_runner.go:130] > # ]
I0305 01:52:17.730750 19549 command_runner.go:130] > # List of devices on the host that a
I0305 01:52:17.730763 19549 command_runner.go:130] > # user can specify with the "io.kubernetes.cri-o.Devices" allowed annotation.
I0305 01:52:17.730772 19549 command_runner.go:130] > # allowed_devices = [
I0305 01:52:17.730782 19549 command_runner.go:130] > # "/dev/fuse",
I0305 01:52:17.730789 19549 command_runner.go:130] > # ]
I0305 01:52:17.730800 19549 command_runner.go:130] > # List of additional devices. specified as
I0305 01:52:17.730810 19549 command_runner.go:130] > # "<device-on-host>:<device-on-container>:<permissions>", for example: "--device=/dev/sdc:/dev/xvdc:rwm".
I0305 01:52:17.730831 19549 command_runner.go:130] > # If it is empty or commented out, only the devices
I0305 01:52:17.730845 19549 command_runner.go:130] > # defined in the container json file by the user/kube will be added.
I0305 01:52:17.730854 19549 command_runner.go:130] > # additional_devices = [
I0305 01:52:17.730863 19549 command_runner.go:130] > # ]
I0305 01:52:17.730871 19549 command_runner.go:130] > # List of directories to scan for CDI Spec files.
I0305 01:52:17.730880 19549 command_runner.go:130] > # cdi_spec_dirs = [
I0305 01:52:17.730889 19549 command_runner.go:130] > # "/etc/cdi",
I0305 01:52:17.730899 19549 command_runner.go:130] > # "/var/run/cdi",
I0305 01:52:17.730907 19549 command_runner.go:130] > # ]
I0305 01:52:17.730917 19549 command_runner.go:130] > # Change the default behavior of setting container devices uid/gid from CRI's
I0305 01:52:17.730930 19549 command_runner.go:130] > # SecurityContext (RunAsUser/RunAsGroup) instead of taking host's uid/gid.
I0305 01:52:17.730941 19549 command_runner.go:130] > # Defaults to false.
I0305 01:52:17.730950 19549 command_runner.go:130] > # device_ownership_from_security_context = false
I0305 01:52:17.730963 19549 command_runner.go:130] > # Path to OCI hooks directories for automatically executed hooks. If one of the
I0305 01:52:17.730975 19549 command_runner.go:130] > # directories does not exist, then CRI-O will automatically skip them.
I0305 01:52:17.730983 19549 command_runner.go:130] > # hooks_dir = [
I0305 01:52:17.730999 19549 command_runner.go:130] > # "/usr/share/containers/oci/hooks.d",
I0305 01:52:17.731007 19549 command_runner.go:130] > # ]
I0305 01:52:17.731016 19549 command_runner.go:130] > # Path to the file specifying the defaults mounts for each container. The
I0305 01:52:17.731029 19549 command_runner.go:130] > # format of the config is /SRC:/DST, one mount per line. Notice that CRI-O reads
I0305 01:52:17.731041 19549 command_runner.go:130] > # its default mounts from the following two files:
I0305 01:52:17.731046 19549 command_runner.go:130] > #
I0305 01:52:17.731057 19549 command_runner.go:130] > # 1) /etc/containers/mounts.conf (i.e., default_mounts_file): This is the
I0305 01:52:17.731070 19549 command_runner.go:130] > # override file, where users can either add in their own default mounts, or
I0305 01:52:17.731082 19549 command_runner.go:130] > # override the default mounts shipped with the package.
I0305 01:52:17.731089 19549 command_runner.go:130] > #
I0305 01:52:17.731101 19549 command_runner.go:130] > # 2) /usr/share/containers/mounts.conf: This is the default file read for
I0305 01:52:17.731114 19549 command_runner.go:130] > # mounts. If you want CRI-O to read from a different, specific mounts file,
I0305 01:52:17.731127 19549 command_runner.go:130] > # you can change the default_mounts_file. Note, if this is done, CRI-O will
I0305 01:52:17.731142 19549 command_runner.go:130] > # only add mounts it finds in this file.
I0305 01:52:17.731150 19549 command_runner.go:130] > #
I0305 01:52:17.731158 19549 command_runner.go:130] > # default_mounts_file = ""
I0305 01:52:17.731171 19549 command_runner.go:130] > # Maximum number of processes allowed in a container.
I0305 01:52:17.731182 19549 command_runner.go:130] > # This option is deprecated. The Kubelet flag '--pod-pids-limit' should be used instead.
I0305 01:52:17.731192 19549 command_runner.go:130] > pids_limit = 1024
I0305 01:52:17.731207 19549 command_runner.go:130] > # Maximum sized allowed for the container log file. Negative numbers indicate
I0305 01:52:17.731241 19549 command_runner.go:130] > # that no size limit is imposed. If it is positive, it must be >= 8192 to
I0305 01:52:17.731252 19549 command_runner.go:130] > # match/exceed conmon's read buffer. The file is truncated and re-opened so the
I0305 01:52:17.731268 19549 command_runner.go:130] > # limit is never exceeded. This option is deprecated. The Kubelet flag '--container-log-max-size' should be used instead.
I0305 01:52:17.731279 19549 command_runner.go:130] > # log_size_max = -1
I0305 01:52:17.731291 19549 command_runner.go:130] > # Whether container output should be logged to journald in addition to the kubernetes log file
I0305 01:52:17.731301 19549 command_runner.go:130] > # log_to_journald = false
I0305 01:52:17.731311 19549 command_runner.go:130] > # Path to directory in which container exit files are written to by conmon.
I0305 01:52:17.731323 19549 command_runner.go:130] > # container_exits_dir = "/var/run/crio/exits"
I0305 01:52:17.731334 19549 command_runner.go:130] > # Path to directory for container attach sockets.
I0305 01:52:17.731343 19549 command_runner.go:130] > # container_attach_socket_dir = "/var/run/crio"
I0305 01:52:17.731351 19549 command_runner.go:130] > # The prefix to use for the source of the bind mounts.
I0305 01:52:17.731357 19549 command_runner.go:130] > # bind_mount_prefix = ""
I0305 01:52:17.731369 19549 command_runner.go:130] > # If set to true, all containers will run in read-only mode.
I0305 01:52:17.731390 19549 command_runner.go:130] > # read_only = false
I0305 01:52:17.731404 19549 command_runner.go:130] > # Changes the verbosity of the logs based on the level it is set to. Options
I0305 01:52:17.731416 19549 command_runner.go:130] > # are fatal, panic, error, warn, info, debug and trace. This option supports
I0305 01:52:17.731424 19549 command_runner.go:130] > # live configuration reload.
I0305 01:52:17.731433 19549 command_runner.go:130] > # log_level = "info"
I0305 01:52:17.731443 19549 command_runner.go:130] > # Filter the log messages by the provided regular expression.
I0305 01:52:17.731454 19549 command_runner.go:130] > # This option supports live configuration reload.
I0305 01:52:17.731463 19549 command_runner.go:130] > # log_filter = ""
I0305 01:52:17.731472 19549 command_runner.go:130] > # The UID mappings for the user namespace of each container. A range is
I0305 01:52:17.731490 19549 command_runner.go:130] > # specified in the form containerUID:HostUID:Size. Multiple ranges must be
I0305 01:52:17.731500 19549 command_runner.go:130] > # separated by comma.
I0305 01:52:17.731515 19549 command_runner.go:130] > # This option is deprecated, and will be replaced with Kubernetes user namespace support (KEP-127) in the future.
I0305 01:52:17.731525 19549 command_runner.go:130] > # uid_mappings = ""
I0305 01:52:17.731535 19549 command_runner.go:130] > # The GID mappings for the user namespace of each container. A range is
I0305 01:52:17.731548 19549 command_runner.go:130] > # specified in the form containerGID:HostGID:Size. Multiple ranges must be
I0305 01:52:17.731559 19549 command_runner.go:130] > # separated by comma.
I0305 01:52:17.731571 19549 command_runner.go:130] > # This option is deprecated, and will be replaced with Kubernetes user namespace support (KEP-127) in the future.
I0305 01:52:17.731585 19549 command_runner.go:130] > # gid_mappings = ""
I0305 01:52:17.731598 19549 command_runner.go:130] > # If set, CRI-O will reject any attempt to map host UIDs below this value
I0305 01:52:17.731611 19549 command_runner.go:130] > # into user namespaces. A negative value indicates that no minimum is set,
I0305 01:52:17.731623 19549 command_runner.go:130] > # so specifying mappings will only be allowed for pods that run as UID 0.
I0305 01:52:17.731634 19549 command_runner.go:130] > # This option is deprecated, and will be replaced with Kubernetes user namespace support (KEP-127) in the future.
I0305 01:52:17.731644 19549 command_runner.go:130] > # minimum_mappable_uid = -1
I0305 01:52:17.731664 19549 command_runner.go:130] > # If set, CRI-O will reject any attempt to map host GIDs below this value
I0305 01:52:17.731677 19549 command_runner.go:130] > # into user namespaces. A negative value indicates that no minimum is set,
I0305 01:52:17.731691 19549 command_runner.go:130] > # so specifying mappings will only be allowed for pods that run as UID 0.
I0305 01:52:17.731706 19549 command_runner.go:130] > # This option is deprecated, and will be replaced with Kubernetes user namespace support (KEP-127) in the future.
I0305 01:52:17.731716 19549 command_runner.go:130] > # minimum_mappable_gid = -1
I0305 01:52:17.731726 19549 command_runner.go:130] > # The minimal amount of time in seconds to wait before issuing a timeout
I0305 01:52:17.731738 19549 command_runner.go:130] > # regarding the proper termination of the container. The lowest possible
I0305 01:52:17.731749 19549 command_runner.go:130] > # value is 30s, whereas lower values are not considered by CRI-O.
I0305 01:52:17.731759 19549 command_runner.go:130] > # ctr_stop_timeout = 30
I0305 01:52:17.731768 19549 command_runner.go:130] > # drop_infra_ctr determines whether CRI-O drops the infra container
I0305 01:52:17.731780 19549 command_runner.go:130] > # when a pod does not have a private PID namespace, and does not use
I0305 01:52:17.731790 19549 command_runner.go:130] > # a kernel separating runtime (like kata).
I0305 01:52:17.731797 19549 command_runner.go:130] > # It requires manage_ns_lifecycle to be true.
I0305 01:52:17.731808 19549 command_runner.go:130] > drop_infra_ctr = false
I0305 01:52:17.731822 19549 command_runner.go:130] > # infra_ctr_cpuset determines what CPUs will be used to run infra containers.
I0305 01:52:17.731834 19549 command_runner.go:130] > # You can use linux CPU list format to specify desired CPUs.
I0305 01:52:17.731845 19549 command_runner.go:130] > # To get better isolation for guaranteed pods, set this parameter to be equal to kubelet reserved-cpus.
I0305 01:52:17.731855 19549 command_runner.go:130] > # infra_ctr_cpuset = ""
I0305 01:52:17.731867 19549 command_runner.go:130] > # shared_cpuset determines the CPU set which is allowed to be shared between guaranteed containers,
I0305 01:52:17.731875 19549 command_runner.go:130] > # regardless of, and in addition to, the exclusiveness of their CPUs.
I0305 01:52:17.731884 19549 command_runner.go:130] > # This field is optional and would not be used if not specified.
I0305 01:52:17.731895 19549 command_runner.go:130] > # You can specify CPUs in the Linux CPU list format.
I0305 01:52:17.731903 19549 command_runner.go:130] > # shared_cpuset = ""
I0305 01:52:17.731916 19549 command_runner.go:130] > # The directory where the state of the managed namespaces gets tracked.
I0305 01:52:17.731928 19549 command_runner.go:130] > # Only used when manage_ns_lifecycle is true.
I0305 01:52:17.731937 19549 command_runner.go:130] > # namespaces_dir = "/var/run"
I0305 01:52:17.731949 19549 command_runner.go:130] > # pinns_path is the path to find the pinns binary, which is needed to manage namespace lifecycle
I0305 01:52:17.731959 19549 command_runner.go:130] > pinns_path = "/usr/bin/pinns"
I0305 01:52:17.731971 19549 command_runner.go:130] > # Globally enable/disable CRIU support which is necessary to
I0305 01:52:17.731981 19549 command_runner.go:130] > # checkpoint and restore container or pods (even if CRIU is found in $PATH).
I0305 01:52:17.731987 19549 command_runner.go:130] > # enable_criu_support = false
I0305 01:52:17.731993 19549 command_runner.go:130] > # Enable/disable the generation of the container,
I0305 01:52:17.732006 19549 command_runner.go:130] > # sandbox lifecycle events to be sent to the Kubelet to optimize the PLEG
I0305 01:52:17.732014 19549 command_runner.go:130] > # enable_pod_events = false
I0305 01:52:17.732024 19549 command_runner.go:130] > # default_runtime is the _name_ of the OCI runtime to be used as the default.
I0305 01:52:17.732038 19549 command_runner.go:130] > # default_runtime is the _name_ of the OCI runtime to be used as the default.
I0305 01:52:17.732053 19549 command_runner.go:130] > # The name is matched against the runtimes map below.
I0305 01:52:17.732063 19549 command_runner.go:130] > # default_runtime = "runc"
I0305 01:52:17.732072 19549 command_runner.go:130] > # A list of paths that, when absent from the host,
I0305 01:52:17.732087 19549 command_runner.go:130] > # will cause a container creation to fail (as opposed to the current behavior being created as a directory).
I0305 01:52:17.732102 19549 command_runner.go:130] > # This option is to protect from source locations whose existence as a directory could jeopardize the health of the node, and whose
I0305 01:52:17.732112 19549 command_runner.go:130] > # creation as a file is not desired either.
I0305 01:52:17.732127 19549 command_runner.go:130] > # An example is /etc/hostname, which will cause failures on reboot if it's created as a directory, but often doesn't exist because
I0305 01:52:17.732138 19549 command_runner.go:130] > # the hostname is being managed dynamically.
I0305 01:52:17.732146 19549 command_runner.go:130] > # absent_mount_sources_to_reject = [
I0305 01:52:17.732154 19549 command_runner.go:130] > # ]
I0305 01:52:17.732165 19549 command_runner.go:130] > # The "crio.runtime.runtimes" table defines a list of OCI compatible runtimes.
I0305 01:52:17.732179 19549 command_runner.go:130] > # The runtime to use is picked based on the runtime handler provided by the CRI.
I0305 01:52:17.732192 19549 command_runner.go:130] > # If no runtime handler is provided, the "default_runtime" will be used.
I0305 01:52:17.732203 19549 command_runner.go:130] > # Each entry in the table should follow the format:
I0305 01:52:17.732211 19549 command_runner.go:130] > #
I0305 01:52:17.732224 19549 command_runner.go:130] > # [crio.runtime.runtimes.runtime-handler]
I0305 01:52:17.732242 19549 command_runner.go:130] > # runtime_path = "/path/to/the/executable"
I0305 01:52:17.732249 19549 command_runner.go:130] > # runtime_type = "oci"
I0305 01:52:17.732333 19549 command_runner.go:130] > # runtime_root = "/path/to/the/root"
I0305 01:52:17.732350 19549 command_runner.go:130] > # monitor_path = "/path/to/container/monitor"
I0305 01:52:17.732357 19549 command_runner.go:130] > # monitor_cgroup = "/cgroup/path"
I0305 01:52:17.732365 19549 command_runner.go:130] > # monitor_exec_cgroup = "/cgroup/path"
I0305 01:52:17.732371 19549 command_runner.go:130] > # monitor_env = []
I0305 01:52:17.732381 19549 command_runner.go:130] > # privileged_without_host_devices = false
I0305 01:52:17.732389 19549 command_runner.go:130] > # allowed_annotations = []
I0305 01:52:17.732399 19549 command_runner.go:130] > # platform_runtime_paths = { "os/arch" = "/path/to/binary" }
I0305 01:52:17.732414 19549 command_runner.go:130] > # Where:
I0305 01:52:17.732427 19549 command_runner.go:130] > # - runtime-handler: Name used to identify the runtime.
I0305 01:52:17.732439 19549 command_runner.go:130] > # - runtime_path (optional, string): Absolute path to the runtime executable in
I0305 01:52:17.732452 19549 command_runner.go:130] > # the host filesystem. If omitted, the runtime-handler identifier should match
I0305 01:52:17.732462 19549 command_runner.go:130] > # the runtime executable name, and the runtime executable should be placed
I0305 01:52:17.732474 19549 command_runner.go:130] > # in $PATH.
I0305 01:52:17.732488 19549 command_runner.go:130] > # - runtime_type (optional, string): Type of runtime, one of: "oci", "vm". If
I0305 01:52:17.732502 19549 command_runner.go:130] > # omitted, an "oci" runtime is assumed.
I0305 01:52:17.732516 19549 command_runner.go:130] > # - runtime_root (optional, string): Root directory for storage of containers
I0305 01:52:17.732525 19549 command_runner.go:130] > # state.
I0305 01:52:17.732543 19549 command_runner.go:130] > # - runtime_config_path (optional, string): the path for the runtime configuration
I0305 01:52:17.732556 19549 command_runner.go:130] > # file. This can only be used with when using the VM runtime_type.
I0305 01:52:17.732566 19549 command_runner.go:130] > # - privileged_without_host_devices (optional, bool): an option for restricting
I0305 01:52:17.732580 19549 command_runner.go:130] > # host devices from being passed to privileged containers.
I0305 01:52:17.732592 19549 command_runner.go:130] > # - allowed_annotations (optional, array of strings): an option for specifying
I0305 01:52:17.732606 19549 command_runner.go:130] > # a list of experimental annotations that this runtime handler is allowed to process.
I0305 01:52:17.732617 19549 command_runner.go:130] > # The currently recognized values are:
I0305 01:52:17.732631 19549 command_runner.go:130] > # "io.kubernetes.cri-o.userns-mode" for configuring a user namespace for the pod.
I0305 01:52:17.732646 19549 command_runner.go:130] > # "io.kubernetes.cri-o.cgroup2-mount-hierarchy-rw" for mounting cgroups writably when set to "true".
I0305 01:52:17.732658 19549 command_runner.go:130] > # "io.kubernetes.cri-o.Devices" for configuring devices for the pod.
I0305 01:52:17.732668 19549 command_runner.go:130] > # "io.kubernetes.cri-o.ShmSize" for configuring the size of /dev/shm.
I0305 01:52:17.732682 19549 command_runner.go:130] > # "io.kubernetes.cri-o.UnifiedCgroup.$CTR_NAME" for configuring the cgroup v2 unified block for a container.
I0305 01:52:17.732697 19549 command_runner.go:130] > # "io.containers.trace-syscall" for tracing syscalls via the OCI seccomp BPF hook.
I0305 01:52:17.732711 19549 command_runner.go:130] > # "io.kubernetes.cri-o.seccompNotifierAction" for enabling the seccomp notifier feature.
I0305 01:52:17.732723 19549 command_runner.go:130] > # "io.kubernetes.cri-o.umask" for setting the umask for container init process.
I0305 01:52:17.732736 19549 command_runner.go:130] > # "io.kubernetes.cri.rdt-class" for setting the RDT class of a container
I0305 01:52:17.732748 19549 command_runner.go:130] > # - monitor_path (optional, string): The path of the monitor binary. Replaces
I0305 01:52:17.732758 19549 command_runner.go:130] > # deprecated option "conmon".
I0305 01:52:17.732770 19549 command_runner.go:130] > # - monitor_cgroup (optional, string): The cgroup the container monitor process will be put in.
I0305 01:52:17.732788 19549 command_runner.go:130] > # Replaces deprecated option "conmon_cgroup".
I0305 01:52:17.732802 19549 command_runner.go:130] > # - monitor_exec_cgroup (optional, string): If set to "container", indicates exec probes
I0305 01:52:17.732812 19549 command_runner.go:130] > # should be moved to the container's cgroup
I0305 01:52:17.732835 19549 command_runner.go:130] > # - monitor_env (optional, array of strings): Environment variables to pass to the montior.
I0305 01:52:17.732853 19549 command_runner.go:130] > # Replaces deprecated option "conmon_env".
I0305 01:52:17.732869 19549 command_runner.go:130] > # - platform_runtime_paths (optional, map): A mapping of platforms to the corresponding
I0305 01:52:17.732881 19549 command_runner.go:130] > # runtime executable paths for the runtime handler.
I0305 01:52:17.732889 19549 command_runner.go:130] > #
I0305 01:52:17.732896 19549 command_runner.go:130] > # Using the seccomp notifier feature:
I0305 01:52:17.732906 19549 command_runner.go:130] > #
I0305 01:52:17.732916 19549 command_runner.go:130] > # This feature can help you to debug seccomp related issues, for example if
I0305 01:52:17.732930 19549 command_runner.go:130] > # blocked syscalls (permission denied errors) have negative impact on the workload.
I0305 01:52:17.732939 19549 command_runner.go:130] > #
I0305 01:52:17.732949 19549 command_runner.go:130] > # To be able to use this feature, configure a runtime which has the annotation
I0305 01:52:17.732962 19549 command_runner.go:130] > # "io.kubernetes.cri-o.seccompNotifierAction" in the allowed_annotations array.
I0305 01:52:17.732967 19549 command_runner.go:130] > #
I0305 01:52:17.732980 19549 command_runner.go:130] > # It also requires at least runc 1.1.0 or crun 0.19 which support the notifier
I0305 01:52:17.732999 19549 command_runner.go:130] > # feature.
I0305 01:52:17.733008 19549 command_runner.go:130] > #
I0305 01:52:17.733017 19549 command_runner.go:130] > # If everything is setup, CRI-O will modify chosen seccomp profiles for
I0305 01:52:17.733031 19549 command_runner.go:130] > # containers if the annotation "io.kubernetes.cri-o.seccompNotifierAction" is
I0305 01:52:17.733045 19549 command_runner.go:130] > # set on the Pod sandbox. CRI-O will then get notified if a container is using
I0305 01:52:17.733057 19549 command_runner.go:130] > # a blocked syscall and then terminate the workload after a timeout of 5
I0305 01:52:17.733073 19549 command_runner.go:130] > # seconds if the value of "io.kubernetes.cri-o.seccompNotifierAction=stop".
I0305 01:52:17.733082 19549 command_runner.go:130] > #
I0305 01:52:17.733092 19549 command_runner.go:130] > # This also means that multiple syscalls can be captured during that period,
I0305 01:52:17.733106 19549 command_runner.go:130] > # while the timeout will get reset once a new syscall has been discovered.
I0305 01:52:17.733114 19549 command_runner.go:130] > #
I0305 01:52:17.733123 19549 command_runner.go:130] > # This also means that the Pods "restartPolicy" has to be set to "Never",
I0305 01:52:17.733135 19549 command_runner.go:130] > # otherwise the kubelet will restart the container immediately.
I0305 01:52:17.733140 19549 command_runner.go:130] > #
I0305 01:52:17.733153 19549 command_runner.go:130] > # Please be aware that CRI-O is not able to get notified if a syscall gets
I0305 01:52:17.733164 19549 command_runner.go:130] > # blocked based on the seccomp defaultAction, which is a general runtime
I0305 01:52:17.733170 19549 command_runner.go:130] > # limitation.
I0305 01:52:17.733174 19549 command_runner.go:130] > [crio.runtime.runtimes.runc]
I0305 01:52:17.733178 19549 command_runner.go:130] > runtime_path = "/usr/bin/runc"
I0305 01:52:17.733182 19549 command_runner.go:130] > runtime_type = "oci"
I0305 01:52:17.733186 19549 command_runner.go:130] > runtime_root = "/run/runc"
I0305 01:52:17.733190 19549 command_runner.go:130] > runtime_config_path = ""
I0305 01:52:17.733197 19549 command_runner.go:130] > monitor_path = "/usr/libexec/crio/conmon"
I0305 01:52:17.733206 19549 command_runner.go:130] > monitor_cgroup = "pod"
I0305 01:52:17.733214 19549 command_runner.go:130] > monitor_exec_cgroup = ""
I0305 01:52:17.733227 19549 command_runner.go:130] > monitor_env = [
I0305 01:52:17.733237 19549 command_runner.go:130] > "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
I0305 01:52:17.733244 19549 command_runner.go:130] > ]
I0305 01:52:17.733252 19549 command_runner.go:130] > privileged_without_host_devices = false
I0305 01:52:17.733266 19549 command_runner.go:130] > # The workloads table defines ways to customize containers with different resources
I0305 01:52:17.733275 19549 command_runner.go:130] > # that work based on annotations, rather than the CRI.
I0305 01:52:17.733280 19549 command_runner.go:130] > # Note, the behavior of this table is EXPERIMENTAL and may change at any time.
I0305 01:52:17.733289 19549 command_runner.go:130] > # Each workload, has a name, activation_annotation, annotation_prefix and set of resources it supports mutating.
I0305 01:52:17.733299 19549 command_runner.go:130] > # The currently supported resources are "cpu" (to configure the cpu shares) and "cpuset" to configure the cpuset.
I0305 01:52:17.733306 19549 command_runner.go:130] > # Each resource can have a default value specified, or be empty.
I0305 01:52:17.733315 19549 command_runner.go:130] > # For a container to opt-into this workload, the pod should be configured with the annotation $activation_annotation (key only, value is ignored).
I0305 01:52:17.733329 19549 command_runner.go:130] > # To customize per-container, an annotation of the form $annotation_prefix.$resource/$ctrName = "value" can be specified
I0305 01:52:17.733337 19549 command_runner.go:130] > # signifying for that resource type to override the default value.
I0305 01:52:17.733347 19549 command_runner.go:130] > # If the annotation_prefix is not present, every container in the pod will be given the default values.
I0305 01:52:17.733356 19549 command_runner.go:130] > # Example:
I0305 01:52:17.733364 19549 command_runner.go:130] > # [crio.runtime.workloads.workload-type]
I0305 01:52:17.733375 19549 command_runner.go:130] > # activation_annotation = "io.crio/workload"
I0305 01:52:17.733386 19549 command_runner.go:130] > # annotation_prefix = "io.crio.workload-type"
I0305 01:52:17.733397 19549 command_runner.go:130] > # [crio.runtime.workloads.workload-type.resources]
I0305 01:52:17.733406 19549 command_runner.go:130] > # cpuset = 0
I0305 01:52:17.733415 19549 command_runner.go:130] > # cpushares = "0-1"
I0305 01:52:17.733419 19549 command_runner.go:130] > # Where:
I0305 01:52:17.733424 19549 command_runner.go:130] > # The workload name is workload-type.
I0305 01:52:17.733430 19549 command_runner.go:130] > # To specify, the pod must have the "io.crio.workload" annotation (this is a precise string match).
I0305 01:52:17.733438 19549 command_runner.go:130] > # This workload supports setting cpuset and cpu resources.
I0305 01:52:17.733443 19549 command_runner.go:130] > # annotation_prefix is used to customize the different resources.
I0305 01:52:17.733453 19549 command_runner.go:130] > # To configure the cpu shares a container gets in the example above, the pod would have to have the following annotation:
I0305 01:52:17.733459 19549 command_runner.go:130] > # "io.crio.workload-type/$container_name = {"cpushares": "value"}"
I0305 01:52:17.733464 19549 command_runner.go:130] > # hostnetwork_disable_selinux determines whether
I0305 01:52:17.733470 19549 command_runner.go:130] > # SELinux should be disabled within a pod when it is running in the host network namespace
I0305 01:52:17.733477 19549 command_runner.go:130] > # Default value is set to true
I0305 01:52:17.733481 19549 command_runner.go:130] > # hostnetwork_disable_selinux = true
I0305 01:52:17.733486 19549 command_runner.go:130] > # disable_hostport_mapping determines whether to enable/disable
I0305 01:52:17.733503 19549 command_runner.go:130] > # the container hostport mapping in CRI-O.
I0305 01:52:17.733513 19549 command_runner.go:130] > # Default value is set to 'false'
I0305 01:52:17.733518 19549 command_runner.go:130] > # disable_hostport_mapping = false
I0305 01:52:17.733526 19549 command_runner.go:130] > # The crio.image table contains settings pertaining to the management of OCI images.
I0305 01:52:17.733529 19549 command_runner.go:130] > #
I0305 01:52:17.733535 19549 command_runner.go:130] > # CRI-O reads its configured registries defaults from the system wide
I0305 01:52:17.733543 19549 command_runner.go:130] > # containers-registries.conf(5) located in /etc/containers/registries.conf. If
I0305 01:52:17.733549 19549 command_runner.go:130] > # you want to modify just CRI-O, you can change the registries configuration in
I0305 01:52:17.733557 19549 command_runner.go:130] > # this file. Otherwise, leave insecure_registries and registries commented out to
I0305 01:52:17.733565 19549 command_runner.go:130] > # use the system's defaults from /etc/containers/registries.conf.
I0305 01:52:17.733573 19549 command_runner.go:130] > [crio.image]
I0305 01:52:17.733583 19549 command_runner.go:130] > # Default transport for pulling images from a remote container storage.
I0305 01:52:17.733595 19549 command_runner.go:130] > # default_transport = "docker://"
I0305 01:52:17.733604 19549 command_runner.go:130] > # The path to a file containing credentials necessary for pulling images from
I0305 01:52:17.733615 19549 command_runner.go:130] > # secure registries. The file is similar to that of /var/lib/kubelet/config.json
I0305 01:52:17.733622 19549 command_runner.go:130] > # global_auth_file = ""
I0305 01:52:17.733629 19549 command_runner.go:130] > # The image used to instantiate infra containers.
I0305 01:52:17.733636 19549 command_runner.go:130] > # This option supports live configuration reload.
I0305 01:52:17.733641 19549 command_runner.go:130] > # pause_image = "registry.k8s.io/pause:3.9"
I0305 01:52:17.733646 19549 command_runner.go:130] > # The path to a file containing credentials specific for pulling the pause_image from
I0305 01:52:17.733654 19549 command_runner.go:130] > # above. The file is similar to that of /var/lib/kubelet/config.json
I0305 01:52:17.733659 19549 command_runner.go:130] > # This option supports live configuration reload.
I0305 01:52:17.733665 19549 command_runner.go:130] > # pause_image_auth_file = ""
I0305 01:52:17.733671 19549 command_runner.go:130] > # The command to run to have a container stay in the paused state.
I0305 01:52:17.733678 19549 command_runner.go:130] > # When explicitly set to "", it will fallback to the entrypoint and command
I0305 01:52:17.733684 19549 command_runner.go:130] > # specified in the pause image. When commented out, it will fallback to the
I0305 01:52:17.733692 19549 command_runner.go:130] > # default: "/pause". This option supports live configuration reload.
I0305 01:52:17.733696 19549 command_runner.go:130] > # pause_command = "/pause"
I0305 01:52:17.733704 19549 command_runner.go:130] > # List of images to be excluded from the kubelet's garbage collection.
I0305 01:52:17.733710 19549 command_runner.go:130] > # It allows specifying image names using either exact, glob, or keyword
I0305 01:52:17.733717 19549 command_runner.go:130] > # patterns. Exact matches must match the entire name, glob matches can
I0305 01:52:17.733722 19549 command_runner.go:130] > # have a wildcard * at the end, and keyword matches can have wildcards
I0305 01:52:17.733730 19549 command_runner.go:130] > # on both ends. By default, this list includes the "pause" image if
I0305 01:52:17.733735 19549 command_runner.go:130] > # configured by the user, which is used as a placeholder in Kubernetes pods.
I0305 01:52:17.733741 19549 command_runner.go:130] > # pinned_images = [
I0305 01:52:17.733744 19549 command_runner.go:130] > # ]
I0305 01:52:17.733750 19549 command_runner.go:130] > # Path to the file which decides what sort of policy we use when deciding
I0305 01:52:17.733758 19549 command_runner.go:130] > # whether or not to trust an image that we've pulled. It is not recommended that
I0305 01:52:17.733764 19549 command_runner.go:130] > # this option be used, as the default behavior of using the system-wide default
I0305 01:52:17.733772 19549 command_runner.go:130] > # policy (i.e., /etc/containers/policy.json) is most often preferred. Please
I0305 01:52:17.733779 19549 command_runner.go:130] > # refer to containers-policy.json(5) for more details.
I0305 01:52:17.733786 19549 command_runner.go:130] > # signature_policy = ""
I0305 01:52:17.733791 19549 command_runner.go:130] > # Root path for pod namespace-separated signature policies.
I0305 01:52:17.733797 19549 command_runner.go:130] > # The final policy to be used on image pull will be <SIGNATURE_POLICY_DIR>/<NAMESPACE>.json.
I0305 01:52:17.733803 19549 command_runner.go:130] > # If no pod namespace is being provided on image pull (via the sandbox config),
I0305 01:52:17.733813 19549 command_runner.go:130] > # or the concatenated path is non existent, then the signature_policy or system
I0305 01:52:17.733818 19549 command_runner.go:130] > # wide policy will be used as fallback. Must be an absolute path.
I0305 01:52:17.733825 19549 command_runner.go:130] > # signature_policy_dir = "/etc/crio/policies"
I0305 01:52:17.733830 19549 command_runner.go:130] > # List of registries to skip TLS verification for pulling images. Please
I0305 01:52:17.733836 19549 command_runner.go:130] > # consider configuring the registries via /etc/containers/registries.conf before
I0305 01:52:17.733846 19549 command_runner.go:130] > # changing them here.
I0305 01:52:17.733851 19549 command_runner.go:130] > # insecure_registries = [
I0305 01:52:17.733855 19549 command_runner.go:130] > # ]
I0305 01:52:17.733861 19549 command_runner.go:130] > # Controls how image volumes are handled. The valid values are mkdir, bind and
I0305 01:52:17.733866 19549 command_runner.go:130] > # ignore; the latter will ignore volumes entirely.
I0305 01:52:17.733870 19549 command_runner.go:130] > # image_volumes = "mkdir"
I0305 01:52:17.733875 19549 command_runner.go:130] > # Temporary directory to use for storing big files
I0305 01:52:17.733879 19549 command_runner.go:130] > # big_files_temporary_dir = ""
I0305 01:52:17.733884 19549 command_runner.go:130] > # The crio.network table containers settings pertaining to the management of
I0305 01:52:17.733887 19549 command_runner.go:130] > # CNI plugins.
I0305 01:52:17.733891 19549 command_runner.go:130] > [crio.network]
I0305 01:52:17.733896 19549 command_runner.go:130] > # The default CNI network name to be selected. If not set or "", then
I0305 01:52:17.733901 19549 command_runner.go:130] > # CRI-O will pick-up the first one found in network_dir.
I0305 01:52:17.733904 19549 command_runner.go:130] > # cni_default_network = ""
I0305 01:52:17.733909 19549 command_runner.go:130] > # Path to the directory where CNI configuration files are located.
I0305 01:52:17.733913 19549 command_runner.go:130] > # network_dir = "/etc/cni/net.d/"
I0305 01:52:17.733917 19549 command_runner.go:130] > # Paths to directories where CNI plugin binaries are located.
I0305 01:52:17.733921 19549 command_runner.go:130] > # plugin_dirs = [
I0305 01:52:17.733924 19549 command_runner.go:130] > # "/opt/cni/bin/",
I0305 01:52:17.733927 19549 command_runner.go:130] > # ]
I0305 01:52:17.733932 19549 command_runner.go:130] > # A necessary configuration for Prometheus based metrics retrieval
I0305 01:52:17.733935 19549 command_runner.go:130] > [crio.metrics]
I0305 01:52:17.733939 19549 command_runner.go:130] > # Globally enable or disable metrics support.
I0305 01:52:17.733943 19549 command_runner.go:130] > enable_metrics = true
I0305 01:52:17.733947 19549 command_runner.go:130] > # Specify enabled metrics collectors.
I0305 01:52:17.733954 19549 command_runner.go:130] > # Per default all metrics are enabled.
I0305 01:52:17.733964 19549 command_runner.go:130] > # It is possible, to prefix the metrics with "container_runtime_" and "crio_".
I0305 01:52:17.733987 19549 command_runner.go:130] > # For example, the metrics collector "operations" would be treated in the same
I0305 01:52:17.733998 19549 command_runner.go:130] > # way as "crio_operations" and "container_runtime_crio_operations".
I0305 01:52:17.734006 19549 command_runner.go:130] > # metrics_collectors = [
I0305 01:52:17.734011 19549 command_runner.go:130] > # "operations",
I0305 01:52:17.734023 19549 command_runner.go:130] > # "operations_latency_microseconds_total",
I0305 01:52:17.734031 19549 command_runner.go:130] > # "operations_latency_microseconds",
I0305 01:52:17.734035 19549 command_runner.go:130] > # "operations_errors",
I0305 01:52:17.734039 19549 command_runner.go:130] > # "image_pulls_by_digest",
I0305 01:52:17.734044 19549 command_runner.go:130] > # "image_pulls_by_name",
I0305 01:52:17.734053 19549 command_runner.go:130] > # "image_pulls_by_name_skipped",
I0305 01:52:17.734062 19549 command_runner.go:130] > # "image_pulls_failures",
I0305 01:52:17.734065 19549 command_runner.go:130] > # "image_pulls_successes",
I0305 01:52:17.734069 19549 command_runner.go:130] > # "image_pulls_layer_size",
I0305 01:52:17.734075 19549 command_runner.go:130] > # "image_layer_reuse",
I0305 01:52:17.734079 19549 command_runner.go:130] > # "containers_events_dropped_total",
I0305 01:52:17.734085 19549 command_runner.go:130] > # "containers_oom_total",
I0305 01:52:17.734089 19549 command_runner.go:130] > # "containers_oom",
I0305 01:52:17.734095 19549 command_runner.go:130] > # "processes_defunct",
I0305 01:52:17.734098 19549 command_runner.go:130] > # "operations_total",
I0305 01:52:17.734103 19549 command_runner.go:130] > # "operations_latency_seconds",
I0305 01:52:17.734109 19549 command_runner.go:130] > # "operations_latency_seconds_total",
I0305 01:52:17.734113 19549 command_runner.go:130] > # "operations_errors_total",
I0305 01:52:17.734120 19549 command_runner.go:130] > # "image_pulls_bytes_total",
I0305 01:52:17.734124 19549 command_runner.go:130] > # "image_pulls_skipped_bytes_total",
I0305 01:52:17.734128 19549 command_runner.go:130] > # "image_pulls_failure_total",
I0305 01:52:17.734134 19549 command_runner.go:130] > # "image_pulls_success_total",
I0305 01:52:17.734138 19549 command_runner.go:130] > # "image_layer_reuse_total",
I0305 01:52:17.734142 19549 command_runner.go:130] > # "containers_oom_count_total",
I0305 01:52:17.734149 19549 command_runner.go:130] > # "containers_seccomp_notifier_count_total",
I0305 01:52:17.734153 19549 command_runner.go:130] > # "resources_stalled_at_stage",
I0305 01:52:17.734176 19549 command_runner.go:130] > # ]
I0305 01:52:17.734188 19549 command_runner.go:130] > # The port on which the metrics server will listen.
I0305 01:52:17.734197 19549 command_runner.go:130] > # metrics_port = 9090
I0305 01:52:17.734203 19549 command_runner.go:130] > # Local socket path to bind the metrics server to
I0305 01:52:17.734209 19549 command_runner.go:130] > # metrics_socket = ""
I0305 01:52:17.734214 19549 command_runner.go:130] > # The certificate for the secure metrics server.
I0305 01:52:17.734224 19549 command_runner.go:130] > # If the certificate is not available on disk, then CRI-O will generate a
I0305 01:52:17.734232 19549 command_runner.go:130] > # self-signed one. CRI-O also watches for changes of this path and reloads the
I0305 01:52:17.734236 19549 command_runner.go:130] > # certificate on any modification event.
I0305 01:52:17.734240 19549 command_runner.go:130] > # metrics_cert = ""
I0305 01:52:17.734246 19549 command_runner.go:130] > # The certificate key for the secure metrics server.
I0305 01:52:17.734251 19549 command_runner.go:130] > # Behaves in the same way as the metrics_cert.
I0305 01:52:17.734256 19549 command_runner.go:130] > # metrics_key = ""
I0305 01:52:17.734261 19549 command_runner.go:130] > # A necessary configuration for OpenTelemetry trace data exporting
I0305 01:52:17.734265 19549 command_runner.go:130] > [crio.tracing]
I0305 01:52:17.734274 19549 command_runner.go:130] > # Globally enable or disable exporting OpenTelemetry traces.
I0305 01:52:17.734281 19549 command_runner.go:130] > # enable_tracing = false
I0305 01:52:17.734286 19549 command_runner.go:130] > # Address on which the gRPC trace collector listens on.
I0305 01:52:17.734290 19549 command_runner.go:130] > # tracing_endpoint = "0.0.0.0:4317"
I0305 01:52:17.734296 19549 command_runner.go:130] > # Number of samples to collect per million spans. Set to 1000000 to always sample.
I0305 01:52:17.734303 19549 command_runner.go:130] > # tracing_sampling_rate_per_million = 0
I0305 01:52:17.734307 19549 command_runner.go:130] > # CRI-O NRI configuration.
I0305 01:52:17.734312 19549 command_runner.go:130] > [crio.nri]
I0305 01:52:17.734316 19549 command_runner.go:130] > # Globally enable or disable NRI.
I0305 01:52:17.734322 19549 command_runner.go:130] > # enable_nri = false
I0305 01:52:17.734328 19549 command_runner.go:130] > # NRI socket to listen on.
I0305 01:52:17.734335 19549 command_runner.go:130] > # nri_listen = "/var/run/nri/nri.sock"
I0305 01:52:17.734339 19549 command_runner.go:130] > # NRI plugin directory to use.
I0305 01:52:17.734343 19549 command_runner.go:130] > # nri_plugin_dir = "/opt/nri/plugins"
I0305 01:52:17.734351 19549 command_runner.go:130] > # NRI plugin configuration directory to use.
I0305 01:52:17.734355 19549 command_runner.go:130] > # nri_plugin_config_dir = "/etc/nri/conf.d"
I0305 01:52:17.734361 19549 command_runner.go:130] > # Disable connections from externally launched NRI plugins.
I0305 01:52:17.734365 19549 command_runner.go:130] > # nri_disable_connections = false
I0305 01:52:17.734371 19549 command_runner.go:130] > # Timeout for a plugin to register itself with NRI.
I0305 01:52:17.734375 19549 command_runner.go:130] > # nri_plugin_registration_timeout = "5s"
I0305 01:52:17.734382 19549 command_runner.go:130] > # Timeout for a plugin to handle an NRI request.
I0305 01:52:17.734386 19549 command_runner.go:130] > # nri_plugin_request_timeout = "2s"
I0305 01:52:17.734394 19549 command_runner.go:130] > # Necessary information pertaining to container and pod stats reporting.
I0305 01:52:17.734397 19549 command_runner.go:130] > [crio.stats]
I0305 01:52:17.734403 19549 command_runner.go:130] > # The number of seconds between collecting pod and container stats.
I0305 01:52:17.734408 19549 command_runner.go:130] > # If set to 0, the stats are collected on-demand instead.
I0305 01:52:17.734420 19549 command_runner.go:130] > # stats_collection_period = 0
I0305 01:52:17.734896 19549 command_runner.go:130] ! time="2024-03-05 01:52:17.708047598Z" level=info msg="Starting CRI-O, version: 1.29.1, git: unknown(clean)"
I0305 01:52:17.734917 19549 command_runner.go:130] ! level=info msg="Using default capabilities: CAP_CHOWN, CAP_DAC_OVERRIDE, CAP_FSETID, CAP_FOWNER, CAP_SETGID, CAP_SETUID, CAP_SETPCAP, CAP_NET_BIND_SERVICE, CAP_KILL"
I0305 01:52:17.735200 19549 cni.go:84] Creating CNI manager for ""
I0305 01:52:17.735218 19549 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0305 01:52:17.735232 19549 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0305 01:52:17.735255 19549 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.62 APIServerPort:8441 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:functional-453214 NodeName:functional-453214 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.62"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.62 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/
etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0305 01:52:17.735379 19549 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.62
bindPort: 8441
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "functional-453214"
kubeletExtraArgs:
node-ip: 192.168.39.62
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.62"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8441
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0305 01:52:17.735437 19549 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0305 01:52:17.747109 19549 command_runner.go:130] > kubeadm
I0305 01:52:17.747128 19549 command_runner.go:130] > kubectl
I0305 01:52:17.747134 19549 command_runner.go:130] > kubelet
I0305 01:52:17.747158 19549 binaries.go:44] Found k8s binaries, skipping transfer
I0305 01:52:17.747209 19549 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0305 01:52:17.757818 19549 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (316 bytes)
I0305 01:52:17.776418 19549 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0305 01:52:17.794512 19549 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2158 bytes)
I0305 01:52:17.812766 19549 ssh_runner.go:195] Run: grep 192.168.39.62 control-plane.minikube.internal$ /etc/hosts
I0305 01:52:17.816841 19549 command_runner.go:130] > 192.168.39.62 control-plane.minikube.internal
I0305 01:52:17.816978 19549 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0305 01:52:17.959257 19549 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0305 01:52:17.975568 19549 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214 for IP: 192.168.39.62
I0305 01:52:17.975590 19549 certs.go:194] generating shared ca certs ...
I0305 01:52:17.975610 19549 certs.go:226] acquiring lock for ca certs: {Name:mkd798d23114d8cce18871242c1505100314b4d5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0305 01:52:17.975794 19549 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-6453/.minikube/ca.key
I0305 01:52:17.975861 19549 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-6453/.minikube/proxy-client-ca.key
I0305 01:52:17.975874 19549 certs.go:256] generating profile certs ...
I0305 01:52:17.975971 19549 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/client.key
I0305 01:52:17.976049 19549 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/apiserver.key.d0d13bb9
I0305 01:52:17.976116 19549 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/proxy-client.key
I0305 01:52:17.976129 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0305 01:52:17.976145 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0305 01:52:17.976161 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0305 01:52:17.976178 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0305 01:52:17.976194 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0305 01:52:17.976207 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0305 01:52:17.976218 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0305 01:52:17.976227 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0305 01:52:17.976278 19549 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/13668.pem (1338 bytes)
W0305 01:52:17.976305 19549 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-6453/.minikube/certs/13668_empty.pem, impossibly tiny 0 bytes
I0305 01:52:17.976314 19549 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca-key.pem (1679 bytes)
I0305 01:52:17.976338 19549 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca.pem (1078 bytes)
I0305 01:52:17.976363 19549 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/cert.pem (1123 bytes)
I0305 01:52:17.976383 19549 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/key.pem (1679 bytes)
I0305 01:52:17.976418 19549 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/ssl/certs/136682.pem (1708 bytes)
I0305 01:52:17.976442 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/13668.pem -> /usr/share/ca-certificates/13668.pem
I0305 01:52:17.976458 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/ssl/certs/136682.pem -> /usr/share/ca-certificates/136682.pem
I0305 01:52:17.976475 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0305 01:52:17.977109 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0305 01:52:18.001619 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0305 01:52:18.026566 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0305 01:52:18.051455 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0305 01:52:18.076831 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0305 01:52:18.102348 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0305 01:52:18.127360 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0305 01:52:18.152299 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0305 01:52:18.177248 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/certs/13668.pem --> /usr/share/ca-certificates/13668.pem (1338 bytes)
I0305 01:52:18.203118 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/ssl/certs/136682.pem --> /usr/share/ca-certificates/136682.pem (1708 bytes)
I0305 01:52:18.227965 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0305 01:52:18.253968 19549 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0305 01:52:18.272003 19549 ssh_runner.go:195] Run: openssl version
I0305 01:52:18.278551 19549 command_runner.go:130] > OpenSSL 1.1.1w 11 Sep 2023
I0305 01:52:18.278630 19549 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/13668.pem && ln -fs /usr/share/ca-certificates/13668.pem /etc/ssl/certs/13668.pem"
I0305 01:52:18.291901 19549 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/13668.pem
I0305 01:52:18.296675 19549 command_runner.go:130] > -rw-r--r-- 1 root root 1338 Mar 5 01:48 /usr/share/ca-certificates/13668.pem
I0305 01:52:18.296699 19549 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 5 01:48 /usr/share/ca-certificates/13668.pem
I0305 01:52:18.296732 19549 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/13668.pem
I0305 01:52:18.302745 19549 command_runner.go:130] > 51391683
I0305 01:52:18.302926 19549 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/13668.pem /etc/ssl/certs/51391683.0"
I0305 01:52:18.313602 19549 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/136682.pem && ln -fs /usr/share/ca-certificates/136682.pem /etc/ssl/certs/136682.pem"
I0305 01:52:18.325821 19549 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/136682.pem
I0305 01:52:18.330855 19549 command_runner.go:130] > -rw-r--r-- 1 root root 1708 Mar 5 01:48 /usr/share/ca-certificates/136682.pem
I0305 01:52:18.330882 19549 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 5 01:48 /usr/share/ca-certificates/136682.pem
I0305 01:52:18.330919 19549 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/136682.pem
I0305 01:52:18.336862 19549 command_runner.go:130] > 3ec20f2e
I0305 01:52:18.336908 19549 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/136682.pem /etc/ssl/certs/3ec20f2e.0"
I0305 01:52:18.347480 19549 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0305 01:52:18.360675 19549 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0305 01:52:18.365429 19549 command_runner.go:130] > -rw-r--r-- 1 root root 1111 Mar 5 01:40 /usr/share/ca-certificates/minikubeCA.pem
I0305 01:52:18.365554 19549 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 5 01:40 /usr/share/ca-certificates/minikubeCA.pem
I0305 01:52:18.365604 19549 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0305 01:52:18.371599 19549 command_runner.go:130] > b5213941
I0305 01:52:18.371646 19549 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0305 01:52:18.382495 19549 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0305 01:52:18.388831 19549 command_runner.go:130] > File: /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0305 01:52:18.388857 19549 command_runner.go:130] > Size: 1164 Blocks: 8 IO Block: 4096 regular file
I0305 01:52:18.388866 19549 command_runner.go:130] > Device: 253,1 Inode: 4197437 Links: 1
I0305 01:52:18.388875 19549 command_runner.go:130] > Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root)
I0305 01:52:18.388884 19549 command_runner.go:130] > Access: 2024-03-05 01:49:31.915916968 +0000
I0305 01:52:18.388897 19549 command_runner.go:130] > Modify: 2024-03-05 01:49:31.915916968 +0000
I0305 01:52:18.388905 19549 command_runner.go:130] > Change: 2024-03-05 01:49:31.915916968 +0000
I0305 01:52:18.388915 19549 command_runner.go:130] > Birth: 2024-03-05 01:49:31.915916968 +0000
I0305 01:52:18.388961 19549 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0305 01:52:18.394962 19549 command_runner.go:130] > Certificate will not expire
I0305 01:52:18.395083 19549 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0305 01:52:18.401077 19549 command_runner.go:130] > Certificate will not expire
I0305 01:52:18.401149 19549 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0305 01:52:18.407007 19549 command_runner.go:130] > Certificate will not expire
I0305 01:52:18.407069 19549 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0305 01:52:18.412944 19549 command_runner.go:130] > Certificate will not expire
I0305 01:52:18.412997 19549 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0305 01:52:18.418596 19549 command_runner.go:130] > Certificate will not expire
I0305 01:52:18.418958 19549 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0305 01:52:18.424668 19549 command_runner.go:130] > Certificate will not expire
I0305 01:52:18.424723 19549 kubeadm.go:391] StartCluster: {Name:functional-453214 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28
.4 ClusterName:functional-453214 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.62 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0305 01:52:18.424800 19549 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0305 01:52:18.424832 19549 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0305 01:52:18.463632 19549 command_runner.go:130] > 8d0a6626ab508ebc33325bef6b6ba28b691d534429beb11c7d3f41c8cb7ff4e3
I0305 01:52:18.463659 19549 command_runner.go:130] > 1db008fd11b252f0062cedf18250a07ff4fda6a461a951cf922cdedc6a3d1fde
I0305 01:52:18.463667 19549 command_runner.go:130] > 8479f2d07a6c3eb71db9e647fd570b3541c0f816bb58280dbabc82850ce43bcf
I0305 01:52:18.463677 19549 command_runner.go:130] > d20870fb9e2013b09a49905daf56f573b42963805f40077a28b2d059acd6bfa3
I0305 01:52:18.463684 19549 command_runner.go:130] > 74f30423682cb801301443b9511d9f47e139f1671df8d45c79cf33b6a78cbd60
I0305 01:52:18.463699 19549 command_runner.go:130] > 69e8a3b084ae6b44dd527a82ae2dfa853b1e7e83278f14d2e222ede0208b5a21
I0305 01:52:18.463708 19549 command_runner.go:130] > 622cfccd4d85b7c74d501ad1c0b4a7b0cdc4e32de6691a791b8ce54bddcdbfc2
I0305 01:52:18.463718 19549 command_runner.go:130] > 1f533cf8af6cc633403cbc30f1b3a8bd09e0a7f9c1e08dfd644681f523e5a57e
I0305 01:52:18.463728 19549 command_runner.go:130] > a4f8033d7c8d2cb8b003e72d5d7c8fe37e6e829611c919470c6109517d04ec58
I0305 01:52:18.463741 19549 command_runner.go:130] > 9c947173b36e3ec9586193b87d921670089f030ee83a5dc5859f5d032290fd9a
I0305 01:52:18.463754 19549 command_runner.go:130] > f7e77f445c6d8106dd827a65e669578404eb50c10388d91db710a1030c764fae
I0305 01:52:18.463779 19549 cri.go:89] found id: "8d0a6626ab508ebc33325bef6b6ba28b691d534429beb11c7d3f41c8cb7ff4e3"
I0305 01:52:18.463790 19549 cri.go:89] found id: "1db008fd11b252f0062cedf18250a07ff4fda6a461a951cf922cdedc6a3d1fde"
I0305 01:52:18.463795 19549 cri.go:89] found id: "8479f2d07a6c3eb71db9e647fd570b3541c0f816bb58280dbabc82850ce43bcf"
I0305 01:52:18.463799 19549 cri.go:89] found id: "d20870fb9e2013b09a49905daf56f573b42963805f40077a28b2d059acd6bfa3"
I0305 01:52:18.463803 19549 cri.go:89] found id: "74f30423682cb801301443b9511d9f47e139f1671df8d45c79cf33b6a78cbd60"
I0305 01:52:18.463808 19549 cri.go:89] found id: "69e8a3b084ae6b44dd527a82ae2dfa853b1e7e83278f14d2e222ede0208b5a21"
I0305 01:52:18.463816 19549 cri.go:89] found id: "622cfccd4d85b7c74d501ad1c0b4a7b0cdc4e32de6691a791b8ce54bddcdbfc2"
I0305 01:52:18.463821 19549 cri.go:89] found id: "1f533cf8af6cc633403cbc30f1b3a8bd09e0a7f9c1e08dfd644681f523e5a57e"
I0305 01:52:18.463826 19549 cri.go:89] found id: "a4f8033d7c8d2cb8b003e72d5d7c8fe37e6e829611c919470c6109517d04ec58"
I0305 01:52:18.463834 19549 cri.go:89] found id: "9c947173b36e3ec9586193b87d921670089f030ee83a5dc5859f5d032290fd9a"
I0305 01:52:18.463842 19549 cri.go:89] found id: "f7e77f445c6d8106dd827a65e669578404eb50c10388d91db710a1030c764fae"
I0305 01:52:18.463846 19549 cri.go:89] found id: ""
I0305 01:52:18.463890 19549 ssh_runner.go:195] Run: sudo runc list -f json
** /stderr **
functional_test.go:657: failed to soft start minikube. args "out/minikube-linux-amd64 start -p functional-453214 --alsologtostderr -v=8": exit status 109
functional_test.go:659: soft start took 13m59.161917876s for "functional-453214" cluster.
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p functional-453214 -n functional-453214
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p functional-453214 -n functional-453214: exit status 2 (242.112902ms)
-- stdout --
Running
-- /stdout --
helpers_test.go:239: status error: exit status 2 (may be ok)
helpers_test.go:244: <<< TestFunctional/serial/SoftStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestFunctional/serial/SoftStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p functional-453214 logs -n 25
helpers_test.go:252: TestFunctional/serial/SoftStart logs:
-- stdout --
==> Audit <==
|---------|--------------------------------|-------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------|-------------------|---------|---------|---------------------|---------------------|
| ip | addons-139295 ip | addons-139295 | jenkins | v1.32.0 | 05 Mar 24 01:44 UTC | 05 Mar 24 01:44 UTC |
| addons | addons-139295 addons disable | addons-139295 | jenkins | v1.32.0 | 05 Mar 24 01:44 UTC | 05 Mar 24 01:44 UTC |
| | ingress-dns --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | addons-139295 addons disable | addons-139295 | jenkins | v1.32.0 | 05 Mar 24 01:44 UTC | 05 Mar 24 01:45 UTC |
| | ingress --alsologtostderr -v=1 | | | | | |
| addons | addons-139295 addons disable | addons-139295 | jenkins | v1.32.0 | 05 Mar 24 01:45 UTC | 05 Mar 24 01:45 UTC |
| | gcp-auth --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| stop | -p addons-139295 | addons-139295 | jenkins | v1.32.0 | 05 Mar 24 01:45 UTC | |
| addons | enable dashboard -p | addons-139295 | jenkins | v1.32.0 | 05 Mar 24 01:47 UTC | |
| | addons-139295 | | | | | |
| addons | disable dashboard -p | addons-139295 | jenkins | v1.32.0 | 05 Mar 24 01:47 UTC | |
| | addons-139295 | | | | | |
| addons | disable gvisor -p | addons-139295 | jenkins | v1.32.0 | 05 Mar 24 01:47 UTC | |
| | addons-139295 | | | | | |
| delete | -p addons-139295 | addons-139295 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | 05 Mar 24 01:48 UTC |
| start | -p nospam-370369 -n=1 | nospam-370369 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | 05 Mar 24 01:48 UTC |
| | --memory=2250 --wait=false | | | | | |
| | --log_dir=/tmp/nospam-370369 | | | | | |
| | --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| start | nospam-370369 --log_dir | nospam-370369 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | |
| | /tmp/nospam-370369 start | | | | | |
| | --dry-run | | | | | |
| start | nospam-370369 --log_dir | nospam-370369 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | |
| | /tmp/nospam-370369 start | | | | | |
| | --dry-run | | | | | |
| start | nospam-370369 --log_dir | nospam-370369 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | |
| | /tmp/nospam-370369 start | | | | | |
| | --dry-run | | | | | |
| pause | nospam-370369 --log_dir | nospam-370369 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | 05 Mar 24 01:48 UTC |
| | /tmp/nospam-370369 pause | | | | | |
| pause | nospam-370369 --log_dir | nospam-370369 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | 05 Mar 24 01:48 UTC |
| | /tmp/nospam-370369 pause | | | | | |
| pause | nospam-370369 --log_dir | nospam-370369 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | 05 Mar 24 01:48 UTC |
| | /tmp/nospam-370369 pause | | | | | |
| unpause | nospam-370369 --log_dir | nospam-370369 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | 05 Mar 24 01:48 UTC |
| | /tmp/nospam-370369 unpause | | | | | |
| unpause | nospam-370369 --log_dir | nospam-370369 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | 05 Mar 24 01:48 UTC |
| | /tmp/nospam-370369 unpause | | | | | |
| unpause | nospam-370369 --log_dir | nospam-370369 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | 05 Mar 24 01:48 UTC |
| | /tmp/nospam-370369 unpause | | | | | |
| stop | nospam-370369 --log_dir | nospam-370369 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | 05 Mar 24 01:48 UTC |
| | /tmp/nospam-370369 stop | | | | | |
| stop | nospam-370369 --log_dir | nospam-370369 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | 05 Mar 24 01:48 UTC |
| | /tmp/nospam-370369 stop | | | | | |
| stop | nospam-370369 --log_dir | nospam-370369 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | 05 Mar 24 01:48 UTC |
| | /tmp/nospam-370369 stop | | | | | |
| delete | -p nospam-370369 | nospam-370369 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | 05 Mar 24 01:48 UTC |
| start | -p functional-453214 | functional-453214 | jenkins | v1.32.0 | 05 Mar 24 01:48 UTC | 05 Mar 24 01:50 UTC |
| | --memory=4000 | | | | | |
| | --apiserver-port=8441 | | | | | |
| | --wait=all --driver=kvm2 | | | | | |
| | --container-runtime=crio | | | | | |
| start | -p functional-453214 | functional-453214 | jenkins | v1.32.0 | 05 Mar 24 01:50 UTC | |
| | --alsologtostderr -v=8 | | | | | |
|---------|--------------------------------|-------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/03/05 01:50:37
Running on machine: ubuntu-20-agent-10
Binary: Built with gc go1.22.0 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0305 01:50:37.798632 19549 out.go:291] Setting OutFile to fd 1 ...
I0305 01:50:37.798725 19549 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0305 01:50:37.798733 19549 out.go:304] Setting ErrFile to fd 2...
I0305 01:50:37.798737 19549 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0305 01:50:37.798921 19549 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17909-6453/.minikube/bin
I0305 01:50:37.799427 19549 out.go:298] Setting JSON to false
I0305 01:50:37.800234 19549 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":1984,"bootTime":1709601454,"procs":180,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0305 01:50:37.800292 19549 start.go:139] virtualization: kvm guest
I0305 01:50:37.802451 19549 out.go:177] * [functional-453214] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
I0305 01:50:37.803876 19549 out.go:177] - MINIKUBE_LOCATION=17909
I0305 01:50:37.803844 19549 notify.go:220] Checking for updates...
I0305 01:50:37.805080 19549 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0305 01:50:37.806462 19549 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/17909-6453/kubeconfig
I0305 01:50:37.807684 19549 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/17909-6453/.minikube
I0305 01:50:37.808716 19549 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0305 01:50:37.809774 19549 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0305 01:50:37.811335 19549 config.go:182] Loaded profile config "functional-453214": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0305 01:50:37.811428 19549 driver.go:392] Setting default libvirt URI to qemu:///system
I0305 01:50:37.811778 19549 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0305 01:50:37.811838 19549 main.go:141] libmachine: Launching plugin server for driver kvm2
I0305 01:50:37.826017 19549 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37485
I0305 01:50:37.826412 19549 main.go:141] libmachine: () Calling .GetVersion
I0305 01:50:37.826870 19549 main.go:141] libmachine: Using API Version 1
I0305 01:50:37.826888 19549 main.go:141] libmachine: () Calling .SetConfigRaw
I0305 01:50:37.827290 19549 main.go:141] libmachine: () Calling .GetMachineName
I0305 01:50:37.827476 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:37.861083 19549 out.go:177] * Using the kvm2 driver based on existing profile
I0305 01:50:37.862378 19549 start.go:297] selected driver: kvm2
I0305 01:50:37.862396 19549 start.go:901] validating driver "kvm2" against &{Name:functional-453214 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:functional-453214 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.62 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L Mount
GID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0305 01:50:37.862492 19549 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0305 01:50:37.862809 19549 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0305 01:50:37.862896 19549 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17909-6453/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0305 01:50:37.877502 19549 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.32.0
I0305 01:50:37.878197 19549 cni.go:84] Creating CNI manager for ""
I0305 01:50:37.878213 19549 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0305 01:50:37.878262 19549 start.go:340] cluster config:
{Name:functional-453214 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-453214 Namespace:default APIServer
HAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.62 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p
MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0305 01:50:37.878354 19549 iso.go:125] acquiring lock: {Name:mkf3f500c52164425f7db4bab55368d9b35643c9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0305 01:50:37.880055 19549 out.go:177] * Starting "functional-453214" primary control-plane node in "functional-453214" cluster
I0305 01:50:37.881210 19549 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0305 01:50:37.881237 19549 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17909-6453/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
I0305 01:50:37.881243 19549 cache.go:56] Caching tarball of preloaded images
I0305 01:50:37.881320 19549 preload.go:173] Found /home/jenkins/minikube-integration/17909-6453/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0305 01:50:37.881333 19549 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on crio
I0305 01:50:37.881415 19549 profile.go:142] Saving config to /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/config.json ...
I0305 01:50:37.881576 19549 start.go:360] acquireMachinesLock for functional-453214: {Name:mk8af9b6c4528f2050a2046e5c3c2bdca8c52f85 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0305 01:50:37.881615 19549 start.go:364] duration metric: took 22.492µs to acquireMachinesLock for "functional-453214"
I0305 01:50:37.881628 19549 start.go:96] Skipping create...Using existing machine configuration
I0305 01:50:37.881635 19549 fix.go:54] fixHost starting:
I0305 01:50:37.881877 19549 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2
I0305 01:50:37.881904 19549 main.go:141] libmachine: Launching plugin server for driver kvm2
I0305 01:50:37.895399 19549 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43199
I0305 01:50:37.895741 19549 main.go:141] libmachine: () Calling .GetVersion
I0305 01:50:37.896180 19549 main.go:141] libmachine: Using API Version 1
I0305 01:50:37.896209 19549 main.go:141] libmachine: () Calling .SetConfigRaw
I0305 01:50:37.896480 19549 main.go:141] libmachine: () Calling .GetMachineName
I0305 01:50:37.896646 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:37.896794 19549 main.go:141] libmachine: (functional-453214) Calling .GetState
I0305 01:50:37.898123 19549 fix.go:112] recreateIfNeeded on functional-453214: state=Running err=<nil>
W0305 01:50:37.898152 19549 fix.go:138] unexpected machine state, will restart: <nil>
I0305 01:50:37.900017 19549 out.go:177] * Updating the running kvm2 "functional-453214" VM ...
I0305 01:50:37.901195 19549 machine.go:94] provisionDockerMachine start ...
I0305 01:50:37.901223 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:37.901393 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:37.903584 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:37.903966 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:37.903993 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:37.904093 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:37.904238 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:37.904375 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:37.904489 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:37.904604 19549 main.go:141] libmachine: Using SSH client type: native
I0305 01:50:37.904777 19549 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.62 22 <nil> <nil>}
I0305 01:50:37.904788 19549 main.go:141] libmachine: About to run SSH command:
hostname
I0305 01:50:38.007224 19549 main.go:141] libmachine: SSH cmd err, output: <nil>: functional-453214
I0305 01:50:38.007256 19549 main.go:141] libmachine: (functional-453214) Calling .GetMachineName
I0305 01:50:38.007508 19549 buildroot.go:166] provisioning hostname "functional-453214"
I0305 01:50:38.007550 19549 main.go:141] libmachine: (functional-453214) Calling .GetMachineName
I0305 01:50:38.007740 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:38.010576 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.010952 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:38.010980 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.011118 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:38.011343 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:38.011517 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:38.011632 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:38.011837 19549 main.go:141] libmachine: Using SSH client type: native
I0305 01:50:38.011988 19549 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.62 22 <nil> <nil>}
I0305 01:50:38.012002 19549 main.go:141] libmachine: About to run SSH command:
sudo hostname functional-453214 && echo "functional-453214" | sudo tee /etc/hostname
I0305 01:50:38.135252 19549 main.go:141] libmachine: SSH cmd err, output: <nil>: functional-453214
I0305 01:50:38.135279 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:38.137978 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.138434 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:38.138457 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.138641 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:38.138825 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:38.139012 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:38.139168 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:38.139316 19549 main.go:141] libmachine: Using SSH client type: native
I0305 01:50:38.139480 19549 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.62 22 <nil> <nil>}
I0305 01:50:38.139496 19549 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sfunctional-453214' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 functional-453214/g' /etc/hosts;
else
echo '127.0.1.1 functional-453214' | sudo tee -a /etc/hosts;
fi
fi
I0305 01:50:38.243381 19549 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0305 01:50:38.243410 19549 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17909-6453/.minikube CaCertPath:/home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17909-6453/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17909-6453/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17909-6453/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17909-6453/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17909-6453/.minikube}
I0305 01:50:38.243434 19549 buildroot.go:174] setting up certificates
I0305 01:50:38.243443 19549 provision.go:84] configureAuth start
I0305 01:50:38.243454 19549 main.go:141] libmachine: (functional-453214) Calling .GetMachineName
I0305 01:50:38.243709 19549 main.go:141] libmachine: (functional-453214) Calling .GetIP
I0305 01:50:38.246286 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.246644 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:38.246670 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.246848 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:38.249142 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.249449 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:38.249476 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.249589 19549 provision.go:143] copyHostCerts
I0305 01:50:38.249633 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17909-6453/.minikube/ca.pem
I0305 01:50:38.249659 19549 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-6453/.minikube/ca.pem, removing ...
I0305 01:50:38.249668 19549 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-6453/.minikube/ca.pem
I0305 01:50:38.249726 19549 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17909-6453/.minikube/ca.pem (1078 bytes)
I0305 01:50:38.249831 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17909-6453/.minikube/cert.pem
I0305 01:50:38.249852 19549 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-6453/.minikube/cert.pem, removing ...
I0305 01:50:38.249856 19549 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-6453/.minikube/cert.pem
I0305 01:50:38.249879 19549 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17909-6453/.minikube/cert.pem (1123 bytes)
I0305 01:50:38.249939 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17909-6453/.minikube/key.pem
I0305 01:50:38.249955 19549 exec_runner.go:144] found /home/jenkins/minikube-integration/17909-6453/.minikube/key.pem, removing ...
I0305 01:50:38.249959 19549 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17909-6453/.minikube/key.pem
I0305 01:50:38.249979 19549 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17909-6453/.minikube/key.pem (1679 bytes)
I0305 01:50:38.250035 19549 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17909-6453/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca-key.pem org=jenkins.functional-453214 san=[127.0.0.1 192.168.39.62 functional-453214 localhost minikube]
I0305 01:50:38.509908 19549 provision.go:177] copyRemoteCerts
I0305 01:50:38.509961 19549 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0305 01:50:38.509982 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:38.512509 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.512760 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:38.512796 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.512984 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:38.513187 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:38.513368 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:38.513522 19549 sshutil.go:53] new ssh client: &{IP:192.168.39.62 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-6453/.minikube/machines/functional-453214/id_rsa Username:docker}
I0305 01:50:38.604495 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0305 01:50:38.604567 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0305 01:50:38.635467 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0305 01:50:38.635533 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0305 01:50:38.662174 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/machines/server.pem -> /etc/docker/server.pem
I0305 01:50:38.662236 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0305 01:50:38.692321 19549 provision.go:87] duration metric: took 448.863621ms to configureAuth
I0305 01:50:38.692350 19549 buildroot.go:189] setting minikube options for container-runtime
I0305 01:50:38.692575 19549 config.go:182] Loaded profile config "functional-453214": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0305 01:50:38.692642 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:38.695368 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.695818 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:38.695846 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:38.695987 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:38.696199 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:38.696380 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:38.696547 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:38.696680 19549 main.go:141] libmachine: Using SSH client type: native
I0305 01:50:38.696854 19549 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.62 22 <nil> <nil>}
I0305 01:50:38.696875 19549 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0305 01:50:44.256069 19549 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0305 01:50:44.256094 19549 machine.go:97] duration metric: took 6.354877147s to provisionDockerMachine
I0305 01:50:44.256108 19549 start.go:293] postStartSetup for "functional-453214" (driver="kvm2")
I0305 01:50:44.256137 19549 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0305 01:50:44.256154 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:44.256449 19549 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0305 01:50:44.256483 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:44.259076 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.259470 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:44.259493 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.259663 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:44.259841 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:44.260020 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:44.260177 19549 sshutil.go:53] new ssh client: &{IP:192.168.39.62 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-6453/.minikube/machines/functional-453214/id_rsa Username:docker}
I0305 01:50:44.345657 19549 ssh_runner.go:195] Run: cat /etc/os-release
I0305 01:50:44.350432 19549 command_runner.go:130] > NAME=Buildroot
I0305 01:50:44.350448 19549 command_runner.go:130] > VERSION=2023.02.9-dirty
I0305 01:50:44.350455 19549 command_runner.go:130] > ID=buildroot
I0305 01:50:44.350464 19549 command_runner.go:130] > VERSION_ID=2023.02.9
I0305 01:50:44.350471 19549 command_runner.go:130] > PRETTY_NAME="Buildroot 2023.02.9"
I0305 01:50:44.350507 19549 info.go:137] Remote host: Buildroot 2023.02.9
I0305 01:50:44.350520 19549 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-6453/.minikube/addons for local assets ...
I0305 01:50:44.350583 19549 filesync.go:126] Scanning /home/jenkins/minikube-integration/17909-6453/.minikube/files for local assets ...
I0305 01:50:44.350684 19549 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/ssl/certs/136682.pem -> 136682.pem in /etc/ssl/certs
I0305 01:50:44.350694 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/ssl/certs/136682.pem -> /etc/ssl/certs/136682.pem
I0305 01:50:44.350777 19549 filesync.go:149] local asset: /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/test/nested/copy/13668/hosts -> hosts in /etc/test/nested/copy/13668
I0305 01:50:44.350784 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/test/nested/copy/13668/hosts -> /etc/test/nested/copy/13668/hosts
I0305 01:50:44.350834 19549 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs /etc/test/nested/copy/13668
I0305 01:50:44.361617 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/ssl/certs/136682.pem --> /etc/ssl/certs/136682.pem (1708 bytes)
I0305 01:50:44.387106 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/test/nested/copy/13668/hosts --> /etc/test/nested/copy/13668/hosts (40 bytes)
I0305 01:50:44.412357 19549 start.go:296] duration metric: took 156.236276ms for postStartSetup
I0305 01:50:44.412396 19549 fix.go:56] duration metric: took 6.530758617s for fixHost
I0305 01:50:44.412419 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:44.414901 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.415245 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:44.415276 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.415458 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:44.415610 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:44.415766 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:44.415902 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:44.416045 19549 main.go:141] libmachine: Using SSH client type: native
I0305 01:50:44.416191 19549 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil> [] 0s} 192.168.39.62 22 <nil> <nil>}
I0305 01:50:44.416200 19549 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0305 01:50:44.519680 19549 main.go:141] libmachine: SSH cmd err, output: <nil>: 1709603444.511434672
I0305 01:50:44.519700 19549 fix.go:216] guest clock: 1709603444.511434672
I0305 01:50:44.519706 19549 fix.go:229] Guest: 2024-03-05 01:50:44.511434672 +0000 UTC Remote: 2024-03-05 01:50:44.412400695 +0000 UTC m=+6.660150955 (delta=99.033977ms)
I0305 01:50:44.519722 19549 fix.go:200] guest clock delta is within tolerance: 99.033977ms
I0305 01:50:44.519727 19549 start.go:83] releasing machines lock for "functional-453214", held for 6.638103225s
I0305 01:50:44.519742 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:44.519963 19549 main.go:141] libmachine: (functional-453214) Calling .GetIP
I0305 01:50:44.522672 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.523059 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:44.523086 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.523237 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:44.523723 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:44.523892 19549 main.go:141] libmachine: (functional-453214) Calling .DriverName
I0305 01:50:44.523982 19549 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0305 01:50:44.524029 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:44.524079 19549 ssh_runner.go:195] Run: cat /version.json
I0305 01:50:44.524103 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHHostname
I0305 01:50:44.526353 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.526626 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:44.526649 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.526816 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:44.526822 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.526992 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:44.527161 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:50:44.527165 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:44.527190 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:50:44.527321 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHPort
I0305 01:50:44.527385 19549 sshutil.go:53] new ssh client: &{IP:192.168.39.62 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-6453/.minikube/machines/functional-453214/id_rsa Username:docker}
I0305 01:50:44.527486 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHKeyPath
I0305 01:50:44.527626 19549 main.go:141] libmachine: (functional-453214) Calling .GetSSHUsername
I0305 01:50:44.527752 19549 sshutil.go:53] new ssh client: &{IP:192.168.39.62 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17909-6453/.minikube/machines/functional-453214/id_rsa Username:docker}
I0305 01:50:44.603587 19549 command_runner.go:130] > {"iso_version": "v1.32.1-1708638130-18020", "kicbase_version": "v0.0.42-1708008208-17936", "minikube_version": "v1.32.0", "commit": "d80143d2abd5a004b09b48bbc118a104326900af"}
I0305 01:50:44.603717 19549 ssh_runner.go:195] Run: systemctl --version
I0305 01:50:44.691362 19549 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.
I0305 01:50:44.691453 19549 command_runner.go:130] > systemd 252 (252)
I0305 01:50:44.691488 19549 command_runner.go:130] > -PAM -AUDIT -SELINUX -APPARMOR -IMA -SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL -ELFUTILS -FIDO2 -IDN2 -IDN +IPTC +KMOD -LIBCRYPTSETUP +LIBFDISK -PCRE2 -PWQUALITY -P11KIT -QRENCODE -TPM2 -BZIP2 +LZ4 +XZ +ZLIB -ZSTD -BPF_FRAMEWORK -XKBCOMMON -UTMP -SYSVINIT default-hierarchy=unified
I0305 01:50:44.691558 19549 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0305 01:50:45.134690 19549 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0305 01:50:45.181405 19549 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory
W0305 01:50:45.181550 19549 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0305 01:50:45.181619 19549 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0305 01:50:45.286735 19549 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0305 01:50:45.286762 19549 start.go:494] detecting cgroup driver to use...
I0305 01:50:45.286849 19549 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0305 01:50:45.368992 19549 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0305 01:50:45.400016 19549 docker.go:217] disabling cri-docker service (if available) ...
I0305 01:50:45.400075 19549 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0305 01:50:45.436572 19549 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0305 01:50:45.489234 19549 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0305 01:50:45.831587 19549 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0305 01:50:46.049566 19549 docker.go:233] disabling docker service ...
I0305 01:50:46.049638 19549 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0305 01:50:46.071083 19549 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0305 01:50:46.085594 19549 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0305 01:50:46.309056 19549 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0305 01:50:46.543874 19549 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0305 01:50:46.562757 19549 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0305 01:50:46.590376 19549 command_runner.go:130] > runtime-endpoint: unix:///var/run/crio/crio.sock
I0305 01:50:46.593415 19549 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
I0305 01:50:46.593465 19549 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
I0305 01:50:46.607821 19549 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0305 01:50:46.607887 19549 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0305 01:50:46.620478 19549 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0305 01:50:46.633949 19549 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0305 01:50:46.653629 19549 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0305 01:50:46.667872 19549 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0305 01:50:46.679020 19549 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1
I0305 01:50:46.679332 19549 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0305 01:50:46.690667 19549 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0305 01:50:46.942123 19549 ssh_runner.go:195] Run: sudo systemctl restart crio
I0305 01:52:17.457991 19549 ssh_runner.go:235] Completed: sudo systemctl restart crio: (1m30.515831874s)
I0305 01:52:17.458035 19549 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock
I0305 01:52:17.458108 19549 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0305 01:52:17.464794 19549 command_runner.go:130] > File: /var/run/crio/crio.sock
I0305 01:52:17.464819 19549 command_runner.go:130] > Size: 0 Blocks: 0 IO Block: 4096 socket
I0305 01:52:17.464834 19549 command_runner.go:130] > Device: 0,22 Inode: 1660 Links: 1
I0305 01:52:17.464844 19549 command_runner.go:130] > Access: (0660/srw-rw----) Uid: ( 0/ root) Gid: ( 0/ root)
I0305 01:52:17.464852 19549 command_runner.go:130] > Access: 2024-03-05 01:52:17.318719892 +0000
I0305 01:52:17.464860 19549 command_runner.go:130] > Modify: 2024-03-05 01:52:17.318719892 +0000
I0305 01:52:17.464869 19549 command_runner.go:130] > Change: 2024-03-05 01:52:17.318719892 +0000
I0305 01:52:17.464879 19549 command_runner.go:130] > Birth: -
I0305 01:52:17.464960 19549 start.go:562] Will wait 60s for crictl version
I0305 01:52:17.465014 19549 ssh_runner.go:195] Run: which crictl
I0305 01:52:17.469733 19549 command_runner.go:130] > /usr/bin/crictl
I0305 01:52:17.469779 19549 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0305 01:52:17.522820 19549 command_runner.go:130] > Version: 0.1.0
I0305 01:52:17.522839 19549 command_runner.go:130] > RuntimeName: cri-o
I0305 01:52:17.522844 19549 command_runner.go:130] > RuntimeVersion: 1.29.1
I0305 01:52:17.522848 19549 command_runner.go:130] > RuntimeApiVersion: v1
I0305 01:52:17.522917 19549 start.go:578] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.29.1
RuntimeApiVersion: v1
I0305 01:52:17.522980 19549 ssh_runner.go:195] Run: crio --version
I0305 01:52:17.556867 19549 command_runner.go:130] > crio version 1.29.1
I0305 01:52:17.556885 19549 command_runner.go:130] > Version: 1.29.1
I0305 01:52:17.556891 19549 command_runner.go:130] > GitCommit: unknown
I0305 01:52:17.556894 19549 command_runner.go:130] > GitCommitDate: unknown
I0305 01:52:17.556904 19549 command_runner.go:130] > GitTreeState: clean
I0305 01:52:17.556909 19549 command_runner.go:130] > BuildDate: 2024-02-23T03:27:48Z
I0305 01:52:17.556913 19549 command_runner.go:130] > GoVersion: go1.21.6
I0305 01:52:17.556917 19549 command_runner.go:130] > Compiler: gc
I0305 01:52:17.556921 19549 command_runner.go:130] > Platform: linux/amd64
I0305 01:52:17.556925 19549 command_runner.go:130] > Linkmode: dynamic
I0305 01:52:17.556931 19549 command_runner.go:130] > BuildTags:
I0305 01:52:17.556935 19549 command_runner.go:130] > containers_image_ostree_stub
I0305 01:52:17.556940 19549 command_runner.go:130] > exclude_graphdriver_btrfs
I0305 01:52:17.556943 19549 command_runner.go:130] > btrfs_noversion
I0305 01:52:17.556946 19549 command_runner.go:130] > exclude_graphdriver_devicemapper
I0305 01:52:17.556950 19549 command_runner.go:130] > libdm_no_deferred_remove
I0305 01:52:17.556954 19549 command_runner.go:130] > seccomp
I0305 01:52:17.556958 19549 command_runner.go:130] > LDFlags: unknown
I0305 01:52:17.556962 19549 command_runner.go:130] > SeccompEnabled: true
I0305 01:52:17.556969 19549 command_runner.go:130] > AppArmorEnabled: false
I0305 01:52:17.557047 19549 ssh_runner.go:195] Run: crio --version
I0305 01:52:17.587472 19549 command_runner.go:130] > crio version 1.29.1
I0305 01:52:17.587493 19549 command_runner.go:130] > Version: 1.29.1
I0305 01:52:17.587500 19549 command_runner.go:130] > GitCommit: unknown
I0305 01:52:17.587504 19549 command_runner.go:130] > GitCommitDate: unknown
I0305 01:52:17.587508 19549 command_runner.go:130] > GitTreeState: clean
I0305 01:52:17.587513 19549 command_runner.go:130] > BuildDate: 2024-02-23T03:27:48Z
I0305 01:52:17.587518 19549 command_runner.go:130] > GoVersion: go1.21.6
I0305 01:52:17.587521 19549 command_runner.go:130] > Compiler: gc
I0305 01:52:17.587526 19549 command_runner.go:130] > Platform: linux/amd64
I0305 01:52:17.587531 19549 command_runner.go:130] > Linkmode: dynamic
I0305 01:52:17.587559 19549 command_runner.go:130] > BuildTags:
I0305 01:52:17.587567 19549 command_runner.go:130] > containers_image_ostree_stub
I0305 01:52:17.587586 19549 command_runner.go:130] > exclude_graphdriver_btrfs
I0305 01:52:17.587590 19549 command_runner.go:130] > btrfs_noversion
I0305 01:52:17.587594 19549 command_runner.go:130] > exclude_graphdriver_devicemapper
I0305 01:52:17.587601 19549 command_runner.go:130] > libdm_no_deferred_remove
I0305 01:52:17.587604 19549 command_runner.go:130] > seccomp
I0305 01:52:17.587608 19549 command_runner.go:130] > LDFlags: unknown
I0305 01:52:17.587612 19549 command_runner.go:130] > SeccompEnabled: true
I0305 01:52:17.587619 19549 command_runner.go:130] > AppArmorEnabled: false
I0305 01:52:17.591508 19549 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.29.1 ...
I0305 01:52:17.592747 19549 main.go:141] libmachine: (functional-453214) Calling .GetIP
I0305 01:52:17.595353 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:52:17.595686 19549 main.go:141] libmachine: (functional-453214) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ad:a4:89", ip: ""} in network mk-functional-453214: {Iface:virbr1 ExpiryTime:2024-03-05 02:49:12 +0000 UTC Type:0 Mac:52:54:00:ad:a4:89 Iaid: IPaddr:192.168.39.62 Prefix:24 Hostname:functional-453214 Clientid:01:52:54:00:ad:a4:89}
I0305 01:52:17.595713 19549 main.go:141] libmachine: (functional-453214) DBG | domain functional-453214 has defined IP address 192.168.39.62 and MAC address 52:54:00:ad:a4:89 in network mk-functional-453214
I0305 01:52:17.595868 19549 ssh_runner.go:195] Run: grep 192.168.39.1 host.minikube.internal$ /etc/hosts
I0305 01:52:17.600720 19549 command_runner.go:130] > 192.168.39.1 host.minikube.internal
I0305 01:52:17.600822 19549 kubeadm.go:877] updating cluster {Name:functional-453214 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1
.28.4 ClusterName:functional-453214 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.62 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0305 01:52:17.600951 19549 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
I0305 01:52:17.601017 19549 ssh_runner.go:195] Run: sudo crictl images --output json
I0305 01:52:17.645481 19549 command_runner.go:130] > {
I0305 01:52:17.645510 19549 command_runner.go:130] > "images": [
I0305 01:52:17.645516 19549 command_runner.go:130] > {
I0305 01:52:17.645528 19549 command_runner.go:130] > "id": "c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc",
I0305 01:52:17.645536 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.645546 19549 command_runner.go:130] > "docker.io/kindest/kindnetd:v20230809-80a64d96"
I0305 01:52:17.645554 19549 command_runner.go:130] > ],
I0305 01:52:17.645562 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.645578 19549 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052",
I0305 01:52:17.645590 19549 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:a315b9c49a50d5e126e1b5fa5ef0eae2a9b367c9c4f868e897d772b142372bb4"
I0305 01:52:17.645598 19549 command_runner.go:130] > ],
I0305 01:52:17.645605 19549 command_runner.go:130] > "size": "65258016",
I0305 01:52:17.645615 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.645625 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.645642 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.645652 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.645660 19549 command_runner.go:130] > },
I0305 01:52:17.645666 19549 command_runner.go:130] > {
I0305 01:52:17.645677 19549 command_runner.go:130] > "id": "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562",
I0305 01:52:17.645687 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.645710 19549 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner:v5"
I0305 01:52:17.645720 19549 command_runner.go:130] > ],
I0305 01:52:17.645727 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.645738 19549 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944",
I0305 01:52:17.645751 19549 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f"
I0305 01:52:17.645759 19549 command_runner.go:130] > ],
I0305 01:52:17.645769 19549 command_runner.go:130] > "size": "31470524",
I0305 01:52:17.645779 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.645796 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.645805 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.645811 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.645816 19549 command_runner.go:130] > },
I0305 01:52:17.645822 19549 command_runner.go:130] > {
I0305 01:52:17.645828 19549 command_runner.go:130] > "id": "ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc",
I0305 01:52:17.645834 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.645840 19549 command_runner.go:130] > "registry.k8s.io/coredns/coredns:v1.10.1"
I0305 01:52:17.645846 19549 command_runner.go:130] > ],
I0305 01:52:17.645851 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.645861 19549 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e",
I0305 01:52:17.645870 19549 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:be7652ce0b43b1339f3d14d9b14af9f588578011092c1f7893bd55432d83a378"
I0305 01:52:17.645876 19549 command_runner.go:130] > ],
I0305 01:52:17.645880 19549 command_runner.go:130] > "size": "53621675",
I0305 01:52:17.645886 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.645890 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.645896 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.645899 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.645903 19549 command_runner.go:130] > },
I0305 01:52:17.645906 19549 command_runner.go:130] > {
I0305 01:52:17.645915 19549 command_runner.go:130] > "id": "73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9",
I0305 01:52:17.645921 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.645926 19549 command_runner.go:130] > "registry.k8s.io/etcd:3.5.9-0"
I0305 01:52:17.645932 19549 command_runner.go:130] > ],
I0305 01:52:17.645936 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.645945 19549 command_runner.go:130] > "registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15",
I0305 01:52:17.645953 19549 command_runner.go:130] > "registry.k8s.io/etcd@sha256:e013d0d5e4e25d00c61a7ff839927a1f36479678f11e49502b53a5e0b14f10c3"
I0305 01:52:17.645965 19549 command_runner.go:130] > ],
I0305 01:52:17.645976 19549 command_runner.go:130] > "size": "295456551",
I0305 01:52:17.645982 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.645986 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.645989 19549 command_runner.go:130] > },
I0305 01:52:17.645995 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.646000 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.646006 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.646009 19549 command_runner.go:130] > },
I0305 01:52:17.646015 19549 command_runner.go:130] > {
I0305 01:52:17.646022 19549 command_runner.go:130] > "id": "7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257",
I0305 01:52:17.646028 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.646033 19549 command_runner.go:130] > "registry.k8s.io/kube-apiserver:v1.28.4"
I0305 01:52:17.646038 19549 command_runner.go:130] > ],
I0305 01:52:17.646042 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.646052 19549 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499",
I0305 01:52:17.646061 19549 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:5b28a364467cf7e134343bb3ee2c6d40682b473a743a72142c7bbe25767d36eb"
I0305 01:52:17.646066 19549 command_runner.go:130] > ],
I0305 01:52:17.646070 19549 command_runner.go:130] > "size": "127226832",
I0305 01:52:17.646074 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.646081 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.646084 19549 command_runner.go:130] > },
I0305 01:52:17.646090 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.646094 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.646100 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.646104 19549 command_runner.go:130] > },
I0305 01:52:17.646109 19549 command_runner.go:130] > {
I0305 01:52:17.646115 19549 command_runner.go:130] > "id": "d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591",
I0305 01:52:17.646121 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.646126 19549 command_runner.go:130] > "registry.k8s.io/kube-controller-manager:v1.28.4"
I0305 01:52:17.646132 19549 command_runner.go:130] > ],
I0305 01:52:17.646136 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.646145 19549 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c",
I0305 01:52:17.646154 19549 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:c173b92b1ac1ac50de36a9d8d3af6377cbb7bbd930f42d4332cbaea521c57232"
I0305 01:52:17.646168 19549 command_runner.go:130] > ],
I0305 01:52:17.646179 19549 command_runner.go:130] > "size": "123261750",
I0305 01:52:17.646188 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.646200 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.646206 19549 command_runner.go:130] > },
I0305 01:52:17.646210 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.646216 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.646224 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.646237 19549 command_runner.go:130] > },
I0305 01:52:17.646243 19549 command_runner.go:130] > {
I0305 01:52:17.646249 19549 command_runner.go:130] > "id": "83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e",
I0305 01:52:17.646256 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.646261 19549 command_runner.go:130] > "registry.k8s.io/kube-proxy:v1.28.4"
I0305 01:52:17.646270 19549 command_runner.go:130] > ],
I0305 01:52:17.646276 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.646285 19549 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e",
I0305 01:52:17.646295 19549 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:e63408a0f5068a7e9d4b34fd72b4a2b0e5512509b53cd2123a37fc991b0ef532"
I0305 01:52:17.646300 19549 command_runner.go:130] > ],
I0305 01:52:17.646305 19549 command_runner.go:130] > "size": "74749335",
I0305 01:52:17.646310 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.646314 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.646320 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.646324 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.646329 19549 command_runner.go:130] > },
I0305 01:52:17.646332 19549 command_runner.go:130] > {
I0305 01:52:17.646338 19549 command_runner.go:130] > "id": "e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1",
I0305 01:52:17.646344 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.646349 19549 command_runner.go:130] > "registry.k8s.io/kube-scheduler:v1.28.4"
I0305 01:52:17.646355 19549 command_runner.go:130] > ],
I0305 01:52:17.646359 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.646381 19549 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba",
I0305 01:52:17.646390 19549 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:d994c8a78e8cb1ec189fabfd258ff002cccdeb63678fad08ec0fba32298ffe32"
I0305 01:52:17.646396 19549 command_runner.go:130] > ],
I0305 01:52:17.646400 19549 command_runner.go:130] > "size": "61551410",
I0305 01:52:17.646406 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.646409 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.646415 19549 command_runner.go:130] > },
I0305 01:52:17.646419 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.646423 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.646433 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.646438 19549 command_runner.go:130] > },
I0305 01:52:17.646441 19549 command_runner.go:130] > {
I0305 01:52:17.646450 19549 command_runner.go:130] > "id": "e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c",
I0305 01:52:17.646454 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.646458 19549 command_runner.go:130] > "registry.k8s.io/pause:3.9"
I0305 01:52:17.646464 19549 command_runner.go:130] > ],
I0305 01:52:17.646468 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.646477 19549 command_runner.go:130] > "registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097",
I0305 01:52:17.646486 19549 command_runner.go:130] > "registry.k8s.io/pause@sha256:8d4106c88ec0bd28001e34c975d65175d994072d65341f62a8ab0754b0fafe10"
I0305 01:52:17.646491 19549 command_runner.go:130] > ],
I0305 01:52:17.646495 19549 command_runner.go:130] > "size": "750414",
I0305 01:52:17.646502 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.646508 19549 command_runner.go:130] > "value": "65535"
I0305 01:52:17.646516 19549 command_runner.go:130] > },
I0305 01:52:17.646525 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.646537 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.646546 19549 command_runner.go:130] > "pinned": true
I0305 01:52:17.646554 19549 command_runner.go:130] > }
I0305 01:52:17.646560 19549 command_runner.go:130] > ]
I0305 01:52:17.646568 19549 command_runner.go:130] > }
I0305 01:52:17.646726 19549 crio.go:496] all images are preloaded for cri-o runtime.
I0305 01:52:17.646739 19549 crio.go:415] Images already preloaded, skipping extraction
I0305 01:52:17.646787 19549 ssh_runner.go:195] Run: sudo crictl images --output json
I0305 01:52:17.683548 19549 command_runner.go:130] > {
I0305 01:52:17.683564 19549 command_runner.go:130] > "images": [
I0305 01:52:17.683568 19549 command_runner.go:130] > {
I0305 01:52:17.683575 19549 command_runner.go:130] > "id": "c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc",
I0305 01:52:17.683580 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.683585 19549 command_runner.go:130] > "docker.io/kindest/kindnetd:v20230809-80a64d96"
I0305 01:52:17.683588 19549 command_runner.go:130] > ],
I0305 01:52:17.683592 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.683600 19549 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052",
I0305 01:52:17.683611 19549 command_runner.go:130] > "docker.io/kindest/kindnetd@sha256:a315b9c49a50d5e126e1b5fa5ef0eae2a9b367c9c4f868e897d772b142372bb4"
I0305 01:52:17.683614 19549 command_runner.go:130] > ],
I0305 01:52:17.683619 19549 command_runner.go:130] > "size": "65258016",
I0305 01:52:17.683622 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.683626 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.683633 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.683637 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.683640 19549 command_runner.go:130] > },
I0305 01:52:17.683644 19549 command_runner.go:130] > {
I0305 01:52:17.683650 19549 command_runner.go:130] > "id": "6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562",
I0305 01:52:17.683654 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.683660 19549 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner:v5"
I0305 01:52:17.683665 19549 command_runner.go:130] > ],
I0305 01:52:17.683678 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.683690 19549 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944",
I0305 01:52:17.683697 19549 command_runner.go:130] > "gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f"
I0305 01:52:17.683700 19549 command_runner.go:130] > ],
I0305 01:52:17.683707 19549 command_runner.go:130] > "size": "31470524",
I0305 01:52:17.683711 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.683716 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.683722 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.683728 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.683733 19549 command_runner.go:130] > },
I0305 01:52:17.683738 19549 command_runner.go:130] > {
I0305 01:52:17.683751 19549 command_runner.go:130] > "id": "ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc",
I0305 01:52:17.683758 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.683767 19549 command_runner.go:130] > "registry.k8s.io/coredns/coredns:v1.10.1"
I0305 01:52:17.683770 19549 command_runner.go:130] > ],
I0305 01:52:17.683774 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.683782 19549 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e",
I0305 01:52:17.683802 19549 command_runner.go:130] > "registry.k8s.io/coredns/coredns@sha256:be7652ce0b43b1339f3d14d9b14af9f588578011092c1f7893bd55432d83a378"
I0305 01:52:17.683812 19549 command_runner.go:130] > ],
I0305 01:52:17.683821 19549 command_runner.go:130] > "size": "53621675",
I0305 01:52:17.683827 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.683837 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.683843 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.683864 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.683873 19549 command_runner.go:130] > },
I0305 01:52:17.683883 19549 command_runner.go:130] > {
I0305 01:52:17.683891 19549 command_runner.go:130] > "id": "73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9",
I0305 01:52:17.683895 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.683903 19549 command_runner.go:130] > "registry.k8s.io/etcd:3.5.9-0"
I0305 01:52:17.683908 19549 command_runner.go:130] > ],
I0305 01:52:17.683912 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.683921 19549 command_runner.go:130] > "registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15",
I0305 01:52:17.683927 19549 command_runner.go:130] > "registry.k8s.io/etcd@sha256:e013d0d5e4e25d00c61a7ff839927a1f36479678f11e49502b53a5e0b14f10c3"
I0305 01:52:17.683941 19549 command_runner.go:130] > ],
I0305 01:52:17.683947 19549 command_runner.go:130] > "size": "295456551",
I0305 01:52:17.683951 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.683957 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.683960 19549 command_runner.go:130] > },
I0305 01:52:17.683966 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.683971 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.683977 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.683980 19549 command_runner.go:130] > },
I0305 01:52:17.683986 19549 command_runner.go:130] > {
I0305 01:52:17.683992 19549 command_runner.go:130] > "id": "7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257",
I0305 01:52:17.683999 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.684004 19549 command_runner.go:130] > "registry.k8s.io/kube-apiserver:v1.28.4"
I0305 01:52:17.684009 19549 command_runner.go:130] > ],
I0305 01:52:17.684014 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.684023 19549 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499",
I0305 01:52:17.684030 19549 command_runner.go:130] > "registry.k8s.io/kube-apiserver@sha256:5b28a364467cf7e134343bb3ee2c6d40682b473a743a72142c7bbe25767d36eb"
I0305 01:52:17.684035 19549 command_runner.go:130] > ],
I0305 01:52:17.684039 19549 command_runner.go:130] > "size": "127226832",
I0305 01:52:17.684045 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.684049 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.684054 19549 command_runner.go:130] > },
I0305 01:52:17.684058 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.684065 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.684069 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.684075 19549 command_runner.go:130] > },
I0305 01:52:17.684083 19549 command_runner.go:130] > {
I0305 01:52:17.684092 19549 command_runner.go:130] > "id": "d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591",
I0305 01:52:17.684098 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.684103 19549 command_runner.go:130] > "registry.k8s.io/kube-controller-manager:v1.28.4"
I0305 01:52:17.684111 19549 command_runner.go:130] > ],
I0305 01:52:17.684115 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.684125 19549 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c",
I0305 01:52:17.684134 19549 command_runner.go:130] > "registry.k8s.io/kube-controller-manager@sha256:c173b92b1ac1ac50de36a9d8d3af6377cbb7bbd930f42d4332cbaea521c57232"
I0305 01:52:17.684140 19549 command_runner.go:130] > ],
I0305 01:52:17.684144 19549 command_runner.go:130] > "size": "123261750",
I0305 01:52:17.684149 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.684153 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.684158 19549 command_runner.go:130] > },
I0305 01:52:17.684162 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.684168 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.684172 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.684177 19549 command_runner.go:130] > },
I0305 01:52:17.684181 19549 command_runner.go:130] > {
I0305 01:52:17.684187 19549 command_runner.go:130] > "id": "83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e",
I0305 01:52:17.684193 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.684198 19549 command_runner.go:130] > "registry.k8s.io/kube-proxy:v1.28.4"
I0305 01:52:17.684203 19549 command_runner.go:130] > ],
I0305 01:52:17.684207 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.684216 19549 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e",
I0305 01:52:17.684225 19549 command_runner.go:130] > "registry.k8s.io/kube-proxy@sha256:e63408a0f5068a7e9d4b34fd72b4a2b0e5512509b53cd2123a37fc991b0ef532"
I0305 01:52:17.684231 19549 command_runner.go:130] > ],
I0305 01:52:17.684235 19549 command_runner.go:130] > "size": "74749335",
I0305 01:52:17.684242 19549 command_runner.go:130] > "uid": null,
I0305 01:52:17.684245 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.684252 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.684255 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.684261 19549 command_runner.go:130] > },
I0305 01:52:17.684264 19549 command_runner.go:130] > {
I0305 01:52:17.684272 19549 command_runner.go:130] > "id": "e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1",
I0305 01:52:17.684277 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.684281 19549 command_runner.go:130] > "registry.k8s.io/kube-scheduler:v1.28.4"
I0305 01:52:17.684291 19549 command_runner.go:130] > ],
I0305 01:52:17.684298 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.684316 19549 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba",
I0305 01:52:17.684325 19549 command_runner.go:130] > "registry.k8s.io/kube-scheduler@sha256:d994c8a78e8cb1ec189fabfd258ff002cccdeb63678fad08ec0fba32298ffe32"
I0305 01:52:17.684331 19549 command_runner.go:130] > ],
I0305 01:52:17.684335 19549 command_runner.go:130] > "size": "61551410",
I0305 01:52:17.684341 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.684345 19549 command_runner.go:130] > "value": "0"
I0305 01:52:17.684350 19549 command_runner.go:130] > },
I0305 01:52:17.684354 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.684360 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.684364 19549 command_runner.go:130] > "pinned": false
I0305 01:52:17.684368 19549 command_runner.go:130] > },
I0305 01:52:17.684371 19549 command_runner.go:130] > {
I0305 01:52:17.684377 19549 command_runner.go:130] > "id": "e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c",
I0305 01:52:17.684385 19549 command_runner.go:130] > "repoTags": [
I0305 01:52:17.684392 19549 command_runner.go:130] > "registry.k8s.io/pause:3.9"
I0305 01:52:17.684396 19549 command_runner.go:130] > ],
I0305 01:52:17.684402 19549 command_runner.go:130] > "repoDigests": [
I0305 01:52:17.684408 19549 command_runner.go:130] > "registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097",
I0305 01:52:17.684417 19549 command_runner.go:130] > "registry.k8s.io/pause@sha256:8d4106c88ec0bd28001e34c975d65175d994072d65341f62a8ab0754b0fafe10"
I0305 01:52:17.684422 19549 command_runner.go:130] > ],
I0305 01:52:17.684426 19549 command_runner.go:130] > "size": "750414",
I0305 01:52:17.684432 19549 command_runner.go:130] > "uid": {
I0305 01:52:17.684436 19549 command_runner.go:130] > "value": "65535"
I0305 01:52:17.684441 19549 command_runner.go:130] > },
I0305 01:52:17.684445 19549 command_runner.go:130] > "username": "",
I0305 01:52:17.684449 19549 command_runner.go:130] > "spec": null,
I0305 01:52:17.684455 19549 command_runner.go:130] > "pinned": true
I0305 01:52:17.684458 19549 command_runner.go:130] > }
I0305 01:52:17.684462 19549 command_runner.go:130] > ]
I0305 01:52:17.684465 19549 command_runner.go:130] > }
I0305 01:52:17.684572 19549 crio.go:496] all images are preloaded for cri-o runtime.
I0305 01:52:17.684583 19549 cache_images.go:84] Images are preloaded, skipping loading
I0305 01:52:17.684589 19549 kubeadm.go:928] updating node { 192.168.39.62 8441 v1.28.4 crio true true} ...
I0305 01:52:17.684695 19549 kubeadm.go:940] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=functional-453214 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.62
[Install]
config:
{KubernetesVersion:v1.28.4 ClusterName:functional-453214 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0305 01:52:17.684758 19549 ssh_runner.go:195] Run: crio config
I0305 01:52:17.728968 19549 command_runner.go:130] > # The CRI-O configuration file specifies all of the available configuration
I0305 01:52:17.729000 19549 command_runner.go:130] > # options and command-line flags for the crio(8) OCI Kubernetes Container Runtime
I0305 01:52:17.729012 19549 command_runner.go:130] > # daemon, but in a TOML format that can be more easily modified and versioned.
I0305 01:52:17.729016 19549 command_runner.go:130] > #
I0305 01:52:17.729031 19549 command_runner.go:130] > # Please refer to crio.conf(5) for details of all configuration options.
I0305 01:52:17.729041 19549 command_runner.go:130] > # CRI-O supports partial configuration reload during runtime, which can be
I0305 01:52:17.729053 19549 command_runner.go:130] > # done by sending SIGHUP to the running process. Currently supported options
I0305 01:52:17.729062 19549 command_runner.go:130] > # are explicitly mentioned with: 'This option supports live configuration
I0305 01:52:17.729070 19549 command_runner.go:130] > # reload'.
I0305 01:52:17.729080 19549 command_runner.go:130] > # CRI-O reads its storage defaults from the containers-storage.conf(5) file
I0305 01:52:17.729091 19549 command_runner.go:130] > # located at /etc/containers/storage.conf. Modify this storage configuration if
I0305 01:52:17.729101 19549 command_runner.go:130] > # you want to change the system's defaults. If you want to modify storage just
I0305 01:52:17.729118 19549 command_runner.go:130] > # for CRI-O, you can change the storage configuration options here.
I0305 01:52:17.729126 19549 command_runner.go:130] > [crio]
I0305 01:52:17.729134 19549 command_runner.go:130] > # Path to the "root directory". CRI-O stores all of its data, including
I0305 01:52:17.729142 19549 command_runner.go:130] > # containers images, in this directory.
I0305 01:52:17.729146 19549 command_runner.go:130] > root = "/var/lib/containers/storage"
I0305 01:52:17.729158 19549 command_runner.go:130] > # Path to the "run directory". CRI-O stores all of its state in this directory.
I0305 01:52:17.729165 19549 command_runner.go:130] > runroot = "/var/run/containers/storage"
I0305 01:52:17.729173 19549 command_runner.go:130] > # Path to the "imagestore". If CRI-O stores all of its images in this directory differently than Root.
I0305 01:52:17.729179 19549 command_runner.go:130] > # imagestore = ""
I0305 01:52:17.729185 19549 command_runner.go:130] > # Storage driver used to manage the storage of images and containers. Please
I0305 01:52:17.729192 19549 command_runner.go:130] > # refer to containers-storage.conf(5) to see all available storage drivers.
I0305 01:52:17.729197 19549 command_runner.go:130] > storage_driver = "overlay"
I0305 01:52:17.729208 19549 command_runner.go:130] > # List to pass options to the storage driver. Please refer to
I0305 01:52:17.729228 19549 command_runner.go:130] > # containers-storage.conf(5) to see all available storage options.
I0305 01:52:17.729239 19549 command_runner.go:130] > storage_option = [
I0305 01:52:17.729250 19549 command_runner.go:130] > "overlay.mountopt=nodev,metacopy=on",
I0305 01:52:17.729255 19549 command_runner.go:130] > ]
I0305 01:52:17.729272 19549 command_runner.go:130] > # The default log directory where all logs will go unless directly specified by
I0305 01:52:17.729289 19549 command_runner.go:130] > # the kubelet. The log directory specified must be an absolute directory.
I0305 01:52:17.729301 19549 command_runner.go:130] > # log_dir = "/var/log/crio/pods"
I0305 01:52:17.729311 19549 command_runner.go:130] > # Location for CRI-O to lay down the temporary version file.
I0305 01:52:17.729323 19549 command_runner.go:130] > # It is used to check if crio wipe should wipe containers, which should
I0305 01:52:17.729338 19549 command_runner.go:130] > # always happen on a node reboot
I0305 01:52:17.729348 19549 command_runner.go:130] > # version_file = "/var/run/crio/version"
I0305 01:52:17.729368 19549 command_runner.go:130] > # Location for CRI-O to lay down the persistent version file.
I0305 01:52:17.729382 19549 command_runner.go:130] > # It is used to check if crio wipe should wipe images, which should
I0305 01:52:17.729391 19549 command_runner.go:130] > # only happen when CRI-O has been upgraded
I0305 01:52:17.729401 19549 command_runner.go:130] > version_file_persist = "/var/lib/crio/version"
I0305 01:52:17.729414 19549 command_runner.go:130] > # InternalWipe is whether CRI-O should wipe containers and images after a reboot when the server starts.
I0305 01:52:17.729429 19549 command_runner.go:130] > # If set to false, one must use the external command 'crio wipe' to wipe the containers and images in these situations.
I0305 01:52:17.729442 19549 command_runner.go:130] > # internal_wipe = true
I0305 01:52:17.729462 19549 command_runner.go:130] > # InternalRepair is whether CRI-O should check if the container and image storage was corrupted after a sudden restart.
I0305 01:52:17.729476 19549 command_runner.go:130] > # If it was, CRI-O also attempts to repair the storage.
I0305 01:52:17.729486 19549 command_runner.go:130] > # internal_repair = false
I0305 01:52:17.729492 19549 command_runner.go:130] > # Location for CRI-O to lay down the clean shutdown file.
I0305 01:52:17.729498 19549 command_runner.go:130] > # It is used to check whether crio had time to sync before shutting down.
I0305 01:52:17.729504 19549 command_runner.go:130] > # If not found, crio wipe will clear the storage directory.
I0305 01:52:17.729513 19549 command_runner.go:130] > # clean_shutdown_file = "/var/lib/crio/clean.shutdown"
I0305 01:52:17.729521 19549 command_runner.go:130] > # The crio.api table contains settings for the kubelet/gRPC interface.
I0305 01:52:17.729525 19549 command_runner.go:130] > [crio.api]
I0305 01:52:17.729530 19549 command_runner.go:130] > # Path to AF_LOCAL socket on which CRI-O will listen.
I0305 01:52:17.729537 19549 command_runner.go:130] > # listen = "/var/run/crio/crio.sock"
I0305 01:52:17.729542 19549 command_runner.go:130] > # IP address on which the stream server will listen.
I0305 01:52:17.729547 19549 command_runner.go:130] > # stream_address = "127.0.0.1"
I0305 01:52:17.729553 19549 command_runner.go:130] > # The port on which the stream server will listen. If the port is set to "0", then
I0305 01:52:17.729560 19549 command_runner.go:130] > # CRI-O will allocate a random free port number.
I0305 01:52:17.729565 19549 command_runner.go:130] > # stream_port = "0"
I0305 01:52:17.729577 19549 command_runner.go:130] > # Enable encrypted TLS transport of the stream server.
I0305 01:52:17.729593 19549 command_runner.go:130] > # stream_enable_tls = false
I0305 01:52:17.729606 19549 command_runner.go:130] > # Length of time until open streams terminate due to lack of activity
I0305 01:52:17.729616 19549 command_runner.go:130] > # stream_idle_timeout = ""
I0305 01:52:17.729626 19549 command_runner.go:130] > # Path to the x509 certificate file used to serve the encrypted stream. This
I0305 01:52:17.729639 19549 command_runner.go:130] > # file can change, and CRI-O will automatically pick up the changes within 5
I0305 01:52:17.729650 19549 command_runner.go:130] > # minutes.
I0305 01:52:17.729656 19549 command_runner.go:130] > # stream_tls_cert = ""
I0305 01:52:17.729662 19549 command_runner.go:130] > # Path to the key file used to serve the encrypted stream. This file can
I0305 01:52:17.729670 19549 command_runner.go:130] > # change and CRI-O will automatically pick up the changes within 5 minutes.
I0305 01:52:17.729676 19549 command_runner.go:130] > # stream_tls_key = ""
I0305 01:52:17.729687 19549 command_runner.go:130] > # Path to the x509 CA(s) file used to verify and authenticate client
I0305 01:52:17.729695 19549 command_runner.go:130] > # communication with the encrypted stream. This file can change and CRI-O will
I0305 01:52:17.729711 19549 command_runner.go:130] > # automatically pick up the changes within 5 minutes.
I0305 01:52:17.729717 19549 command_runner.go:130] > # stream_tls_ca = ""
I0305 01:52:17.729726 19549 command_runner.go:130] > # Maximum grpc send message size in bytes. If not set or <=0, then CRI-O will default to 80 * 1024 * 1024.
I0305 01:52:17.729733 19549 command_runner.go:130] > grpc_max_send_msg_size = 16777216
I0305 01:52:17.729744 19549 command_runner.go:130] > # Maximum grpc receive message size. If not set or <= 0, then CRI-O will default to 80 * 1024 * 1024.
I0305 01:52:17.729755 19549 command_runner.go:130] > grpc_max_recv_msg_size = 16777216
I0305 01:52:17.729768 19549 command_runner.go:130] > # The crio.runtime table contains settings pertaining to the OCI runtime used
I0305 01:52:17.729780 19549 command_runner.go:130] > # and options for how to set up and manage the OCI runtime.
I0305 01:52:17.729789 19549 command_runner.go:130] > [crio.runtime]
I0305 01:52:17.729798 19549 command_runner.go:130] > # A list of ulimits to be set in containers by default, specified as
I0305 01:52:17.729810 19549 command_runner.go:130] > # "<ulimit name>=<soft limit>:<hard limit>", for example:
I0305 01:52:17.729817 19549 command_runner.go:130] > # "nofile=1024:2048"
I0305 01:52:17.729823 19549 command_runner.go:130] > # If nothing is set here, settings will be inherited from the CRI-O daemon
I0305 01:52:17.729829 19549 command_runner.go:130] > # default_ulimits = [
I0305 01:52:17.729832 19549 command_runner.go:130] > # ]
I0305 01:52:17.729838 19549 command_runner.go:130] > # If true, the runtime will not use pivot_root, but instead use MS_MOVE.
I0305 01:52:17.729846 19549 command_runner.go:130] > # no_pivot = false
I0305 01:52:17.729852 19549 command_runner.go:130] > # decryption_keys_path is the path where the keys required for
I0305 01:52:17.729857 19549 command_runner.go:130] > # image decryption are stored. This option supports live configuration reload.
I0305 01:52:17.729865 19549 command_runner.go:130] > # decryption_keys_path = "/etc/crio/keys/"
I0305 01:52:17.729875 19549 command_runner.go:130] > # Path to the conmon binary, used for monitoring the OCI runtime.
I0305 01:52:17.729886 19549 command_runner.go:130] > # Will be searched for using $PATH if empty.
I0305 01:52:17.729899 19549 command_runner.go:130] > # This option is currently deprecated, and will be replaced with RuntimeHandler.MonitorEnv.
I0305 01:52:17.729911 19549 command_runner.go:130] > conmon = "/usr/libexec/crio/conmon"
I0305 01:52:17.729921 19549 command_runner.go:130] > # Cgroup setting for conmon
I0305 01:52:17.729932 19549 command_runner.go:130] > # This option is currently deprecated, and will be replaced with RuntimeHandler.MonitorCgroup.
I0305 01:52:17.729940 19549 command_runner.go:130] > conmon_cgroup = "pod"
I0305 01:52:17.729950 19549 command_runner.go:130] > # Environment variable list for the conmon process, used for passing necessary
I0305 01:52:17.729962 19549 command_runner.go:130] > # environment variables to conmon or the runtime.
I0305 01:52:17.729976 19549 command_runner.go:130] > # This option is currently deprecated, and will be replaced with RuntimeHandler.MonitorEnv.
I0305 01:52:17.729985 19549 command_runner.go:130] > conmon_env = [
I0305 01:52:17.730000 19549 command_runner.go:130] > "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
I0305 01:52:17.730008 19549 command_runner.go:130] > ]
I0305 01:52:17.730017 19549 command_runner.go:130] > # Additional environment variables to set for all the
I0305 01:52:17.730038 19549 command_runner.go:130] > # containers. These are overridden if set in the
I0305 01:52:17.730051 19549 command_runner.go:130] > # container image spec or in the container runtime configuration.
I0305 01:52:17.730060 19549 command_runner.go:130] > # default_env = [
I0305 01:52:17.730063 19549 command_runner.go:130] > # ]
I0305 01:52:17.730069 19549 command_runner.go:130] > # If true, SELinux will be used for pod separation on the host.
I0305 01:52:17.730083 19549 command_runner.go:130] > # This option is deprecated, and be interpreted from whether SELinux is enabled on the host in the future.
I0305 01:52:17.730095 19549 command_runner.go:130] > # selinux = false
I0305 01:52:17.730104 19549 command_runner.go:130] > # Path to the seccomp.json profile which is used as the default seccomp profile
I0305 01:52:17.730118 19549 command_runner.go:130] > # for the runtime. If not specified, then the internal default seccomp profile
I0305 01:52:17.730130 19549 command_runner.go:130] > # will be used. This option supports live configuration reload.
I0305 01:52:17.730139 19549 command_runner.go:130] > # seccomp_profile = ""
I0305 01:52:17.730151 19549 command_runner.go:130] > # Changes the meaning of an empty seccomp profile. By default
I0305 01:52:17.730173 19549 command_runner.go:130] > # (and according to CRI spec), an empty profile means unconfined.
I0305 01:52:17.730186 19549 command_runner.go:130] > # This option tells CRI-O to treat an empty profile as the default profile,
I0305 01:52:17.730197 19549 command_runner.go:130] > # which might increase security.
I0305 01:52:17.730208 19549 command_runner.go:130] > # This option is currently deprecated,
I0305 01:52:17.730218 19549 command_runner.go:130] > # and will be replaced by the SeccompDefault FeatureGate in Kubernetes.
I0305 01:52:17.730243 19549 command_runner.go:130] > seccomp_use_default_when_empty = false
I0305 01:52:17.730253 19549 command_runner.go:130] > # Used to change the name of the default AppArmor profile of CRI-O. The default
I0305 01:52:17.730267 19549 command_runner.go:130] > # profile name is "crio-default". This profile only takes effect if the user
I0305 01:52:17.730280 19549 command_runner.go:130] > # does not specify a profile via the Kubernetes Pod's metadata annotation. If
I0305 01:52:17.730292 19549 command_runner.go:130] > # the profile is set to "unconfined", then this equals to disabling AppArmor.
I0305 01:52:17.730303 19549 command_runner.go:130] > # This option supports live configuration reload.
I0305 01:52:17.730312 19549 command_runner.go:130] > # apparmor_profile = "crio-default"
I0305 01:52:17.730323 19549 command_runner.go:130] > # Path to the blockio class configuration file for configuring
I0305 01:52:17.730327 19549 command_runner.go:130] > # the cgroup blockio controller.
I0305 01:52:17.730335 19549 command_runner.go:130] > # blockio_config_file = ""
I0305 01:52:17.730346 19549 command_runner.go:130] > # Reload blockio-config-file and rescan blockio devices in the system before applying
I0305 01:52:17.730357 19549 command_runner.go:130] > # blockio parameters.
I0305 01:52:17.730364 19549 command_runner.go:130] > # blockio_reload = false
I0305 01:52:17.730375 19549 command_runner.go:130] > # Used to change irqbalance service config file path which is used for configuring
I0305 01:52:17.730384 19549 command_runner.go:130] > # irqbalance daemon.
I0305 01:52:17.730393 19549 command_runner.go:130] > # irqbalance_config_file = "/etc/sysconfig/irqbalance"
I0305 01:52:17.730405 19549 command_runner.go:130] > # irqbalance_config_restore_file allows to set a cpu mask CRI-O should
I0305 01:52:17.730418 19549 command_runner.go:130] > # restore as irqbalance config at startup. Set to empty string to disable this flow entirely.
I0305 01:52:17.730430 19549 command_runner.go:130] > # By default, CRI-O manages the irqbalance configuration to enable dynamic IRQ pinning.
I0305 01:52:17.730445 19549 command_runner.go:130] > # irqbalance_config_restore_file = "/etc/sysconfig/orig_irq_banned_cpus"
I0305 01:52:17.730455 19549 command_runner.go:130] > # Path to the RDT configuration file for configuring the resctrl pseudo-filesystem.
I0305 01:52:17.730468 19549 command_runner.go:130] > # This option supports live configuration reload.
I0305 01:52:17.730475 19549 command_runner.go:130] > # rdt_config_file = ""
I0305 01:52:17.730488 19549 command_runner.go:130] > # Cgroup management implementation used for the runtime.
I0305 01:52:17.730498 19549 command_runner.go:130] > cgroup_manager = "cgroupfs"
I0305 01:52:17.730534 19549 command_runner.go:130] > # Specify whether the image pull must be performed in a separate cgroup.
I0305 01:52:17.730544 19549 command_runner.go:130] > # separate_pull_cgroup = ""
I0305 01:52:17.730553 19549 command_runner.go:130] > # List of default capabilities for containers. If it is empty or commented out,
I0305 01:52:17.730566 19549 command_runner.go:130] > # only the capabilities defined in the containers json file by the user/kube
I0305 01:52:17.730575 19549 command_runner.go:130] > # will be added.
I0305 01:52:17.730584 19549 command_runner.go:130] > # default_capabilities = [
I0305 01:52:17.730596 19549 command_runner.go:130] > # "CHOWN",
I0305 01:52:17.730605 19549 command_runner.go:130] > # "DAC_OVERRIDE",
I0305 01:52:17.730610 19549 command_runner.go:130] > # "FSETID",
I0305 01:52:17.730618 19549 command_runner.go:130] > # "FOWNER",
I0305 01:52:17.730624 19549 command_runner.go:130] > # "SETGID",
I0305 01:52:17.730631 19549 command_runner.go:130] > # "SETUID",
I0305 01:52:17.730634 19549 command_runner.go:130] > # "SETPCAP",
I0305 01:52:17.730640 19549 command_runner.go:130] > # "NET_BIND_SERVICE",
I0305 01:52:17.730649 19549 command_runner.go:130] > # "KILL",
I0305 01:52:17.730655 19549 command_runner.go:130] > # ]
I0305 01:52:17.730670 19549 command_runner.go:130] > # Add capabilities to the inheritable set, as well as the default group of permitted, bounding and effective.
I0305 01:52:17.730684 19549 command_runner.go:130] > # If capabilities are expected to work for non-root users, this option should be set.
I0305 01:52:17.730698 19549 command_runner.go:130] > # add_inheritable_capabilities = false
I0305 01:52:17.730711 19549 command_runner.go:130] > # List of default sysctls. If it is empty or commented out, only the sysctls
I0305 01:52:17.730723 19549 command_runner.go:130] > # defined in the container json file by the user/kube will be added.
I0305 01:52:17.730733 19549 command_runner.go:130] > # default_sysctls = [
I0305 01:52:17.730739 19549 command_runner.go:130] > # ]
I0305 01:52:17.730750 19549 command_runner.go:130] > # List of devices on the host that a
I0305 01:52:17.730763 19549 command_runner.go:130] > # user can specify with the "io.kubernetes.cri-o.Devices" allowed annotation.
I0305 01:52:17.730772 19549 command_runner.go:130] > # allowed_devices = [
I0305 01:52:17.730782 19549 command_runner.go:130] > # "/dev/fuse",
I0305 01:52:17.730789 19549 command_runner.go:130] > # ]
I0305 01:52:17.730800 19549 command_runner.go:130] > # List of additional devices. specified as
I0305 01:52:17.730810 19549 command_runner.go:130] > # "<device-on-host>:<device-on-container>:<permissions>", for example: "--device=/dev/sdc:/dev/xvdc:rwm".
I0305 01:52:17.730831 19549 command_runner.go:130] > # If it is empty or commented out, only the devices
I0305 01:52:17.730845 19549 command_runner.go:130] > # defined in the container json file by the user/kube will be added.
I0305 01:52:17.730854 19549 command_runner.go:130] > # additional_devices = [
I0305 01:52:17.730863 19549 command_runner.go:130] > # ]
I0305 01:52:17.730871 19549 command_runner.go:130] > # List of directories to scan for CDI Spec files.
I0305 01:52:17.730880 19549 command_runner.go:130] > # cdi_spec_dirs = [
I0305 01:52:17.730889 19549 command_runner.go:130] > # "/etc/cdi",
I0305 01:52:17.730899 19549 command_runner.go:130] > # "/var/run/cdi",
I0305 01:52:17.730907 19549 command_runner.go:130] > # ]
I0305 01:52:17.730917 19549 command_runner.go:130] > # Change the default behavior of setting container devices uid/gid from CRI's
I0305 01:52:17.730930 19549 command_runner.go:130] > # SecurityContext (RunAsUser/RunAsGroup) instead of taking host's uid/gid.
I0305 01:52:17.730941 19549 command_runner.go:130] > # Defaults to false.
I0305 01:52:17.730950 19549 command_runner.go:130] > # device_ownership_from_security_context = false
I0305 01:52:17.730963 19549 command_runner.go:130] > # Path to OCI hooks directories for automatically executed hooks. If one of the
I0305 01:52:17.730975 19549 command_runner.go:130] > # directories does not exist, then CRI-O will automatically skip them.
I0305 01:52:17.730983 19549 command_runner.go:130] > # hooks_dir = [
I0305 01:52:17.730999 19549 command_runner.go:130] > # "/usr/share/containers/oci/hooks.d",
I0305 01:52:17.731007 19549 command_runner.go:130] > # ]
I0305 01:52:17.731016 19549 command_runner.go:130] > # Path to the file specifying the defaults mounts for each container. The
I0305 01:52:17.731029 19549 command_runner.go:130] > # format of the config is /SRC:/DST, one mount per line. Notice that CRI-O reads
I0305 01:52:17.731041 19549 command_runner.go:130] > # its default mounts from the following two files:
I0305 01:52:17.731046 19549 command_runner.go:130] > #
I0305 01:52:17.731057 19549 command_runner.go:130] > # 1) /etc/containers/mounts.conf (i.e., default_mounts_file): This is the
I0305 01:52:17.731070 19549 command_runner.go:130] > # override file, where users can either add in their own default mounts, or
I0305 01:52:17.731082 19549 command_runner.go:130] > # override the default mounts shipped with the package.
I0305 01:52:17.731089 19549 command_runner.go:130] > #
I0305 01:52:17.731101 19549 command_runner.go:130] > # 2) /usr/share/containers/mounts.conf: This is the default file read for
I0305 01:52:17.731114 19549 command_runner.go:130] > # mounts. If you want CRI-O to read from a different, specific mounts file,
I0305 01:52:17.731127 19549 command_runner.go:130] > # you can change the default_mounts_file. Note, if this is done, CRI-O will
I0305 01:52:17.731142 19549 command_runner.go:130] > # only add mounts it finds in this file.
I0305 01:52:17.731150 19549 command_runner.go:130] > #
I0305 01:52:17.731158 19549 command_runner.go:130] > # default_mounts_file = ""
I0305 01:52:17.731171 19549 command_runner.go:130] > # Maximum number of processes allowed in a container.
I0305 01:52:17.731182 19549 command_runner.go:130] > # This option is deprecated. The Kubelet flag '--pod-pids-limit' should be used instead.
I0305 01:52:17.731192 19549 command_runner.go:130] > pids_limit = 1024
I0305 01:52:17.731207 19549 command_runner.go:130] > # Maximum sized allowed for the container log file. Negative numbers indicate
I0305 01:52:17.731241 19549 command_runner.go:130] > # that no size limit is imposed. If it is positive, it must be >= 8192 to
I0305 01:52:17.731252 19549 command_runner.go:130] > # match/exceed conmon's read buffer. The file is truncated and re-opened so the
I0305 01:52:17.731268 19549 command_runner.go:130] > # limit is never exceeded. This option is deprecated. The Kubelet flag '--container-log-max-size' should be used instead.
I0305 01:52:17.731279 19549 command_runner.go:130] > # log_size_max = -1
I0305 01:52:17.731291 19549 command_runner.go:130] > # Whether container output should be logged to journald in addition to the kubernetes log file
I0305 01:52:17.731301 19549 command_runner.go:130] > # log_to_journald = false
I0305 01:52:17.731311 19549 command_runner.go:130] > # Path to directory in which container exit files are written to by conmon.
I0305 01:52:17.731323 19549 command_runner.go:130] > # container_exits_dir = "/var/run/crio/exits"
I0305 01:52:17.731334 19549 command_runner.go:130] > # Path to directory for container attach sockets.
I0305 01:52:17.731343 19549 command_runner.go:130] > # container_attach_socket_dir = "/var/run/crio"
I0305 01:52:17.731351 19549 command_runner.go:130] > # The prefix to use for the source of the bind mounts.
I0305 01:52:17.731357 19549 command_runner.go:130] > # bind_mount_prefix = ""
I0305 01:52:17.731369 19549 command_runner.go:130] > # If set to true, all containers will run in read-only mode.
I0305 01:52:17.731390 19549 command_runner.go:130] > # read_only = false
I0305 01:52:17.731404 19549 command_runner.go:130] > # Changes the verbosity of the logs based on the level it is set to. Options
I0305 01:52:17.731416 19549 command_runner.go:130] > # are fatal, panic, error, warn, info, debug and trace. This option supports
I0305 01:52:17.731424 19549 command_runner.go:130] > # live configuration reload.
I0305 01:52:17.731433 19549 command_runner.go:130] > # log_level = "info"
I0305 01:52:17.731443 19549 command_runner.go:130] > # Filter the log messages by the provided regular expression.
I0305 01:52:17.731454 19549 command_runner.go:130] > # This option supports live configuration reload.
I0305 01:52:17.731463 19549 command_runner.go:130] > # log_filter = ""
I0305 01:52:17.731472 19549 command_runner.go:130] > # The UID mappings for the user namespace of each container. A range is
I0305 01:52:17.731490 19549 command_runner.go:130] > # specified in the form containerUID:HostUID:Size. Multiple ranges must be
I0305 01:52:17.731500 19549 command_runner.go:130] > # separated by comma.
I0305 01:52:17.731515 19549 command_runner.go:130] > # This option is deprecated, and will be replaced with Kubernetes user namespace support (KEP-127) in the future.
I0305 01:52:17.731525 19549 command_runner.go:130] > # uid_mappings = ""
I0305 01:52:17.731535 19549 command_runner.go:130] > # The GID mappings for the user namespace of each container. A range is
I0305 01:52:17.731548 19549 command_runner.go:130] > # specified in the form containerGID:HostGID:Size. Multiple ranges must be
I0305 01:52:17.731559 19549 command_runner.go:130] > # separated by comma.
I0305 01:52:17.731571 19549 command_runner.go:130] > # This option is deprecated, and will be replaced with Kubernetes user namespace support (KEP-127) in the future.
I0305 01:52:17.731585 19549 command_runner.go:130] > # gid_mappings = ""
I0305 01:52:17.731598 19549 command_runner.go:130] > # If set, CRI-O will reject any attempt to map host UIDs below this value
I0305 01:52:17.731611 19549 command_runner.go:130] > # into user namespaces. A negative value indicates that no minimum is set,
I0305 01:52:17.731623 19549 command_runner.go:130] > # so specifying mappings will only be allowed for pods that run as UID 0.
I0305 01:52:17.731634 19549 command_runner.go:130] > # This option is deprecated, and will be replaced with Kubernetes user namespace support (KEP-127) in the future.
I0305 01:52:17.731644 19549 command_runner.go:130] > # minimum_mappable_uid = -1
I0305 01:52:17.731664 19549 command_runner.go:130] > # If set, CRI-O will reject any attempt to map host GIDs below this value
I0305 01:52:17.731677 19549 command_runner.go:130] > # into user namespaces. A negative value indicates that no minimum is set,
I0305 01:52:17.731691 19549 command_runner.go:130] > # so specifying mappings will only be allowed for pods that run as UID 0.
I0305 01:52:17.731706 19549 command_runner.go:130] > # This option is deprecated, and will be replaced with Kubernetes user namespace support (KEP-127) in the future.
I0305 01:52:17.731716 19549 command_runner.go:130] > # minimum_mappable_gid = -1
I0305 01:52:17.731726 19549 command_runner.go:130] > # The minimal amount of time in seconds to wait before issuing a timeout
I0305 01:52:17.731738 19549 command_runner.go:130] > # regarding the proper termination of the container. The lowest possible
I0305 01:52:17.731749 19549 command_runner.go:130] > # value is 30s, whereas lower values are not considered by CRI-O.
I0305 01:52:17.731759 19549 command_runner.go:130] > # ctr_stop_timeout = 30
I0305 01:52:17.731768 19549 command_runner.go:130] > # drop_infra_ctr determines whether CRI-O drops the infra container
I0305 01:52:17.731780 19549 command_runner.go:130] > # when a pod does not have a private PID namespace, and does not use
I0305 01:52:17.731790 19549 command_runner.go:130] > # a kernel separating runtime (like kata).
I0305 01:52:17.731797 19549 command_runner.go:130] > # It requires manage_ns_lifecycle to be true.
I0305 01:52:17.731808 19549 command_runner.go:130] > drop_infra_ctr = false
I0305 01:52:17.731822 19549 command_runner.go:130] > # infra_ctr_cpuset determines what CPUs will be used to run infra containers.
I0305 01:52:17.731834 19549 command_runner.go:130] > # You can use linux CPU list format to specify desired CPUs.
I0305 01:52:17.731845 19549 command_runner.go:130] > # To get better isolation for guaranteed pods, set this parameter to be equal to kubelet reserved-cpus.
I0305 01:52:17.731855 19549 command_runner.go:130] > # infra_ctr_cpuset = ""
I0305 01:52:17.731867 19549 command_runner.go:130] > # shared_cpuset determines the CPU set which is allowed to be shared between guaranteed containers,
I0305 01:52:17.731875 19549 command_runner.go:130] > # regardless of, and in addition to, the exclusiveness of their CPUs.
I0305 01:52:17.731884 19549 command_runner.go:130] > # This field is optional and would not be used if not specified.
I0305 01:52:17.731895 19549 command_runner.go:130] > # You can specify CPUs in the Linux CPU list format.
I0305 01:52:17.731903 19549 command_runner.go:130] > # shared_cpuset = ""
I0305 01:52:17.731916 19549 command_runner.go:130] > # The directory where the state of the managed namespaces gets tracked.
I0305 01:52:17.731928 19549 command_runner.go:130] > # Only used when manage_ns_lifecycle is true.
I0305 01:52:17.731937 19549 command_runner.go:130] > # namespaces_dir = "/var/run"
I0305 01:52:17.731949 19549 command_runner.go:130] > # pinns_path is the path to find the pinns binary, which is needed to manage namespace lifecycle
I0305 01:52:17.731959 19549 command_runner.go:130] > pinns_path = "/usr/bin/pinns"
I0305 01:52:17.731971 19549 command_runner.go:130] > # Globally enable/disable CRIU support which is necessary to
I0305 01:52:17.731981 19549 command_runner.go:130] > # checkpoint and restore container or pods (even if CRIU is found in $PATH).
I0305 01:52:17.731987 19549 command_runner.go:130] > # enable_criu_support = false
I0305 01:52:17.731993 19549 command_runner.go:130] > # Enable/disable the generation of the container,
I0305 01:52:17.732006 19549 command_runner.go:130] > # sandbox lifecycle events to be sent to the Kubelet to optimize the PLEG
I0305 01:52:17.732014 19549 command_runner.go:130] > # enable_pod_events = false
I0305 01:52:17.732024 19549 command_runner.go:130] > # default_runtime is the _name_ of the OCI runtime to be used as the default.
I0305 01:52:17.732038 19549 command_runner.go:130] > # default_runtime is the _name_ of the OCI runtime to be used as the default.
I0305 01:52:17.732053 19549 command_runner.go:130] > # The name is matched against the runtimes map below.
I0305 01:52:17.732063 19549 command_runner.go:130] > # default_runtime = "runc"
I0305 01:52:17.732072 19549 command_runner.go:130] > # A list of paths that, when absent from the host,
I0305 01:52:17.732087 19549 command_runner.go:130] > # will cause a container creation to fail (as opposed to the current behavior being created as a directory).
I0305 01:52:17.732102 19549 command_runner.go:130] > # This option is to protect from source locations whose existence as a directory could jeopardize the health of the node, and whose
I0305 01:52:17.732112 19549 command_runner.go:130] > # creation as a file is not desired either.
I0305 01:52:17.732127 19549 command_runner.go:130] > # An example is /etc/hostname, which will cause failures on reboot if it's created as a directory, but often doesn't exist because
I0305 01:52:17.732138 19549 command_runner.go:130] > # the hostname is being managed dynamically.
I0305 01:52:17.732146 19549 command_runner.go:130] > # absent_mount_sources_to_reject = [
I0305 01:52:17.732154 19549 command_runner.go:130] > # ]
I0305 01:52:17.732165 19549 command_runner.go:130] > # The "crio.runtime.runtimes" table defines a list of OCI compatible runtimes.
I0305 01:52:17.732179 19549 command_runner.go:130] > # The runtime to use is picked based on the runtime handler provided by the CRI.
I0305 01:52:17.732192 19549 command_runner.go:130] > # If no runtime handler is provided, the "default_runtime" will be used.
I0305 01:52:17.732203 19549 command_runner.go:130] > # Each entry in the table should follow the format:
I0305 01:52:17.732211 19549 command_runner.go:130] > #
I0305 01:52:17.732224 19549 command_runner.go:130] > # [crio.runtime.runtimes.runtime-handler]
I0305 01:52:17.732242 19549 command_runner.go:130] > # runtime_path = "/path/to/the/executable"
I0305 01:52:17.732249 19549 command_runner.go:130] > # runtime_type = "oci"
I0305 01:52:17.732333 19549 command_runner.go:130] > # runtime_root = "/path/to/the/root"
I0305 01:52:17.732350 19549 command_runner.go:130] > # monitor_path = "/path/to/container/monitor"
I0305 01:52:17.732357 19549 command_runner.go:130] > # monitor_cgroup = "/cgroup/path"
I0305 01:52:17.732365 19549 command_runner.go:130] > # monitor_exec_cgroup = "/cgroup/path"
I0305 01:52:17.732371 19549 command_runner.go:130] > # monitor_env = []
I0305 01:52:17.732381 19549 command_runner.go:130] > # privileged_without_host_devices = false
I0305 01:52:17.732389 19549 command_runner.go:130] > # allowed_annotations = []
I0305 01:52:17.732399 19549 command_runner.go:130] > # platform_runtime_paths = { "os/arch" = "/path/to/binary" }
I0305 01:52:17.732414 19549 command_runner.go:130] > # Where:
I0305 01:52:17.732427 19549 command_runner.go:130] > # - runtime-handler: Name used to identify the runtime.
I0305 01:52:17.732439 19549 command_runner.go:130] > # - runtime_path (optional, string): Absolute path to the runtime executable in
I0305 01:52:17.732452 19549 command_runner.go:130] > # the host filesystem. If omitted, the runtime-handler identifier should match
I0305 01:52:17.732462 19549 command_runner.go:130] > # the runtime executable name, and the runtime executable should be placed
I0305 01:52:17.732474 19549 command_runner.go:130] > # in $PATH.
I0305 01:52:17.732488 19549 command_runner.go:130] > # - runtime_type (optional, string): Type of runtime, one of: "oci", "vm". If
I0305 01:52:17.732502 19549 command_runner.go:130] > # omitted, an "oci" runtime is assumed.
I0305 01:52:17.732516 19549 command_runner.go:130] > # - runtime_root (optional, string): Root directory for storage of containers
I0305 01:52:17.732525 19549 command_runner.go:130] > # state.
I0305 01:52:17.732543 19549 command_runner.go:130] > # - runtime_config_path (optional, string): the path for the runtime configuration
I0305 01:52:17.732556 19549 command_runner.go:130] > # file. This can only be used with when using the VM runtime_type.
I0305 01:52:17.732566 19549 command_runner.go:130] > # - privileged_without_host_devices (optional, bool): an option for restricting
I0305 01:52:17.732580 19549 command_runner.go:130] > # host devices from being passed to privileged containers.
I0305 01:52:17.732592 19549 command_runner.go:130] > # - allowed_annotations (optional, array of strings): an option for specifying
I0305 01:52:17.732606 19549 command_runner.go:130] > # a list of experimental annotations that this runtime handler is allowed to process.
I0305 01:52:17.732617 19549 command_runner.go:130] > # The currently recognized values are:
I0305 01:52:17.732631 19549 command_runner.go:130] > # "io.kubernetes.cri-o.userns-mode" for configuring a user namespace for the pod.
I0305 01:52:17.732646 19549 command_runner.go:130] > # "io.kubernetes.cri-o.cgroup2-mount-hierarchy-rw" for mounting cgroups writably when set to "true".
I0305 01:52:17.732658 19549 command_runner.go:130] > # "io.kubernetes.cri-o.Devices" for configuring devices for the pod.
I0305 01:52:17.732668 19549 command_runner.go:130] > # "io.kubernetes.cri-o.ShmSize" for configuring the size of /dev/shm.
I0305 01:52:17.732682 19549 command_runner.go:130] > # "io.kubernetes.cri-o.UnifiedCgroup.$CTR_NAME" for configuring the cgroup v2 unified block for a container.
I0305 01:52:17.732697 19549 command_runner.go:130] > # "io.containers.trace-syscall" for tracing syscalls via the OCI seccomp BPF hook.
I0305 01:52:17.732711 19549 command_runner.go:130] > # "io.kubernetes.cri-o.seccompNotifierAction" for enabling the seccomp notifier feature.
I0305 01:52:17.732723 19549 command_runner.go:130] > # "io.kubernetes.cri-o.umask" for setting the umask for container init process.
I0305 01:52:17.732736 19549 command_runner.go:130] > # "io.kubernetes.cri.rdt-class" for setting the RDT class of a container
I0305 01:52:17.732748 19549 command_runner.go:130] > # - monitor_path (optional, string): The path of the monitor binary. Replaces
I0305 01:52:17.732758 19549 command_runner.go:130] > # deprecated option "conmon".
I0305 01:52:17.732770 19549 command_runner.go:130] > # - monitor_cgroup (optional, string): The cgroup the container monitor process will be put in.
I0305 01:52:17.732788 19549 command_runner.go:130] > # Replaces deprecated option "conmon_cgroup".
I0305 01:52:17.732802 19549 command_runner.go:130] > # - monitor_exec_cgroup (optional, string): If set to "container", indicates exec probes
I0305 01:52:17.732812 19549 command_runner.go:130] > # should be moved to the container's cgroup
I0305 01:52:17.732835 19549 command_runner.go:130] > # - monitor_env (optional, array of strings): Environment variables to pass to the montior.
I0305 01:52:17.732853 19549 command_runner.go:130] > # Replaces deprecated option "conmon_env".
I0305 01:52:17.732869 19549 command_runner.go:130] > # - platform_runtime_paths (optional, map): A mapping of platforms to the corresponding
I0305 01:52:17.732881 19549 command_runner.go:130] > # runtime executable paths for the runtime handler.
I0305 01:52:17.732889 19549 command_runner.go:130] > #
I0305 01:52:17.732896 19549 command_runner.go:130] > # Using the seccomp notifier feature:
I0305 01:52:17.732906 19549 command_runner.go:130] > #
I0305 01:52:17.732916 19549 command_runner.go:130] > # This feature can help you to debug seccomp related issues, for example if
I0305 01:52:17.732930 19549 command_runner.go:130] > # blocked syscalls (permission denied errors) have negative impact on the workload.
I0305 01:52:17.732939 19549 command_runner.go:130] > #
I0305 01:52:17.732949 19549 command_runner.go:130] > # To be able to use this feature, configure a runtime which has the annotation
I0305 01:52:17.732962 19549 command_runner.go:130] > # "io.kubernetes.cri-o.seccompNotifierAction" in the allowed_annotations array.
I0305 01:52:17.732967 19549 command_runner.go:130] > #
I0305 01:52:17.732980 19549 command_runner.go:130] > # It also requires at least runc 1.1.0 or crun 0.19 which support the notifier
I0305 01:52:17.732999 19549 command_runner.go:130] > # feature.
I0305 01:52:17.733008 19549 command_runner.go:130] > #
I0305 01:52:17.733017 19549 command_runner.go:130] > # If everything is setup, CRI-O will modify chosen seccomp profiles for
I0305 01:52:17.733031 19549 command_runner.go:130] > # containers if the annotation "io.kubernetes.cri-o.seccompNotifierAction" is
I0305 01:52:17.733045 19549 command_runner.go:130] > # set on the Pod sandbox. CRI-O will then get notified if a container is using
I0305 01:52:17.733057 19549 command_runner.go:130] > # a blocked syscall and then terminate the workload after a timeout of 5
I0305 01:52:17.733073 19549 command_runner.go:130] > # seconds if the value of "io.kubernetes.cri-o.seccompNotifierAction=stop".
I0305 01:52:17.733082 19549 command_runner.go:130] > #
I0305 01:52:17.733092 19549 command_runner.go:130] > # This also means that multiple syscalls can be captured during that period,
I0305 01:52:17.733106 19549 command_runner.go:130] > # while the timeout will get reset once a new syscall has been discovered.
I0305 01:52:17.733114 19549 command_runner.go:130] > #
I0305 01:52:17.733123 19549 command_runner.go:130] > # This also means that the Pods "restartPolicy" has to be set to "Never",
I0305 01:52:17.733135 19549 command_runner.go:130] > # otherwise the kubelet will restart the container immediately.
I0305 01:52:17.733140 19549 command_runner.go:130] > #
I0305 01:52:17.733153 19549 command_runner.go:130] > # Please be aware that CRI-O is not able to get notified if a syscall gets
I0305 01:52:17.733164 19549 command_runner.go:130] > # blocked based on the seccomp defaultAction, which is a general runtime
I0305 01:52:17.733170 19549 command_runner.go:130] > # limitation.
I0305 01:52:17.733174 19549 command_runner.go:130] > [crio.runtime.runtimes.runc]
I0305 01:52:17.733178 19549 command_runner.go:130] > runtime_path = "/usr/bin/runc"
I0305 01:52:17.733182 19549 command_runner.go:130] > runtime_type = "oci"
I0305 01:52:17.733186 19549 command_runner.go:130] > runtime_root = "/run/runc"
I0305 01:52:17.733190 19549 command_runner.go:130] > runtime_config_path = ""
I0305 01:52:17.733197 19549 command_runner.go:130] > monitor_path = "/usr/libexec/crio/conmon"
I0305 01:52:17.733206 19549 command_runner.go:130] > monitor_cgroup = "pod"
I0305 01:52:17.733214 19549 command_runner.go:130] > monitor_exec_cgroup = ""
I0305 01:52:17.733227 19549 command_runner.go:130] > monitor_env = [
I0305 01:52:17.733237 19549 command_runner.go:130] > "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
I0305 01:52:17.733244 19549 command_runner.go:130] > ]
I0305 01:52:17.733252 19549 command_runner.go:130] > privileged_without_host_devices = false
I0305 01:52:17.733266 19549 command_runner.go:130] > # The workloads table defines ways to customize containers with different resources
I0305 01:52:17.733275 19549 command_runner.go:130] > # that work based on annotations, rather than the CRI.
I0305 01:52:17.733280 19549 command_runner.go:130] > # Note, the behavior of this table is EXPERIMENTAL and may change at any time.
I0305 01:52:17.733289 19549 command_runner.go:130] > # Each workload, has a name, activation_annotation, annotation_prefix and set of resources it supports mutating.
I0305 01:52:17.733299 19549 command_runner.go:130] > # The currently supported resources are "cpu" (to configure the cpu shares) and "cpuset" to configure the cpuset.
I0305 01:52:17.733306 19549 command_runner.go:130] > # Each resource can have a default value specified, or be empty.
I0305 01:52:17.733315 19549 command_runner.go:130] > # For a container to opt-into this workload, the pod should be configured with the annotation $activation_annotation (key only, value is ignored).
I0305 01:52:17.733329 19549 command_runner.go:130] > # To customize per-container, an annotation of the form $annotation_prefix.$resource/$ctrName = "value" can be specified
I0305 01:52:17.733337 19549 command_runner.go:130] > # signifying for that resource type to override the default value.
I0305 01:52:17.733347 19549 command_runner.go:130] > # If the annotation_prefix is not present, every container in the pod will be given the default values.
I0305 01:52:17.733356 19549 command_runner.go:130] > # Example:
I0305 01:52:17.733364 19549 command_runner.go:130] > # [crio.runtime.workloads.workload-type]
I0305 01:52:17.733375 19549 command_runner.go:130] > # activation_annotation = "io.crio/workload"
I0305 01:52:17.733386 19549 command_runner.go:130] > # annotation_prefix = "io.crio.workload-type"
I0305 01:52:17.733397 19549 command_runner.go:130] > # [crio.runtime.workloads.workload-type.resources]
I0305 01:52:17.733406 19549 command_runner.go:130] > # cpuset = 0
I0305 01:52:17.733415 19549 command_runner.go:130] > # cpushares = "0-1"
I0305 01:52:17.733419 19549 command_runner.go:130] > # Where:
I0305 01:52:17.733424 19549 command_runner.go:130] > # The workload name is workload-type.
I0305 01:52:17.733430 19549 command_runner.go:130] > # To specify, the pod must have the "io.crio.workload" annotation (this is a precise string match).
I0305 01:52:17.733438 19549 command_runner.go:130] > # This workload supports setting cpuset and cpu resources.
I0305 01:52:17.733443 19549 command_runner.go:130] > # annotation_prefix is used to customize the different resources.
I0305 01:52:17.733453 19549 command_runner.go:130] > # To configure the cpu shares a container gets in the example above, the pod would have to have the following annotation:
I0305 01:52:17.733459 19549 command_runner.go:130] > # "io.crio.workload-type/$container_name = {"cpushares": "value"}"
I0305 01:52:17.733464 19549 command_runner.go:130] > # hostnetwork_disable_selinux determines whether
I0305 01:52:17.733470 19549 command_runner.go:130] > # SELinux should be disabled within a pod when it is running in the host network namespace
I0305 01:52:17.733477 19549 command_runner.go:130] > # Default value is set to true
I0305 01:52:17.733481 19549 command_runner.go:130] > # hostnetwork_disable_selinux = true
I0305 01:52:17.733486 19549 command_runner.go:130] > # disable_hostport_mapping determines whether to enable/disable
I0305 01:52:17.733503 19549 command_runner.go:130] > # the container hostport mapping in CRI-O.
I0305 01:52:17.733513 19549 command_runner.go:130] > # Default value is set to 'false'
I0305 01:52:17.733518 19549 command_runner.go:130] > # disable_hostport_mapping = false
I0305 01:52:17.733526 19549 command_runner.go:130] > # The crio.image table contains settings pertaining to the management of OCI images.
I0305 01:52:17.733529 19549 command_runner.go:130] > #
I0305 01:52:17.733535 19549 command_runner.go:130] > # CRI-O reads its configured registries defaults from the system wide
I0305 01:52:17.733543 19549 command_runner.go:130] > # containers-registries.conf(5) located in /etc/containers/registries.conf. If
I0305 01:52:17.733549 19549 command_runner.go:130] > # you want to modify just CRI-O, you can change the registries configuration in
I0305 01:52:17.733557 19549 command_runner.go:130] > # this file. Otherwise, leave insecure_registries and registries commented out to
I0305 01:52:17.733565 19549 command_runner.go:130] > # use the system's defaults from /etc/containers/registries.conf.
I0305 01:52:17.733573 19549 command_runner.go:130] > [crio.image]
I0305 01:52:17.733583 19549 command_runner.go:130] > # Default transport for pulling images from a remote container storage.
I0305 01:52:17.733595 19549 command_runner.go:130] > # default_transport = "docker://"
I0305 01:52:17.733604 19549 command_runner.go:130] > # The path to a file containing credentials necessary for pulling images from
I0305 01:52:17.733615 19549 command_runner.go:130] > # secure registries. The file is similar to that of /var/lib/kubelet/config.json
I0305 01:52:17.733622 19549 command_runner.go:130] > # global_auth_file = ""
I0305 01:52:17.733629 19549 command_runner.go:130] > # The image used to instantiate infra containers.
I0305 01:52:17.733636 19549 command_runner.go:130] > # This option supports live configuration reload.
I0305 01:52:17.733641 19549 command_runner.go:130] > # pause_image = "registry.k8s.io/pause:3.9"
I0305 01:52:17.733646 19549 command_runner.go:130] > # The path to a file containing credentials specific for pulling the pause_image from
I0305 01:52:17.733654 19549 command_runner.go:130] > # above. The file is similar to that of /var/lib/kubelet/config.json
I0305 01:52:17.733659 19549 command_runner.go:130] > # This option supports live configuration reload.
I0305 01:52:17.733665 19549 command_runner.go:130] > # pause_image_auth_file = ""
I0305 01:52:17.733671 19549 command_runner.go:130] > # The command to run to have a container stay in the paused state.
I0305 01:52:17.733678 19549 command_runner.go:130] > # When explicitly set to "", it will fallback to the entrypoint and command
I0305 01:52:17.733684 19549 command_runner.go:130] > # specified in the pause image. When commented out, it will fallback to the
I0305 01:52:17.733692 19549 command_runner.go:130] > # default: "/pause". This option supports live configuration reload.
I0305 01:52:17.733696 19549 command_runner.go:130] > # pause_command = "/pause"
I0305 01:52:17.733704 19549 command_runner.go:130] > # List of images to be excluded from the kubelet's garbage collection.
I0305 01:52:17.733710 19549 command_runner.go:130] > # It allows specifying image names using either exact, glob, or keyword
I0305 01:52:17.733717 19549 command_runner.go:130] > # patterns. Exact matches must match the entire name, glob matches can
I0305 01:52:17.733722 19549 command_runner.go:130] > # have a wildcard * at the end, and keyword matches can have wildcards
I0305 01:52:17.733730 19549 command_runner.go:130] > # on both ends. By default, this list includes the "pause" image if
I0305 01:52:17.733735 19549 command_runner.go:130] > # configured by the user, which is used as a placeholder in Kubernetes pods.
I0305 01:52:17.733741 19549 command_runner.go:130] > # pinned_images = [
I0305 01:52:17.733744 19549 command_runner.go:130] > # ]
I0305 01:52:17.733750 19549 command_runner.go:130] > # Path to the file which decides what sort of policy we use when deciding
I0305 01:52:17.733758 19549 command_runner.go:130] > # whether or not to trust an image that we've pulled. It is not recommended that
I0305 01:52:17.733764 19549 command_runner.go:130] > # this option be used, as the default behavior of using the system-wide default
I0305 01:52:17.733772 19549 command_runner.go:130] > # policy (i.e., /etc/containers/policy.json) is most often preferred. Please
I0305 01:52:17.733779 19549 command_runner.go:130] > # refer to containers-policy.json(5) for more details.
I0305 01:52:17.733786 19549 command_runner.go:130] > # signature_policy = ""
I0305 01:52:17.733791 19549 command_runner.go:130] > # Root path for pod namespace-separated signature policies.
I0305 01:52:17.733797 19549 command_runner.go:130] > # The final policy to be used on image pull will be <SIGNATURE_POLICY_DIR>/<NAMESPACE>.json.
I0305 01:52:17.733803 19549 command_runner.go:130] > # If no pod namespace is being provided on image pull (via the sandbox config),
I0305 01:52:17.733813 19549 command_runner.go:130] > # or the concatenated path is non existent, then the signature_policy or system
I0305 01:52:17.733818 19549 command_runner.go:130] > # wide policy will be used as fallback. Must be an absolute path.
I0305 01:52:17.733825 19549 command_runner.go:130] > # signature_policy_dir = "/etc/crio/policies"
I0305 01:52:17.733830 19549 command_runner.go:130] > # List of registries to skip TLS verification for pulling images. Please
I0305 01:52:17.733836 19549 command_runner.go:130] > # consider configuring the registries via /etc/containers/registries.conf before
I0305 01:52:17.733846 19549 command_runner.go:130] > # changing them here.
I0305 01:52:17.733851 19549 command_runner.go:130] > # insecure_registries = [
I0305 01:52:17.733855 19549 command_runner.go:130] > # ]
I0305 01:52:17.733861 19549 command_runner.go:130] > # Controls how image volumes are handled. The valid values are mkdir, bind and
I0305 01:52:17.733866 19549 command_runner.go:130] > # ignore; the latter will ignore volumes entirely.
I0305 01:52:17.733870 19549 command_runner.go:130] > # image_volumes = "mkdir"
I0305 01:52:17.733875 19549 command_runner.go:130] > # Temporary directory to use for storing big files
I0305 01:52:17.733879 19549 command_runner.go:130] > # big_files_temporary_dir = ""
I0305 01:52:17.733884 19549 command_runner.go:130] > # The crio.network table containers settings pertaining to the management of
I0305 01:52:17.733887 19549 command_runner.go:130] > # CNI plugins.
I0305 01:52:17.733891 19549 command_runner.go:130] > [crio.network]
I0305 01:52:17.733896 19549 command_runner.go:130] > # The default CNI network name to be selected. If not set or "", then
I0305 01:52:17.733901 19549 command_runner.go:130] > # CRI-O will pick-up the first one found in network_dir.
I0305 01:52:17.733904 19549 command_runner.go:130] > # cni_default_network = ""
I0305 01:52:17.733909 19549 command_runner.go:130] > # Path to the directory where CNI configuration files are located.
I0305 01:52:17.733913 19549 command_runner.go:130] > # network_dir = "/etc/cni/net.d/"
I0305 01:52:17.733917 19549 command_runner.go:130] > # Paths to directories where CNI plugin binaries are located.
I0305 01:52:17.733921 19549 command_runner.go:130] > # plugin_dirs = [
I0305 01:52:17.733924 19549 command_runner.go:130] > # "/opt/cni/bin/",
I0305 01:52:17.733927 19549 command_runner.go:130] > # ]
I0305 01:52:17.733932 19549 command_runner.go:130] > # A necessary configuration for Prometheus based metrics retrieval
I0305 01:52:17.733935 19549 command_runner.go:130] > [crio.metrics]
I0305 01:52:17.733939 19549 command_runner.go:130] > # Globally enable or disable metrics support.
I0305 01:52:17.733943 19549 command_runner.go:130] > enable_metrics = true
I0305 01:52:17.733947 19549 command_runner.go:130] > # Specify enabled metrics collectors.
I0305 01:52:17.733954 19549 command_runner.go:130] > # Per default all metrics are enabled.
I0305 01:52:17.733964 19549 command_runner.go:130] > # It is possible, to prefix the metrics with "container_runtime_" and "crio_".
I0305 01:52:17.733987 19549 command_runner.go:130] > # For example, the metrics collector "operations" would be treated in the same
I0305 01:52:17.733998 19549 command_runner.go:130] > # way as "crio_operations" and "container_runtime_crio_operations".
I0305 01:52:17.734006 19549 command_runner.go:130] > # metrics_collectors = [
I0305 01:52:17.734011 19549 command_runner.go:130] > # "operations",
I0305 01:52:17.734023 19549 command_runner.go:130] > # "operations_latency_microseconds_total",
I0305 01:52:17.734031 19549 command_runner.go:130] > # "operations_latency_microseconds",
I0305 01:52:17.734035 19549 command_runner.go:130] > # "operations_errors",
I0305 01:52:17.734039 19549 command_runner.go:130] > # "image_pulls_by_digest",
I0305 01:52:17.734044 19549 command_runner.go:130] > # "image_pulls_by_name",
I0305 01:52:17.734053 19549 command_runner.go:130] > # "image_pulls_by_name_skipped",
I0305 01:52:17.734062 19549 command_runner.go:130] > # "image_pulls_failures",
I0305 01:52:17.734065 19549 command_runner.go:130] > # "image_pulls_successes",
I0305 01:52:17.734069 19549 command_runner.go:130] > # "image_pulls_layer_size",
I0305 01:52:17.734075 19549 command_runner.go:130] > # "image_layer_reuse",
I0305 01:52:17.734079 19549 command_runner.go:130] > # "containers_events_dropped_total",
I0305 01:52:17.734085 19549 command_runner.go:130] > # "containers_oom_total",
I0305 01:52:17.734089 19549 command_runner.go:130] > # "containers_oom",
I0305 01:52:17.734095 19549 command_runner.go:130] > # "processes_defunct",
I0305 01:52:17.734098 19549 command_runner.go:130] > # "operations_total",
I0305 01:52:17.734103 19549 command_runner.go:130] > # "operations_latency_seconds",
I0305 01:52:17.734109 19549 command_runner.go:130] > # "operations_latency_seconds_total",
I0305 01:52:17.734113 19549 command_runner.go:130] > # "operations_errors_total",
I0305 01:52:17.734120 19549 command_runner.go:130] > # "image_pulls_bytes_total",
I0305 01:52:17.734124 19549 command_runner.go:130] > # "image_pulls_skipped_bytes_total",
I0305 01:52:17.734128 19549 command_runner.go:130] > # "image_pulls_failure_total",
I0305 01:52:17.734134 19549 command_runner.go:130] > # "image_pulls_success_total",
I0305 01:52:17.734138 19549 command_runner.go:130] > # "image_layer_reuse_total",
I0305 01:52:17.734142 19549 command_runner.go:130] > # "containers_oom_count_total",
I0305 01:52:17.734149 19549 command_runner.go:130] > # "containers_seccomp_notifier_count_total",
I0305 01:52:17.734153 19549 command_runner.go:130] > # "resources_stalled_at_stage",
I0305 01:52:17.734176 19549 command_runner.go:130] > # ]
I0305 01:52:17.734188 19549 command_runner.go:130] > # The port on which the metrics server will listen.
I0305 01:52:17.734197 19549 command_runner.go:130] > # metrics_port = 9090
I0305 01:52:17.734203 19549 command_runner.go:130] > # Local socket path to bind the metrics server to
I0305 01:52:17.734209 19549 command_runner.go:130] > # metrics_socket = ""
I0305 01:52:17.734214 19549 command_runner.go:130] > # The certificate for the secure metrics server.
I0305 01:52:17.734224 19549 command_runner.go:130] > # If the certificate is not available on disk, then CRI-O will generate a
I0305 01:52:17.734232 19549 command_runner.go:130] > # self-signed one. CRI-O also watches for changes of this path and reloads the
I0305 01:52:17.734236 19549 command_runner.go:130] > # certificate on any modification event.
I0305 01:52:17.734240 19549 command_runner.go:130] > # metrics_cert = ""
I0305 01:52:17.734246 19549 command_runner.go:130] > # The certificate key for the secure metrics server.
I0305 01:52:17.734251 19549 command_runner.go:130] > # Behaves in the same way as the metrics_cert.
I0305 01:52:17.734256 19549 command_runner.go:130] > # metrics_key = ""
I0305 01:52:17.734261 19549 command_runner.go:130] > # A necessary configuration for OpenTelemetry trace data exporting
I0305 01:52:17.734265 19549 command_runner.go:130] > [crio.tracing]
I0305 01:52:17.734274 19549 command_runner.go:130] > # Globally enable or disable exporting OpenTelemetry traces.
I0305 01:52:17.734281 19549 command_runner.go:130] > # enable_tracing = false
I0305 01:52:17.734286 19549 command_runner.go:130] > # Address on which the gRPC trace collector listens on.
I0305 01:52:17.734290 19549 command_runner.go:130] > # tracing_endpoint = "0.0.0.0:4317"
I0305 01:52:17.734296 19549 command_runner.go:130] > # Number of samples to collect per million spans. Set to 1000000 to always sample.
I0305 01:52:17.734303 19549 command_runner.go:130] > # tracing_sampling_rate_per_million = 0
I0305 01:52:17.734307 19549 command_runner.go:130] > # CRI-O NRI configuration.
I0305 01:52:17.734312 19549 command_runner.go:130] > [crio.nri]
I0305 01:52:17.734316 19549 command_runner.go:130] > # Globally enable or disable NRI.
I0305 01:52:17.734322 19549 command_runner.go:130] > # enable_nri = false
I0305 01:52:17.734328 19549 command_runner.go:130] > # NRI socket to listen on.
I0305 01:52:17.734335 19549 command_runner.go:130] > # nri_listen = "/var/run/nri/nri.sock"
I0305 01:52:17.734339 19549 command_runner.go:130] > # NRI plugin directory to use.
I0305 01:52:17.734343 19549 command_runner.go:130] > # nri_plugin_dir = "/opt/nri/plugins"
I0305 01:52:17.734351 19549 command_runner.go:130] > # NRI plugin configuration directory to use.
I0305 01:52:17.734355 19549 command_runner.go:130] > # nri_plugin_config_dir = "/etc/nri/conf.d"
I0305 01:52:17.734361 19549 command_runner.go:130] > # Disable connections from externally launched NRI plugins.
I0305 01:52:17.734365 19549 command_runner.go:130] > # nri_disable_connections = false
I0305 01:52:17.734371 19549 command_runner.go:130] > # Timeout for a plugin to register itself with NRI.
I0305 01:52:17.734375 19549 command_runner.go:130] > # nri_plugin_registration_timeout = "5s"
I0305 01:52:17.734382 19549 command_runner.go:130] > # Timeout for a plugin to handle an NRI request.
I0305 01:52:17.734386 19549 command_runner.go:130] > # nri_plugin_request_timeout = "2s"
I0305 01:52:17.734394 19549 command_runner.go:130] > # Necessary information pertaining to container and pod stats reporting.
I0305 01:52:17.734397 19549 command_runner.go:130] > [crio.stats]
I0305 01:52:17.734403 19549 command_runner.go:130] > # The number of seconds between collecting pod and container stats.
I0305 01:52:17.734408 19549 command_runner.go:130] > # If set to 0, the stats are collected on-demand instead.
I0305 01:52:17.734420 19549 command_runner.go:130] > # stats_collection_period = 0
I0305 01:52:17.734896 19549 command_runner.go:130] ! time="2024-03-05 01:52:17.708047598Z" level=info msg="Starting CRI-O, version: 1.29.1, git: unknown(clean)"
I0305 01:52:17.734917 19549 command_runner.go:130] ! level=info msg="Using default capabilities: CAP_CHOWN, CAP_DAC_OVERRIDE, CAP_FSETID, CAP_FOWNER, CAP_SETGID, CAP_SETUID, CAP_SETPCAP, CAP_NET_BIND_SERVICE, CAP_KILL"
I0305 01:52:17.735200 19549 cni.go:84] Creating CNI manager for ""
I0305 01:52:17.735218 19549 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge
I0305 01:52:17.735232 19549 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0305 01:52:17.735255 19549 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.62 APIServerPort:8441 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:functional-453214 NodeName:functional-453214 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.62"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.62 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/
etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0305 01:52:17.735379 19549 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.39.62
bindPort: 8441
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "functional-453214"
kubeletExtraArgs:
node-ip: 192.168.39.62
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.39.62"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8441
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.28.4
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0305 01:52:17.735437 19549 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
I0305 01:52:17.747109 19549 command_runner.go:130] > kubeadm
I0305 01:52:17.747128 19549 command_runner.go:130] > kubectl
I0305 01:52:17.747134 19549 command_runner.go:130] > kubelet
I0305 01:52:17.747158 19549 binaries.go:44] Found k8s binaries, skipping transfer
I0305 01:52:17.747209 19549 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0305 01:52:17.757818 19549 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (316 bytes)
I0305 01:52:17.776418 19549 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0305 01:52:17.794512 19549 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2158 bytes)
I0305 01:52:17.812766 19549 ssh_runner.go:195] Run: grep 192.168.39.62 control-plane.minikube.internal$ /etc/hosts
I0305 01:52:17.816841 19549 command_runner.go:130] > 192.168.39.62 control-plane.minikube.internal
I0305 01:52:17.816978 19549 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0305 01:52:17.959257 19549 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0305 01:52:17.975568 19549 certs.go:68] Setting up /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214 for IP: 192.168.39.62
I0305 01:52:17.975590 19549 certs.go:194] generating shared ca certs ...
I0305 01:52:17.975610 19549 certs.go:226] acquiring lock for ca certs: {Name:mkd798d23114d8cce18871242c1505100314b4d5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0305 01:52:17.975794 19549 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17909-6453/.minikube/ca.key
I0305 01:52:17.975861 19549 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17909-6453/.minikube/proxy-client-ca.key
I0305 01:52:17.975874 19549 certs.go:256] generating profile certs ...
I0305 01:52:17.975971 19549 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/client.key
I0305 01:52:17.976049 19549 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/apiserver.key.d0d13bb9
I0305 01:52:17.976116 19549 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/proxy-client.key
I0305 01:52:17.976129 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0305 01:52:17.976145 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0305 01:52:17.976161 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0305 01:52:17.976178 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0305 01:52:17.976194 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0305 01:52:17.976207 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0305 01:52:17.976218 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0305 01:52:17.976227 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0305 01:52:17.976278 19549 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/13668.pem (1338 bytes)
W0305 01:52:17.976305 19549 certs.go:480] ignoring /home/jenkins/minikube-integration/17909-6453/.minikube/certs/13668_empty.pem, impossibly tiny 0 bytes
I0305 01:52:17.976314 19549 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca-key.pem (1679 bytes)
I0305 01:52:17.976338 19549 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/ca.pem (1078 bytes)
I0305 01:52:17.976363 19549 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/cert.pem (1123 bytes)
I0305 01:52:17.976383 19549 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/key.pem (1679 bytes)
I0305 01:52:17.976418 19549 certs.go:484] found cert: /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/ssl/certs/136682.pem (1708 bytes)
I0305 01:52:17.976442 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/certs/13668.pem -> /usr/share/ca-certificates/13668.pem
I0305 01:52:17.976458 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/ssl/certs/136682.pem -> /usr/share/ca-certificates/136682.pem
I0305 01:52:17.976475 19549 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17909-6453/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0305 01:52:17.977109 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0305 01:52:18.001619 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0305 01:52:18.026566 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0305 01:52:18.051455 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0305 01:52:18.076831 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0305 01:52:18.102348 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0305 01:52:18.127360 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0305 01:52:18.152299 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/profiles/functional-453214/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0305 01:52:18.177248 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/certs/13668.pem --> /usr/share/ca-certificates/13668.pem (1338 bytes)
I0305 01:52:18.203118 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/files/etc/ssl/certs/136682.pem --> /usr/share/ca-certificates/136682.pem (1708 bytes)
I0305 01:52:18.227965 19549 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17909-6453/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0305 01:52:18.253968 19549 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0305 01:52:18.272003 19549 ssh_runner.go:195] Run: openssl version
I0305 01:52:18.278551 19549 command_runner.go:130] > OpenSSL 1.1.1w 11 Sep 2023
I0305 01:52:18.278630 19549 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/13668.pem && ln -fs /usr/share/ca-certificates/13668.pem /etc/ssl/certs/13668.pem"
I0305 01:52:18.291901 19549 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/13668.pem
I0305 01:52:18.296675 19549 command_runner.go:130] > -rw-r--r-- 1 root root 1338 Mar 5 01:48 /usr/share/ca-certificates/13668.pem
I0305 01:52:18.296699 19549 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Mar 5 01:48 /usr/share/ca-certificates/13668.pem
I0305 01:52:18.296732 19549 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/13668.pem
I0305 01:52:18.302745 19549 command_runner.go:130] > 51391683
I0305 01:52:18.302926 19549 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/13668.pem /etc/ssl/certs/51391683.0"
I0305 01:52:18.313602 19549 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/136682.pem && ln -fs /usr/share/ca-certificates/136682.pem /etc/ssl/certs/136682.pem"
I0305 01:52:18.325821 19549 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/136682.pem
I0305 01:52:18.330855 19549 command_runner.go:130] > -rw-r--r-- 1 root root 1708 Mar 5 01:48 /usr/share/ca-certificates/136682.pem
I0305 01:52:18.330882 19549 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Mar 5 01:48 /usr/share/ca-certificates/136682.pem
I0305 01:52:18.330919 19549 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/136682.pem
I0305 01:52:18.336862 19549 command_runner.go:130] > 3ec20f2e
I0305 01:52:18.336908 19549 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/136682.pem /etc/ssl/certs/3ec20f2e.0"
I0305 01:52:18.347480 19549 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0305 01:52:18.360675 19549 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0305 01:52:18.365429 19549 command_runner.go:130] > -rw-r--r-- 1 root root 1111 Mar 5 01:40 /usr/share/ca-certificates/minikubeCA.pem
I0305 01:52:18.365554 19549 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Mar 5 01:40 /usr/share/ca-certificates/minikubeCA.pem
I0305 01:52:18.365604 19549 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0305 01:52:18.371599 19549 command_runner.go:130] > b5213941
I0305 01:52:18.371646 19549 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0305 01:52:18.382495 19549 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0305 01:52:18.388831 19549 command_runner.go:130] > File: /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0305 01:52:18.388857 19549 command_runner.go:130] > Size: 1164 Blocks: 8 IO Block: 4096 regular file
I0305 01:52:18.388866 19549 command_runner.go:130] > Device: 253,1 Inode: 4197437 Links: 1
I0305 01:52:18.388875 19549 command_runner.go:130] > Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root)
I0305 01:52:18.388884 19549 command_runner.go:130] > Access: 2024-03-05 01:49:31.915916968 +0000
I0305 01:52:18.388897 19549 command_runner.go:130] > Modify: 2024-03-05 01:49:31.915916968 +0000
I0305 01:52:18.388905 19549 command_runner.go:130] > Change: 2024-03-05 01:49:31.915916968 +0000
I0305 01:52:18.388915 19549 command_runner.go:130] > Birth: 2024-03-05 01:49:31.915916968 +0000
I0305 01:52:18.388961 19549 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I0305 01:52:18.394962 19549 command_runner.go:130] > Certificate will not expire
I0305 01:52:18.395083 19549 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I0305 01:52:18.401077 19549 command_runner.go:130] > Certificate will not expire
I0305 01:52:18.401149 19549 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I0305 01:52:18.407007 19549 command_runner.go:130] > Certificate will not expire
I0305 01:52:18.407069 19549 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I0305 01:52:18.412944 19549 command_runner.go:130] > Certificate will not expire
I0305 01:52:18.412997 19549 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I0305 01:52:18.418596 19549 command_runner.go:130] > Certificate will not expire
I0305 01:52:18.418958 19549 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I0305 01:52:18.424668 19549 command_runner.go:130] > Certificate will not expire
I0305 01:52:18.424723 19549 kubeadm.go:391] StartCluster: {Name:functional-453214 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28
.4 ClusterName:functional-453214 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.62 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP
: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0305 01:52:18.424800 19549 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0305 01:52:18.424832 19549 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0305 01:52:18.463632 19549 command_runner.go:130] > 8d0a6626ab508ebc33325bef6b6ba28b691d534429beb11c7d3f41c8cb7ff4e3
I0305 01:52:18.463659 19549 command_runner.go:130] > 1db008fd11b252f0062cedf18250a07ff4fda6a461a951cf922cdedc6a3d1fde
I0305 01:52:18.463667 19549 command_runner.go:130] > 8479f2d07a6c3eb71db9e647fd570b3541c0f816bb58280dbabc82850ce43bcf
I0305 01:52:18.463677 19549 command_runner.go:130] > d20870fb9e2013b09a49905daf56f573b42963805f40077a28b2d059acd6bfa3
I0305 01:52:18.463684 19549 command_runner.go:130] > 74f30423682cb801301443b9511d9f47e139f1671df8d45c79cf33b6a78cbd60
I0305 01:52:18.463699 19549 command_runner.go:130] > 69e8a3b084ae6b44dd527a82ae2dfa853b1e7e83278f14d2e222ede0208b5a21
I0305 01:52:18.463708 19549 command_runner.go:130] > 622cfccd4d85b7c74d501ad1c0b4a7b0cdc4e32de6691a791b8ce54bddcdbfc2
I0305 01:52:18.463718 19549 command_runner.go:130] > 1f533cf8af6cc633403cbc30f1b3a8bd09e0a7f9c1e08dfd644681f523e5a57e
I0305 01:52:18.463728 19549 command_runner.go:130] > a4f8033d7c8d2cb8b003e72d5d7c8fe37e6e829611c919470c6109517d04ec58
I0305 01:52:18.463741 19549 command_runner.go:130] > 9c947173b36e3ec9586193b87d921670089f030ee83a5dc5859f5d032290fd9a
I0305 01:52:18.463754 19549 command_runner.go:130] > f7e77f445c6d8106dd827a65e669578404eb50c10388d91db710a1030c764fae
I0305 01:52:18.463779 19549 cri.go:89] found id: "8d0a6626ab508ebc33325bef6b6ba28b691d534429beb11c7d3f41c8cb7ff4e3"
I0305 01:52:18.463790 19549 cri.go:89] found id: "1db008fd11b252f0062cedf18250a07ff4fda6a461a951cf922cdedc6a3d1fde"
I0305 01:52:18.463795 19549 cri.go:89] found id: "8479f2d07a6c3eb71db9e647fd570b3541c0f816bb58280dbabc82850ce43bcf"
I0305 01:52:18.463799 19549 cri.go:89] found id: "d20870fb9e2013b09a49905daf56f573b42963805f40077a28b2d059acd6bfa3"
I0305 01:52:18.463803 19549 cri.go:89] found id: "74f30423682cb801301443b9511d9f47e139f1671df8d45c79cf33b6a78cbd60"
I0305 01:52:18.463808 19549 cri.go:89] found id: "69e8a3b084ae6b44dd527a82ae2dfa853b1e7e83278f14d2e222ede0208b5a21"
I0305 01:52:18.463816 19549 cri.go:89] found id: "622cfccd4d85b7c74d501ad1c0b4a7b0cdc4e32de6691a791b8ce54bddcdbfc2"
I0305 01:52:18.463821 19549 cri.go:89] found id: "1f533cf8af6cc633403cbc30f1b3a8bd09e0a7f9c1e08dfd644681f523e5a57e"
I0305 01:52:18.463826 19549 cri.go:89] found id: "a4f8033d7c8d2cb8b003e72d5d7c8fe37e6e829611c919470c6109517d04ec58"
I0305 01:52:18.463834 19549 cri.go:89] found id: "9c947173b36e3ec9586193b87d921670089f030ee83a5dc5859f5d032290fd9a"
I0305 01:52:18.463842 19549 cri.go:89] found id: "f7e77f445c6d8106dd827a65e669578404eb50c10388d91db710a1030c764fae"
I0305 01:52:18.463846 19549 cri.go:89] found id: ""
I0305 01:52:18.463890 19549 ssh_runner.go:195] Run: sudo runc list -f json
==> CRI-O <==
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.546531603Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1709604277546506724,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:116233,},InodesUsed:&UInt64Value{Value:57,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=0c8005cf-734b-43d0-9dd7-8fe4d25b8983 name=/runtime.v1.ImageService/ImageFsInfo
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.547084530Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=6392cd74-c13d-421e-a134-99acd96fff5f name=/runtime.v1.RuntimeService/ListContainers
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.547161862Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=6392cd74-c13d-421e-a134-99acd96fff5f name=/runtime.v1.RuntimeService/ListContainers
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.547237337Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:a223f6395cc0df14e88bcd47bf83af0897cf1d50f5619e7529f4aa53470d25d2,PodSandboxId:7075d2ee0238b9852bd1215e9c263c3747973223ce1284e1f60f54b1c9b46430,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:18,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1709604260307872705,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-functional-453214,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 89cf96c70085939bfd080138c3ec325d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restart
Count: 18,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0d4c70bbbf6b46261db50c4d73864da79018e64dd50121d217f49913f5c27d90,PodSandboxId:b910b9d0c0058dcf455f88a886143e705f997a1451caefa8ee9fe827b66aec97,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:4,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_RUNNING,CreatedAt:1709604036971483708,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-functional-453214,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ab2768deb422642707ca71c2c4db35aa,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 4,io.
kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=6392cd74-c13d-421e-a134-99acd96fff5f name=/runtime.v1.RuntimeService/ListContainers
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.582711860Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=cb86ade6-2b47-416b-843c-b3e56fc72aa6 name=/runtime.v1.RuntimeService/Version
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.582807269Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=cb86ade6-2b47-416b-843c-b3e56fc72aa6 name=/runtime.v1.RuntimeService/Version
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.584368801Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=09571096-e744-4fdb-8489-6f13734b2005 name=/runtime.v1.ImageService/ImageFsInfo
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.584904479Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1709604277584880536,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:116233,},InodesUsed:&UInt64Value{Value:57,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=09571096-e744-4fdb-8489-6f13734b2005 name=/runtime.v1.ImageService/ImageFsInfo
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.585424365Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=1e287522-6bd8-4f82-9015-a136e6df1091 name=/runtime.v1.RuntimeService/ListContainers
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.585499036Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=1e287522-6bd8-4f82-9015-a136e6df1091 name=/runtime.v1.RuntimeService/ListContainers
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.585570485Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:a223f6395cc0df14e88bcd47bf83af0897cf1d50f5619e7529f4aa53470d25d2,PodSandboxId:7075d2ee0238b9852bd1215e9c263c3747973223ce1284e1f60f54b1c9b46430,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:18,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1709604260307872705,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-functional-453214,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 89cf96c70085939bfd080138c3ec325d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restart
Count: 18,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0d4c70bbbf6b46261db50c4d73864da79018e64dd50121d217f49913f5c27d90,PodSandboxId:b910b9d0c0058dcf455f88a886143e705f997a1451caefa8ee9fe827b66aec97,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:4,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_RUNNING,CreatedAt:1709604036971483708,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-functional-453214,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ab2768deb422642707ca71c2c4db35aa,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 4,io.
kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=1e287522-6bd8-4f82-9015-a136e6df1091 name=/runtime.v1.RuntimeService/ListContainers
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.627604372Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=59b5d001-0e14-4848-b831-2d3ca78916e0 name=/runtime.v1.RuntimeService/Version
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.627703953Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=59b5d001-0e14-4848-b831-2d3ca78916e0 name=/runtime.v1.RuntimeService/Version
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.629040661Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=0048c777-0acc-4f96-877f-7c0f671c6792 name=/runtime.v1.ImageService/ImageFsInfo
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.629525624Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1709604277629503709,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:116233,},InodesUsed:&UInt64Value{Value:57,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=0048c777-0acc-4f96-877f-7c0f671c6792 name=/runtime.v1.ImageService/ImageFsInfo
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.630308809Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=d16640ef-1274-4faf-812d-94e470c3ee56 name=/runtime.v1.RuntimeService/ListContainers
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.630387735Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=d16640ef-1274-4faf-812d-94e470c3ee56 name=/runtime.v1.RuntimeService/ListContainers
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.630470267Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:a223f6395cc0df14e88bcd47bf83af0897cf1d50f5619e7529f4aa53470d25d2,PodSandboxId:7075d2ee0238b9852bd1215e9c263c3747973223ce1284e1f60f54b1c9b46430,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:18,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1709604260307872705,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-functional-453214,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 89cf96c70085939bfd080138c3ec325d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restart
Count: 18,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0d4c70bbbf6b46261db50c4d73864da79018e64dd50121d217f49913f5c27d90,PodSandboxId:b910b9d0c0058dcf455f88a886143e705f997a1451caefa8ee9fe827b66aec97,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:4,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_RUNNING,CreatedAt:1709604036971483708,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-functional-453214,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ab2768deb422642707ca71c2c4db35aa,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 4,io.
kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=d16640ef-1274-4faf-812d-94e470c3ee56 name=/runtime.v1.RuntimeService/ListContainers
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.665717042Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=8310aa9e-882c-4573-8b38-cf56e6ad9686 name=/runtime.v1.RuntimeService/Version
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.665815866Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=8310aa9e-882c-4573-8b38-cf56e6ad9686 name=/runtime.v1.RuntimeService/Version
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.666964892Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=741c54b6-2eff-4f2c-aa0c-d6cb8e3ba0c0 name=/runtime.v1.ImageService/ImageFsInfo
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.667465159Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1709604277667442247,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:116233,},InodesUsed:&UInt64Value{Value:57,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=741c54b6-2eff-4f2c-aa0c-d6cb8e3ba0c0 name=/runtime.v1.ImageService/ImageFsInfo
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.668071700Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=71935740-7213-471f-bd6b-8d30f8840d18 name=/runtime.v1.RuntimeService/ListContainers
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.668125746Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=71935740-7213-471f-bd6b-8d30f8840d18 name=/runtime.v1.RuntimeService/ListContainers
Mar 05 02:04:37 functional-453214 crio[3070]: time="2024-03-05 02:04:37.668196124Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:a223f6395cc0df14e88bcd47bf83af0897cf1d50f5619e7529f4aa53470d25d2,PodSandboxId:7075d2ee0238b9852bd1215e9c263c3747973223ce1284e1f60f54b1c9b46430,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:18,},Image:&ImageSpec{Image:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591,State:CONTAINER_EXITED,CreatedAt:1709604260307872705,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-functional-453214,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 89cf96c70085939bfd080138c3ec325d,},Annotations:map[string]string{io.kubernetes.container.hash: 4b9c51fc,io.kubernetes.container.restart
Count: 18,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0d4c70bbbf6b46261db50c4d73864da79018e64dd50121d217f49913f5c27d90,PodSandboxId:b910b9d0c0058dcf455f88a886143e705f997a1451caefa8ee9fe827b66aec97,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:4,},Image:&ImageSpec{Image:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1,State:CONTAINER_RUNNING,CreatedAt:1709604036971483708,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-functional-453214,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ab2768deb422642707ca71c2c4db35aa,},Annotations:map[string]string{io.kubernetes.container.hash: e1639c7a,io.kubernetes.container.restartCount: 4,io.
kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=71935740-7213-471f-bd6b-8d30f8840d18 name=/runtime.v1.RuntimeService/ListContainers
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
a223f6395cc0d d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591 17 seconds ago Exited kube-controller-manager 18 7075d2ee0238b kube-controller-manager-functional-453214
0d4c70bbbf6b4 e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1 4 minutes ago Running kube-scheduler 4 b910b9d0c0058 kube-scheduler-functional-453214
==> describe nodes <==
command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
The connection to the server localhost:8441 was refused - did you specify the right host or port?
==> dmesg <==
[ +0.192899] systemd-fstab-generator[628]: Ignoring "noauto" option for root device
[ +0.116797] systemd-fstab-generator[640]: Ignoring "noauto" option for root device
[ +0.234082] systemd-fstab-generator[666]: Ignoring "noauto" option for root device
[ +5.209041] systemd-fstab-generator[764]: Ignoring "noauto" option for root device
[ +0.060913] kauditd_printk_skb: 130 callbacks suppressed
[ +4.646070] systemd-fstab-generator[952]: Ignoring "noauto" option for root device
[ +0.817583] kauditd_printk_skb: 46 callbacks suppressed
[ +6.442446] systemd-fstab-generator[1280]: Ignoring "noauto" option for root device
[ +0.077360] kauditd_printk_skb: 41 callbacks suppressed
[ +13.849177] systemd-fstab-generator[1502]: Ignoring "noauto" option for root device
[ +0.108269] kauditd_printk_skb: 21 callbacks suppressed
[Mar 5 01:50] kauditd_printk_skb: 90 callbacks suppressed
[ +38.467473] systemd-fstab-generator[2765]: Ignoring "noauto" option for root device
[ +0.296248] systemd-fstab-generator[2866]: Ignoring "noauto" option for root device
[ +0.245733] systemd-fstab-generator[2894]: Ignoring "noauto" option for root device
[ +0.221312] systemd-fstab-generator[2906]: Ignoring "noauto" option for root device
[ +0.382155] systemd-fstab-generator[2930]: Ignoring "noauto" option for root device
[Mar 5 01:52] systemd-fstab-generator[3149]: Ignoring "noauto" option for root device
[ +0.078332] kauditd_printk_skb: 182 callbacks suppressed
[ +1.893619] systemd-fstab-generator[3275]: Ignoring "noauto" option for root device
[ +12.492728] kauditd_printk_skb: 73 callbacks suppressed
[Mar 5 01:56] systemd-fstab-generator[10662]: Ignoring "noauto" option for root device
[ +12.660331] kauditd_printk_skb: 65 callbacks suppressed
[Mar 5 02:00] systemd-fstab-generator[12317]: Ignoring "noauto" option for root device
[ +12.704178] kauditd_printk_skb: 49 callbacks suppressed
==> kernel <==
02:04:37 up 15 min, 0 users, load average: 0.15, 0.33, 0.30
Linux functional-453214 5.10.207 #1 SMP Fri Feb 23 02:44:03 UTC 2024 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2023.02.9"
==> kube-controller-manager [a223f6395cc0df14e88bcd47bf83af0897cf1d50f5619e7529f4aa53470d25d2] <==
I0305 02:04:20.853326 1 serving.go:348] Generated self-signed cert in-memory
I0305 02:04:21.290768 1 controllermanager.go:189] "Starting" version="v1.28.4"
I0305 02:04:21.290848 1 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0305 02:04:21.292197 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt"
I0305 02:04:21.292569 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"
I0305 02:04:21.293153 1 secure_serving.go:213] Serving securely on 127.0.0.1:10257
I0305 02:04:21.293309 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
E0305 02:04:31.298036 1 controllermanager.go:235] "Error building controller context" err="failed to wait for apiserver being healthy: timed out waiting for the condition: failed to get apiserver /healthz status: Get \"https://192.168.39.62:8441/healthz\": dial tcp 192.168.39.62:8441: connect: connection refused"
==> kube-scheduler [0d4c70bbbf6b46261db50c4d73864da79018e64dd50121d217f49913f5c27d90] <==
E0305 02:04:09.667962 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: Get "https://192.168.39.62:8441/apis/apps/v1/replicasets?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
W0305 02:04:09.770607 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: Get "https://192.168.39.62:8441/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
E0305 02:04:09.770656 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: Get "https://192.168.39.62:8441/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
W0305 02:04:11.925938 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: Get "https://192.168.39.62:8441/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
E0305 02:04:11.925988 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://192.168.39.62:8441/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
W0305 02:04:13.530958 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: Get "https://192.168.39.62:8441/api/v1/replicationcontrollers?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
E0305 02:04:13.531005 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: Get "https://192.168.39.62:8441/api/v1/replicationcontrollers?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
W0305 02:04:15.242916 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: Get "https://192.168.39.62:8441/apis/storage.k8s.io/v1/csistoragecapacities?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
E0305 02:04:15.242966 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: Get "https://192.168.39.62:8441/apis/storage.k8s.io/v1/csistoragecapacities?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
W0305 02:04:15.803014 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.62:8441/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
E0305 02:04:15.803062 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.62:8441/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
W0305 02:04:15.919387 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: Get "https://192.168.39.62:8441/api/v1/pods?fieldSelector=status.phase%3DSucceeded%!C(MISSING)status.phase%3DFailed&limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
E0305 02:04:15.919431 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: Get "https://192.168.39.62:8441/api/v1/pods?fieldSelector=status.phase%3DSucceeded%!C(MISSING)status.phase%3DFailed&limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
W0305 02:04:27.404448 1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: Get "https://192.168.39.62:8441/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
E0305 02:04:27.404497 1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: Get "https://192.168.39.62:8441/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
W0305 02:04:32.833694 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: Get "https://192.168.39.62:8441/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
E0305 02:04:32.833736 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: Get "https://192.168.39.62:8441/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
W0305 02:04:34.136865 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: Get "https://192.168.39.62:8441/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
E0305 02:04:34.136914 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://192.168.39.62:8441/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
W0305 02:04:34.987439 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: Get "https://192.168.39.62:8441/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
E0305 02:04:34.987483 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get "https://192.168.39.62:8441/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
W0305 02:04:36.493196 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: Get "https://192.168.39.62:8441/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
E0305 02:04:36.493242 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://192.168.39.62:8441/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
W0305 02:04:37.775890 1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: Get "https://192.168.39.62:8441/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
E0305 02:04:37.775956 1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: Get "https://192.168.39.62:8441/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
==> kubelet <==
Mar 05 02:04:26 functional-453214 kubelet[12324]: E0305 02:04:26.119942 12324 kubelet_node_status.go:92] "Unable to register node with API server" err="Post \"https://control-plane.minikube.internal:8441/api/v1/nodes\": dial tcp 192.168.39.62:8441: connect: connection refused" node="functional-453214"
Mar 05 02:04:26 functional-453214 kubelet[12324]: E0305 02:04:26.367202 12324 eviction_manager.go:258] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"functional-453214\" not found"
Mar 05 02:04:26 functional-453214 kubelet[12324]: W0305 02:04:26.418400 12324 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.RuntimeClass: Get "https://control-plane.minikube.internal:8441/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
Mar 05 02:04:26 functional-453214 kubelet[12324]: E0305 02:04:26.418482 12324 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get "https://control-plane.minikube.internal:8441/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.62:8441: connect: connection refused
Mar 05 02:04:29 functional-453214 kubelet[12324]: E0305 02:04:29.075548 12324 event.go:289] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"functional-453214.17b9bbd02c33acd2", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"functional-453214", UID:"functional-453214", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node functional-453214 status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"functional-453214"}, FirstTimestamp:time.Date(20
24, time.March, 5, 2, 0, 36, 332989650, time.Local), LastTimestamp:time.Date(2024, time.March, 5, 2, 0, 36, 332989650, time.Local), Count:1, Type:"Normal", EventTime:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"kubelet", ReportingInstance:"functional-453214"}': 'Post "https://control-plane.minikube.internal:8441/api/v1/namespaces/default/events": dial tcp 192.168.39.62:8441: connect: connection refused'(may retry after sleeping)
Mar 05 02:04:32 functional-453214 kubelet[12324]: I0305 02:04:32.112882 12324 scope.go:117] "RemoveContainer" containerID="aa5f3ac18dd0136e4290be76eff2a48bc4466ce46ce2dbd1b8ff20abb387384b"
Mar 05 02:04:32 functional-453214 kubelet[12324]: I0305 02:04:32.115504 12324 scope.go:117] "RemoveContainer" containerID="a223f6395cc0df14e88bcd47bf83af0897cf1d50f5619e7529f4aa53470d25d2"
Mar 05 02:04:32 functional-453214 kubelet[12324]: E0305 02:04:32.115817 12324 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=kube-controller-manager pod=kube-controller-manager-functional-453214_kube-system(89cf96c70085939bfd080138c3ec325d)\"" pod="kube-system/kube-controller-manager-functional-453214" podUID="89cf96c70085939bfd080138c3ec325d"
Mar 05 02:04:32 functional-453214 kubelet[12324]: E0305 02:04:32.303033 12324 remote_runtime.go:319] "CreateContainer in sandbox from runtime service failed" err="rpc error: code = Unknown desc = the container name \"k8s_etcd_etcd-functional-453214_kube-system_ea2801be9db2d690340e52b476b473bf_1\" is already in use by 6364138edf99d0930a2b3e484b73f155bfba420a37e64ef0e6ae5d31f37dcdfb. You have to remove that container to be able to reuse that name: that name is already in use" podSandboxID="5d94a2665ee769f09c71a6508989e776c6941af6bd79d7de8d90e1a305b8bda7"
Mar 05 02:04:32 functional-453214 kubelet[12324]: E0305 02:04:32.303124 12324 kuberuntime_manager.go:1261] container &Container{Name:etcd,Image:registry.k8s.io/etcd:3.5.9-0,Command:[etcd --advertise-client-urls=https://192.168.39.62:2379 --cert-file=/var/lib/minikube/certs/etcd/server.crt --client-cert-auth=true --data-dir=/var/lib/minikube/etcd --experimental-initial-corrupt-check=true --experimental-watch-progress-notify-interval=5s --initial-advertise-peer-urls=https://192.168.39.62:2380 --initial-cluster=functional-453214=https://192.168.39.62:2380 --key-file=/var/lib/minikube/certs/etcd/server.key --listen-client-urls=https://127.0.0.1:2379,https://192.168.39.62:2379 --listen-metrics-urls=http://127.0.0.1:2381 --listen-peer-urls=https://192.168.39.62:2380 --name=functional-453214 --peer-cert-file=/var/lib/minikube/certs/etcd/peer.crt --peer-client-cert-auth=true --peer-key-file=/var/lib/minikube/certs/etcd/peer.key --peer-trusted-ca-file=/var/lib/minikube/certs/etcd/ca.crt --proxy-refresh-inte
rval=70000 --snapshot-count=10000 --trusted-ca-file=/var/lib/minikube/certs/etcd/ca.crt],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{104857600 0} {<nil>} 100Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:etcd-data,ReadOnly:false,MountPath:/var/lib/minikube/etcd,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:etcd-certs,ReadOnly:false,MountPath:/var/lib/minikube/certs/etcd,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/health?exclude=NOSPACE&serializable=true,Port:{0 2381 },Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,TerminationGracePeriodSeconds:nil,},ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:
/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/health?serializable=false,Port:{0 2381 },Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:24,TerminationGracePeriodSeconds:nil,},ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod etcd-functional-453214_kube-system(ea2801be9db2d690340e52b476b473bf): CreateContainerError: the container name "k8s_etcd_etcd-functional-453214_kube-system_ea2801be9db2d690340e52b476b473bf_1" is already in use by 6364138edf99d0930a2b3e484b73f155bfba420a37e64ef0e6ae5d31f37dcdfb. You have to remove that container to be able to reuse that name: that name is already in use
Mar 05 02:04:32 functional-453214 kubelet[12324]: E0305 02:04:32.303164 12324 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"etcd\" with CreateContainerError: \"the container name \\\"k8s_etcd_etcd-functional-453214_kube-system_ea2801be9db2d690340e52b476b473bf_1\\\" is already in use by 6364138edf99d0930a2b3e484b73f155bfba420a37e64ef0e6ae5d31f37dcdfb. You have to remove that container to be able to reuse that name: that name is already in use\"" pod="kube-system/etcd-functional-453214" podUID="ea2801be9db2d690340e52b476b473bf"
Mar 05 02:04:32 functional-453214 kubelet[12324]: E0305 02:04:32.951742 12324 controller.go:146] "Failed to ensure lease exists, will retry" err="Get \"https://control-plane.minikube.internal:8441/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/functional-453214?timeout=10s\": dial tcp 192.168.39.62:8441: connect: connection refused" interval="7s"
Mar 05 02:04:33 functional-453214 kubelet[12324]: I0305 02:04:33.120870 12324 kubelet_node_status.go:70] "Attempting to register node" node="functional-453214"
Mar 05 02:04:33 functional-453214 kubelet[12324]: E0305 02:04:33.121691 12324 kubelet_node_status.go:92] "Unable to register node with API server" err="Post \"https://control-plane.minikube.internal:8441/api/v1/nodes\": dial tcp 192.168.39.62:8441: connect: connection refused" node="functional-453214"
Mar 05 02:04:35 functional-453214 kubelet[12324]: I0305 02:04:35.677871 12324 scope.go:117] "RemoveContainer" containerID="a223f6395cc0df14e88bcd47bf83af0897cf1d50f5619e7529f4aa53470d25d2"
Mar 05 02:04:35 functional-453214 kubelet[12324]: E0305 02:04:35.678312 12324 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=kube-controller-manager pod=kube-controller-manager-functional-453214_kube-system(89cf96c70085939bfd080138c3ec325d)\"" pod="kube-system/kube-controller-manager-functional-453214" podUID="89cf96c70085939bfd080138c3ec325d"
Mar 05 02:04:36 functional-453214 kubelet[12324]: E0305 02:04:36.311519 12324 iptables.go:575] "Could not set up iptables canary" err=<
Mar 05 02:04:36 functional-453214 kubelet[12324]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.
Mar 05 02:04:36 functional-453214 kubelet[12324]: ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Mar 05 02:04:36 functional-453214 kubelet[12324]: Perhaps ip6tables or your kernel needs to be upgraded.
Mar 05 02:04:36 functional-453214 kubelet[12324]: > table="nat" chain="KUBE-KUBELET-CANARY"
Mar 05 02:04:36 functional-453214 kubelet[12324]: E0305 02:04:36.367563 12324 eviction_manager.go:258] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"functional-453214\" not found"
Mar 05 02:04:37 functional-453214 kubelet[12324]: E0305 02:04:37.302495 12324 remote_runtime.go:319] "CreateContainer in sandbox from runtime service failed" err="rpc error: code = Unknown desc = the container name \"k8s_kube-apiserver_kube-apiserver-functional-453214_kube-system_9a0e6d087f52c1b953a5e8af6a9e74df_1\" is already in use by 0d82b1ef935f59b92887abb5f1efb245bed9a9324490d82e0830e87499e4d14b. You have to remove that container to be able to reuse that name: that name is already in use" podSandboxID="8c38a90b3716163557d8d849323a9082e3941c204a70bf07e8c5c6ec53d13049"
Mar 05 02:04:37 functional-453214 kubelet[12324]: E0305 02:04:37.302636 12324 kuberuntime_manager.go:1261] container &Container{Name:kube-apiserver,Image:registry.k8s.io/kube-apiserver:v1.28.4,Command:[kube-apiserver --advertise-address=192.168.39.62 --allow-privileged=true --authorization-mode=Node,RBAC --client-ca-file=/var/lib/minikube/certs/ca.crt --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota --enable-bootstrap-token-auth=true --etcd-cafile=/var/lib/minikube/certs/etcd/ca.crt --etcd-certfile=/var/lib/minikube/certs/apiserver-etcd-client.crt --etcd-keyfile=/var/lib/minikube/certs/apiserver-etcd-client.key --etcd-servers=https://127.0.0.1:2379 --kubelet-client-certificate=/var/lib/minikube/certs/apiserver-kubelet-client.crt --kubelet-client-key=/var/lib/minikube/certs/apiserver-kubelet-client.key --kubelet-preferred-address-types=InternalIP,Exte
rnalIP,Hostname --proxy-client-cert-file=/var/lib/minikube/certs/front-proxy-client.crt --proxy-client-key-file=/var/lib/minikube/certs/front-proxy-client.key --requestheader-allowed-names=front-proxy-client --requestheader-client-ca-file=/var/lib/minikube/certs/front-proxy-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=8441 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/minikube/certs/sa.pub --service-account-signing-key-file=/var/lib/minikube/certs/sa.key --service-cluster-ip-range=10.96.0.0/12 --tls-cert-file=/var/lib/minikube/certs/apiserver.crt --tls-private-key-file=/var/lib/minikube/certs/apiserver.key],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{250 -3} {<nil>} 250m DecimalSI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount
{VolumeMount{Name:ca-certs,ReadOnly:true,MountPath:/etc/ssl/certs,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:k8s-certs,ReadOnly:true,MountPath:/var/lib/minikube/certs,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:usr-share-ca-certificates,ReadOnly:true,MountPath:/usr/share/ca-certificates,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{0 8441 },Host:192.168.39.62,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8441 },Host:192.168.39.62,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:15,PeriodSeconds:1,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Life
cycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/livez,Port:{0 8441 },Host:192.168.39.62,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:24,TerminationGracePeriodSeconds:nil,},ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod kube-apiserver-functional-453214_kube-system(9a0e6d087f52c1b953a5e8af6a9e74df): CreateContainerError: the container name "k8s_kube-apiserver_kube-apiserver-functional-453214_kube-system_9a0e6d087f52c1b953a5e8af6a9e74df_1" is already in use by 0d82b1ef935f59b92887abb5f1efb245bed9a9324490d82e0830e87499e4d14b. You have to remove that container to be able to reuse that name: that name is alread
y in use
Mar 05 02:04:37 functional-453214 kubelet[12324]: E0305 02:04:37.302680 12324 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CreateContainerError: \"the container name \\\"k8s_kube-apiserver_kube-apiserver-functional-453214_kube-system_9a0e6d087f52c1b953a5e8af6a9e74df_1\\\" is already in use by 0d82b1ef935f59b92887abb5f1efb245bed9a9324490d82e0830e87499e4d14b. You have to remove that container to be able to reuse that name: that name is already in use\"" pod="kube-system/kube-apiserver-functional-453214" podUID="9a0e6d087f52c1b953a5e8af6a9e74df"
-- /stdout --
** stderr **
E0305 02:04:37.247294 21681 logs.go:258] failed to output last start logs: failed to read file /home/jenkins/minikube-integration/17909-6453/.minikube/logs/lastStart.txt: bufio.Scanner: token too long
** /stderr **
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p functional-453214 -n functional-453214
helpers_test.go:254: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p functional-453214 -n functional-453214: exit status 2 (243.811763ms)
-- stdout --
Stopped
-- /stdout --
helpers_test.go:254: status error: exit status 2 (may be ok)
helpers_test.go:256: "functional-453214" apiserver is not running, skipping kubectl commands (state="Stopped")
--- FAIL: TestFunctional/serial/SoftStart (840.54s)