=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-964633 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0
start_stop_delete_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p old-k8s-version-964633 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0: exit status 80 (4m56.722247122s)
-- stdout --
* [old-k8s-version-964633] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=20506
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/20506-16361/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/20506-16361/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the docker driver based on user configuration
* Using Docker driver with root privileges
* Starting "old-k8s-version-964633" primary control-plane node in "old-k8s-version-964633" cluster
* Pulling base image v0.0.46-1741860993-20523 ...
* Creating docker container (CPUs=2, Memory=2200MB) ...
* Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Configuring RBAC rules ...
* Configuring CNI (Container Networking Interface) ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
* Enabled addons: storage-provisioner, default-storageclass
-- /stdout --
** stderr **
I0401 20:25:46.868961 318306 out.go:345] Setting OutFile to fd 1 ...
I0401 20:25:46.869282 318306 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0401 20:25:46.869309 318306 out.go:358] Setting ErrFile to fd 2...
I0401 20:25:46.869321 318306 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0401 20:25:46.869541 318306 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20506-16361/.minikube/bin
I0401 20:25:46.870342 318306 out.go:352] Setting JSON to false
I0401 20:25:46.871973 318306 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent","uptime":4093,"bootTime":1743535054,"procs":319,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1078-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0401 20:25:46.872100 318306 start.go:139] virtualization: kvm guest
I0401 20:25:46.874104 318306 out.go:177] * [old-k8s-version-964633] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0401 20:25:46.875548 318306 out.go:177] - MINIKUBE_LOCATION=20506
I0401 20:25:46.875574 318306 notify.go:220] Checking for updates...
I0401 20:25:46.877915 318306 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0401 20:25:46.879036 318306 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20506-16361/kubeconfig
I0401 20:25:46.880352 318306 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20506-16361/.minikube
I0401 20:25:46.881870 318306 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0401 20:25:46.883147 318306 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0401 20:25:46.885164 318306 config.go:182] Loaded profile config "bridge-460236": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0401 20:25:46.885318 318306 config.go:182] Loaded profile config "flannel-460236": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0401 20:25:46.885430 318306 config.go:182] Loaded profile config "kubernetes-upgrade-337773": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0401 20:25:46.885545 318306 driver.go:394] Setting default libvirt URI to qemu:///system
I0401 20:25:46.916063 318306 docker.go:123] docker version: linux-28.0.4:Docker Engine - Community
I0401 20:25:46.916172 318306 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0401 20:25:46.973726 318306 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:64 OomKillDisable:true NGoroutines:74 SystemTime:2025-04-01 20:25:46.963213114 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1078-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Ser
verErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0401 20:25:46.973912 318306 docker.go:318] overlay module found
I0401 20:25:46.975739 318306 out.go:177] * Using the docker driver based on user configuration
I0401 20:25:46.976896 318306 start.go:297] selected driver: docker
I0401 20:25:46.976911 318306 start.go:901] validating driver "docker" against <nil>
I0401 20:25:46.976922 318306 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0401 20:25:46.977881 318306 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0401 20:25:47.034208 318306 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:64 OomKillDisable:true NGoroutines:74 SystemTime:2025-04-01 20:25:47.023327431 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1078-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Ser
verErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0401 20:25:47.034401 318306 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0401 20:25:47.034669 318306 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0401 20:25:47.036569 318306 out.go:177] * Using Docker driver with root privileges
I0401 20:25:47.037710 318306 cni.go:84] Creating CNI manager for ""
I0401 20:25:47.037813 318306 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0401 20:25:47.037833 318306 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0401 20:25:47.037921 318306 start.go:340] cluster config:
{Name:old-k8s-version-964633 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-964633 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:
SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0401 20:25:47.039215 318306 out.go:177] * Starting "old-k8s-version-964633" primary control-plane node in "old-k8s-version-964633" cluster
I0401 20:25:47.040285 318306 cache.go:121] Beginning downloading kic base image for docker with crio
I0401 20:25:47.041350 318306 out.go:177] * Pulling base image v0.0.46-1741860993-20523 ...
I0401 20:25:47.042617 318306 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0401 20:25:47.042673 318306 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20506-16361/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4
I0401 20:25:47.042686 318306 cache.go:56] Caching tarball of preloaded images
I0401 20:25:47.042744 318306 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 in local docker daemon
I0401 20:25:47.042824 318306 preload.go:172] Found /home/jenkins/minikube-integration/20506-16361/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0401 20:25:47.042848 318306 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on crio
I0401 20:25:47.042978 318306 profile.go:143] Saving config to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/config.json ...
I0401 20:25:47.043004 318306 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/config.json: {Name:mkb41ce499848d37d634cb747175ed10985e5c21 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:25:47.066723 318306 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 in local docker daemon, skipping pull
I0401 20:25:47.066749 318306 cache.go:145] gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 exists in daemon, skipping load
I0401 20:25:47.066770 318306 cache.go:230] Successfully downloaded all kic artifacts
I0401 20:25:47.066811 318306 start.go:360] acquireMachinesLock for old-k8s-version-964633: {Name:mkcf81b33459cdbb9c109c2df72357b4097207d4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0401 20:25:47.066930 318306 start.go:364] duration metric: took 99.604µs to acquireMachinesLock for "old-k8s-version-964633"
I0401 20:25:47.066961 318306 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-964633 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-964633 Namespace:default APIServerHAVIP:
APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetri
cs:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0401 20:25:47.067064 318306 start.go:125] createHost starting for "" (driver="docker")
I0401 20:25:47.069077 318306 out.go:235] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0401 20:25:47.069340 318306 start.go:159] libmachine.API.Create for "old-k8s-version-964633" (driver="docker")
I0401 20:25:47.069375 318306 client.go:168] LocalClient.Create starting
I0401 20:25:47.069465 318306 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem
I0401 20:25:47.069514 318306 main.go:141] libmachine: Decoding PEM data...
I0401 20:25:47.069541 318306 main.go:141] libmachine: Parsing certificate...
I0401 20:25:47.069624 318306 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20506-16361/.minikube/certs/cert.pem
I0401 20:25:47.069659 318306 main.go:141] libmachine: Decoding PEM data...
I0401 20:25:47.069687 318306 main.go:141] libmachine: Parsing certificate...
I0401 20:25:47.070132 318306 cli_runner.go:164] Run: docker network inspect old-k8s-version-964633 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0401 20:25:47.090560 318306 cli_runner.go:211] docker network inspect old-k8s-version-964633 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0401 20:25:47.090646 318306 network_create.go:284] running [docker network inspect old-k8s-version-964633] to gather additional debugging logs...
I0401 20:25:47.090669 318306 cli_runner.go:164] Run: docker network inspect old-k8s-version-964633
W0401 20:25:47.111410 318306 cli_runner.go:211] docker network inspect old-k8s-version-964633 returned with exit code 1
I0401 20:25:47.111448 318306 network_create.go:287] error running [docker network inspect old-k8s-version-964633]: docker network inspect old-k8s-version-964633: exit status 1
stdout:
[]
stderr:
Error response from daemon: network old-k8s-version-964633 not found
I0401 20:25:47.111463 318306 network_create.go:289] output of [docker network inspect old-k8s-version-964633]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network old-k8s-version-964633 not found
** /stderr **
I0401 20:25:47.111607 318306 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0401 20:25:47.134093 318306 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-64a5a6ce16e8 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:de:10:1d:21:82:a2} reservation:<nil>}
I0401 20:25:47.135214 318306 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-81fe12fae94d IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:76:cc:45:d3:a7:72} reservation:<nil>}
I0401 20:25:47.136406 318306 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-d1f8fe59a39e IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:0e:15:5e:6b:fd:d1} reservation:<nil>}
I0401 20:25:47.137165 318306 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-54795f4c4e71 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:6a:29:cf:68:90:0b} reservation:<nil>}
I0401 20:25:47.138407 318306 network.go:206] using free private subnet 192.168.85.0/24: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001fe1250}
I0401 20:25:47.138447 318306 network_create.go:124] attempt to create docker network old-k8s-version-964633 192.168.85.0/24 with gateway 192.168.85.1 and MTU of 1500 ...
I0401 20:25:47.138516 318306 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.85.0/24 --gateway=192.168.85.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=old-k8s-version-964633 old-k8s-version-964633
I0401 20:25:47.201184 318306 network_create.go:108] docker network old-k8s-version-964633 192.168.85.0/24 created
I0401 20:25:47.201251 318306 kic.go:121] calculated static IP "192.168.85.2" for the "old-k8s-version-964633" container
I0401 20:25:47.201326 318306 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0401 20:25:47.222911 318306 cli_runner.go:164] Run: docker volume create old-k8s-version-964633 --label name.minikube.sigs.k8s.io=old-k8s-version-964633 --label created_by.minikube.sigs.k8s.io=true
I0401 20:25:47.243317 318306 oci.go:103] Successfully created a docker volume old-k8s-version-964633
I0401 20:25:47.243406 318306 cli_runner.go:164] Run: docker run --rm --name old-k8s-version-964633-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-964633 --entrypoint /usr/bin/test -v old-k8s-version-964633:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 -d /var/lib
I0401 20:25:47.925959 318306 oci.go:107] Successfully prepared a docker volume old-k8s-version-964633
I0401 20:25:47.925994 318306 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0401 20:25:47.926012 318306 kic.go:194] Starting extracting preloaded images to volume ...
I0401 20:25:47.926064 318306 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20506-16361/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-964633:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 -I lz4 -xf /preloaded.tar -C /extractDir
I0401 20:25:51.479311 318306 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20506-16361/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v old-k8s-version-964633:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 -I lz4 -xf /preloaded.tar -C /extractDir: (3.553199428s)
I0401 20:25:51.479347 318306 kic.go:203] duration metric: took 3.553329888s to extract preloaded images to volume ...
W0401 20:25:51.479496 318306 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0401 20:25:51.479599 318306 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0401 20:25:51.538364 318306 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname old-k8s-version-964633 --name old-k8s-version-964633 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=old-k8s-version-964633 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=old-k8s-version-964633 --network old-k8s-version-964633 --ip 192.168.85.2 --volume old-k8s-version-964633:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185
I0401 20:25:51.914123 318306 cli_runner.go:164] Run: docker container inspect old-k8s-version-964633 --format={{.State.Running}}
I0401 20:25:51.933509 318306 cli_runner.go:164] Run: docker container inspect old-k8s-version-964633 --format={{.State.Status}}
I0401 20:25:51.954003 318306 cli_runner.go:164] Run: docker exec old-k8s-version-964633 stat /var/lib/dpkg/alternatives/iptables
I0401 20:25:52.007465 318306 oci.go:144] the created container "old-k8s-version-964633" has a running status.
I0401 20:25:52.007506 318306 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20506-16361/.minikube/machines/old-k8s-version-964633/id_rsa...
I0401 20:25:52.641691 318306 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20506-16361/.minikube/machines/old-k8s-version-964633/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0401 20:25:52.665483 318306 cli_runner.go:164] Run: docker container inspect old-k8s-version-964633 --format={{.State.Status}}
I0401 20:25:52.685896 318306 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0401 20:25:52.685923 318306 kic_runner.go:114] Args: [docker exec --privileged old-k8s-version-964633 chown docker:docker /home/docker/.ssh/authorized_keys]
I0401 20:25:52.731004 318306 cli_runner.go:164] Run: docker container inspect old-k8s-version-964633 --format={{.State.Status}}
I0401 20:25:52.753165 318306 machine.go:93] provisionDockerMachine start ...
I0401 20:25:52.753236 318306 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-964633
I0401 20:25:52.776340 318306 main.go:141] libmachine: Using SSH client type: native
I0401 20:25:52.776675 318306 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 127.0.0.1 33088 <nil> <nil>}
I0401 20:25:52.776696 318306 main.go:141] libmachine: About to run SSH command:
hostname
I0401 20:25:52.913502 318306 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-964633
I0401 20:25:52.913544 318306 ubuntu.go:169] provisioning hostname "old-k8s-version-964633"
I0401 20:25:52.913610 318306 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-964633
I0401 20:25:52.933307 318306 main.go:141] libmachine: Using SSH client type: native
I0401 20:25:52.933507 318306 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 127.0.0.1 33088 <nil> <nil>}
I0401 20:25:52.933537 318306 main.go:141] libmachine: About to run SSH command:
sudo hostname old-k8s-version-964633 && echo "old-k8s-version-964633" | sudo tee /etc/hostname
I0401 20:25:53.084568 318306 main.go:141] libmachine: SSH cmd err, output: <nil>: old-k8s-version-964633
I0401 20:25:53.084651 318306 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-964633
I0401 20:25:53.106281 318306 main.go:141] libmachine: Using SSH client type: native
I0401 20:25:53.106550 318306 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 127.0.0.1 33088 <nil> <nil>}
I0401 20:25:53.106575 318306 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-964633' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-964633/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-964633' | sudo tee -a /etc/hosts;
fi
fi
I0401 20:25:53.258421 318306 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0401 20:25:53.258451 318306 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/20506-16361/.minikube CaCertPath:/home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20506-16361/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20506-16361/.minikube}
I0401 20:25:53.258502 318306 ubuntu.go:177] setting up certificates
I0401 20:25:53.258517 318306 provision.go:84] configureAuth start
I0401 20:25:53.258571 318306 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-964633
I0401 20:25:53.281400 318306 provision.go:143] copyHostCerts
I0401 20:25:53.281482 318306 exec_runner.go:144] found /home/jenkins/minikube-integration/20506-16361/.minikube/ca.pem, removing ...
I0401 20:25:53.281493 318306 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20506-16361/.minikube/ca.pem
I0401 20:25:53.281570 318306 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20506-16361/.minikube/ca.pem (1078 bytes)
I0401 20:25:53.281684 318306 exec_runner.go:144] found /home/jenkins/minikube-integration/20506-16361/.minikube/cert.pem, removing ...
I0401 20:25:53.281703 318306 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20506-16361/.minikube/cert.pem
I0401 20:25:53.281788 318306 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20506-16361/.minikube/cert.pem (1123 bytes)
I0401 20:25:53.281957 318306 exec_runner.go:144] found /home/jenkins/minikube-integration/20506-16361/.minikube/key.pem, removing ...
I0401 20:25:53.281972 318306 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20506-16361/.minikube/key.pem
I0401 20:25:53.282011 318306 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20506-16361/.minikube/key.pem (1675 bytes)
I0401 20:25:53.282087 318306 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20506-16361/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca-key.pem org=jenkins.old-k8s-version-964633 san=[127.0.0.1 192.168.85.2 localhost minikube old-k8s-version-964633]
I0401 20:25:53.615409 318306 provision.go:177] copyRemoteCerts
I0401 20:25:53.615524 318306 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0401 20:25:53.615588 318306 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-964633
I0401 20:25:53.641992 318306 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33088 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/old-k8s-version-964633/id_rsa Username:docker}
I0401 20:25:53.747397 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0401 20:25:53.782377 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0401 20:25:53.818803 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/machines/server.pem --> /etc/docker/server.pem (1233 bytes)
I0401 20:25:53.874023 318306 provision.go:87] duration metric: took 615.492089ms to configureAuth
I0401 20:25:53.874054 318306 ubuntu.go:193] setting minikube options for container-runtime
I0401 20:25:53.874235 318306 config.go:182] Loaded profile config "old-k8s-version-964633": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0401 20:25:53.874364 318306 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-964633
I0401 20:25:53.897584 318306 main.go:141] libmachine: Using SSH client type: native
I0401 20:25:53.897869 318306 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 127.0.0.1 33088 <nil> <nil>}
I0401 20:25:53.897893 318306 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0401 20:25:54.204857 318306 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0401 20:25:54.204889 318306 machine.go:96] duration metric: took 1.45170283s to provisionDockerMachine
I0401 20:25:54.204902 318306 client.go:171] duration metric: took 7.135519249s to LocalClient.Create
I0401 20:25:54.204925 318306 start.go:167] duration metric: took 7.135585322s to libmachine.API.Create "old-k8s-version-964633"
I0401 20:25:54.204935 318306 start.go:293] postStartSetup for "old-k8s-version-964633" (driver="docker")
I0401 20:25:54.204948 318306 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0401 20:25:54.205015 318306 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0401 20:25:54.205060 318306 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-964633
I0401 20:25:54.226446 318306 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33088 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/old-k8s-version-964633/id_rsa Username:docker}
I0401 20:25:54.339195 318306 ssh_runner.go:195] Run: cat /etc/os-release
I0401 20:25:54.343892 318306 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0401 20:25:54.343934 318306 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0401 20:25:54.343946 318306 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0401 20:25:54.343954 318306 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0401 20:25:54.343965 318306 filesync.go:126] Scanning /home/jenkins/minikube-integration/20506-16361/.minikube/addons for local assets ...
I0401 20:25:54.344027 318306 filesync.go:126] Scanning /home/jenkins/minikube-integration/20506-16361/.minikube/files for local assets ...
I0401 20:25:54.344139 318306 filesync.go:149] local asset: /home/jenkins/minikube-integration/20506-16361/.minikube/files/etc/ssl/certs/231632.pem -> 231632.pem in /etc/ssl/certs
I0401 20:25:54.344266 318306 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0401 20:25:54.353849 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/files/etc/ssl/certs/231632.pem --> /etc/ssl/certs/231632.pem (1708 bytes)
I0401 20:25:54.395190 318306 start.go:296] duration metric: took 190.240724ms for postStartSetup
I0401 20:25:54.395616 318306 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-964633
I0401 20:25:54.415533 318306 profile.go:143] Saving config to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/config.json ...
I0401 20:25:54.415765 318306 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0401 20:25:54.415798 318306 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-964633
I0401 20:25:54.459355 318306 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33088 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/old-k8s-version-964633/id_rsa Username:docker}
I0401 20:25:54.561329 318306 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0401 20:25:54.566966 318306 start.go:128] duration metric: took 7.499885209s to createHost
I0401 20:25:54.566990 318306 start.go:83] releasing machines lock for "old-k8s-version-964633", held for 7.500046336s
I0401 20:25:54.567055 318306 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-964633
I0401 20:25:54.589620 318306 ssh_runner.go:195] Run: cat /version.json
I0401 20:25:54.589683 318306 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-964633
I0401 20:25:54.589831 318306 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0401 20:25:54.589927 318306 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-964633
I0401 20:25:54.617148 318306 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33088 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/old-k8s-version-964633/id_rsa Username:docker}
I0401 20:25:54.619127 318306 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33088 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/old-k8s-version-964633/id_rsa Username:docker}
I0401 20:25:54.809087 318306 ssh_runner.go:195] Run: systemctl --version
I0401 20:25:54.814501 318306 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0401 20:25:54.965066 318306 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0401 20:25:54.971071 318306 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0401 20:25:54.993325 318306 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0401 20:25:54.993396 318306 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0401 20:25:55.029677 318306 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0401 20:25:55.029699 318306 start.go:495] detecting cgroup driver to use...
I0401 20:25:55.029736 318306 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0401 20:25:55.029819 318306 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0401 20:25:55.046597 318306 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0401 20:25:55.060877 318306 docker.go:217] disabling cri-docker service (if available) ...
I0401 20:25:55.060926 318306 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0401 20:25:55.075695 318306 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0401 20:25:55.094020 318306 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0401 20:25:55.199275 318306 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0401 20:25:55.309864 318306 docker.go:233] disabling docker service ...
I0401 20:25:55.309931 318306 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0401 20:25:55.342052 318306 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0401 20:25:55.356875 318306 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0401 20:25:55.464654 318306 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0401 20:25:55.562715 318306 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0401 20:25:55.575265 318306 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0401 20:25:55.592047 318306 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
I0401 20:25:55.592099 318306 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:25:55.602306 318306 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0401 20:25:55.602371 318306 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:25:55.613062 318306 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:25:55.624247 318306 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:25:55.634727 318306 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0401 20:25:55.644502 318306 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0401 20:25:55.653897 318306 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0401 20:25:55.664593 318306 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 20:25:55.753561 318306 ssh_runner.go:195] Run: sudo systemctl restart crio
I0401 20:25:56.072365 318306 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0401 20:25:56.072442 318306 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0401 20:25:56.076963 318306 start.go:563] Will wait 60s for crictl version
I0401 20:25:56.077029 318306 ssh_runner.go:195] Run: which crictl
I0401 20:25:56.081144 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0401 20:25:56.121586 318306 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0401 20:25:56.121710 318306 ssh_runner.go:195] Run: crio --version
I0401 20:25:56.164793 318306 ssh_runner.go:195] Run: crio --version
I0401 20:25:56.210746 318306 out.go:177] * Preparing Kubernetes v1.20.0 on CRI-O 1.24.6 ...
I0401 20:25:56.211937 318306 cli_runner.go:164] Run: docker network inspect old-k8s-version-964633 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0401 20:25:56.231325 318306 ssh_runner.go:195] Run: grep 192.168.85.1 host.minikube.internal$ /etc/hosts
I0401 20:25:56.235503 318306 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0401 20:25:56.246920 318306 kubeadm.go:883] updating cluster {Name:old-k8s-version-964633 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-964633 Namespace:default APIServerHAVIP: APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fals
e CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0401 20:25:56.247046 318306 preload.go:131] Checking if preload exists for k8s version v1.20.0 and runtime crio
I0401 20:25:56.247107 318306 ssh_runner.go:195] Run: sudo crictl images --output json
I0401 20:25:56.310159 318306 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0401 20:25:56.310244 318306 ssh_runner.go:195] Run: which lz4
I0401 20:25:56.314491 318306 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I0401 20:25:56.318031 318306 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0401 20:25:56.318093 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (473237281 bytes)
I0401 20:25:57.522133 318306 crio.go:462] duration metric: took 1.207678915s to copy over tarball
I0401 20:25:57.522197 318306 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I0401 20:26:01.262109 318306 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (3.739881399s)
I0401 20:26:01.262141 318306 crio.go:469] duration metric: took 3.739980892s to extract the tarball
I0401 20:26:01.262150 318306 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0401 20:26:01.346404 318306 ssh_runner.go:195] Run: sudo crictl images --output json
I0401 20:26:01.392938 318306 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.20.0". assuming images are not preloaded.
I0401 20:26:01.392960 318306 cache_images.go:88] LoadCachedImages start: [registry.k8s.io/kube-apiserver:v1.20.0 registry.k8s.io/kube-controller-manager:v1.20.0 registry.k8s.io/kube-scheduler:v1.20.0 registry.k8s.io/kube-proxy:v1.20.0 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.13-0 registry.k8s.io/coredns:1.7.0 gcr.io/k8s-minikube/storage-provisioner:v5]
I0401 20:26:01.393024 318306 image.go:135] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
I0401 20:26:01.393208 318306 image.go:135] retrieving image: registry.k8s.io/kube-apiserver:v1.20.0
I0401 20:26:01.393295 318306 image.go:135] retrieving image: registry.k8s.io/kube-controller-manager:v1.20.0
I0401 20:26:01.393364 318306 image.go:135] retrieving image: registry.k8s.io/kube-scheduler:v1.20.0
I0401 20:26:01.393428 318306 image.go:135] retrieving image: registry.k8s.io/kube-proxy:v1.20.0
I0401 20:26:01.393506 318306 image.go:135] retrieving image: registry.k8s.io/pause:3.2
I0401 20:26:01.393586 318306 image.go:135] retrieving image: registry.k8s.io/etcd:3.4.13-0
I0401 20:26:01.393651 318306 image.go:135] retrieving image: registry.k8s.io/coredns:1.7.0
I0401 20:26:01.397429 318306 image.go:178] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
I0401 20:26:01.398604 318306 image.go:178] daemon lookup for registry.k8s.io/coredns:1.7.0: Error response from daemon: No such image: registry.k8s.io/coredns:1.7.0
I0401 20:26:01.398624 318306 image.go:178] daemon lookup for registry.k8s.io/kube-scheduler:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.20.0
I0401 20:26:01.398637 318306 image.go:178] daemon lookup for registry.k8s.io/kube-controller-manager:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.20.0
I0401 20:26:01.398633 318306 image.go:178] daemon lookup for registry.k8s.io/kube-apiserver:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.20.0
I0401 20:26:01.398678 318306 image.go:178] daemon lookup for registry.k8s.io/kube-proxy:v1.20.0: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.20.0
I0401 20:26:01.398624 318306 image.go:178] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
I0401 20:26:01.398726 318306 image.go:178] daemon lookup for registry.k8s.io/etcd:3.4.13-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.13-0
I0401 20:26:01.593174 318306 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.13-0
I0401 20:26:01.623784 318306 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.20.0
I0401 20:26:01.624051 318306 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
I0401 20:26:01.669865 318306 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.20.0
I0401 20:26:01.670928 318306 cache_images.go:116] "registry.k8s.io/etcd:3.4.13-0" needs transfer: "registry.k8s.io/etcd:3.4.13-0" does not exist at hash "0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934" in container runtime
I0401 20:26:01.670963 318306 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.13-0
I0401 20:26:01.670998 318306 ssh_runner.go:195] Run: which crictl
I0401 20:26:01.672117 318306 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.20.0
I0401 20:26:01.766128 318306 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.7.0
I0401 20:26:01.769577 318306 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
I0401 20:26:01.769622 318306 cri.go:218] Removing image: registry.k8s.io/pause:3.2
I0401 20:26:01.769671 318306 ssh_runner.go:195] Run: which crictl
I0401 20:26:01.769768 318306 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.20.0" needs transfer: "registry.k8s.io/kube-apiserver:v1.20.0" does not exist at hash "ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99" in container runtime
I0401 20:26:01.769805 318306 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.20.0
I0401 20:26:01.769839 318306 ssh_runner.go:195] Run: which crictl
I0401 20:26:01.769909 318306 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.20.0" needs transfer: "registry.k8s.io/kube-proxy:v1.20.0" does not exist at hash "10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc" in container runtime
I0401 20:26:01.769937 318306 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.20.0
I0401 20:26:01.769962 318306 ssh_runner.go:195] Run: which crictl
I0401 20:26:01.770024 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0401 20:26:01.770080 318306 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.20.0" needs transfer: "registry.k8s.io/kube-controller-manager:v1.20.0" does not exist at hash "b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080" in container runtime
I0401 20:26:01.770096 318306 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.20.0
I0401 20:26:01.770121 318306 ssh_runner.go:195] Run: which crictl
I0401 20:26:01.770961 318306 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.20.0
I0401 20:26:01.855908 318306 cache_images.go:116] "registry.k8s.io/coredns:1.7.0" needs transfer: "registry.k8s.io/coredns:1.7.0" does not exist at hash "bfe3a36ebd2528b454be6aebece806db5b40407b833e2af9617bf39afaff8c16" in container runtime
I0401 20:26:01.855951 318306 cri.go:218] Removing image: registry.k8s.io/coredns:1.7.0
I0401 20:26:01.855999 318306 ssh_runner.go:195] Run: which crictl
I0401 20:26:01.870093 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0401 20:26:01.870116 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0401 20:26:01.870133 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0401 20:26:01.870173 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0401 20:26:01.870194 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0401 20:26:01.877649 318306 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.20.0" needs transfer: "registry.k8s.io/kube-scheduler:v1.20.0" does not exist at hash "3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899" in container runtime
I0401 20:26:01.877692 318306 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.20.0
I0401 20:26:01.877760 318306 ssh_runner.go:195] Run: which crictl
I0401 20:26:01.877839 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0401 20:26:02.051702 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.13-0
I0401 20:26:02.051817 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0401 20:26:02.051885 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0401 20:26:02.051947 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0401 20:26:02.051997 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0401 20:26:02.062679 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0401 20:26:02.062744 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0401 20:26:02.273804 318306 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20506-16361/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0
I0401 20:26:02.273945 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.20.0
I0401 20:26:02.273991 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.20.0
I0401 20:26:02.274033 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.20.0
I0401 20:26:02.274071 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
I0401 20:26:02.274113 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0401 20:26:02.274152 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.7.0
I0401 20:26:02.452934 318306 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.20.0
I0401 20:26:02.453057 318306 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20506-16361/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
I0401 20:26:02.453120 318306 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20506-16361/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.20.0
I0401 20:26:02.453171 318306 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20506-16361/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.20.0
I0401 20:26:02.453229 318306 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20506-16361/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.20.0
I0401 20:26:02.453279 318306 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20506-16361/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.7.0
I0401 20:26:02.510483 318306 cache_images.go:289] Loading image from: /home/jenkins/minikube-integration/20506-16361/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.20.0
I0401 20:26:02.583862 318306 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
I0401 20:26:02.748489 318306 cache_images.go:92] duration metric: took 1.355511786s to LoadCachedImages
W0401 20:26:02.748573 318306 out.go:270] X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20506-16361/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
X Unable to load cached images: LoadCachedImages: stat /home/jenkins/minikube-integration/20506-16361/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.13-0: no such file or directory
I0401 20:26:02.748585 318306 kubeadm.go:934] updating node { 192.168.85.2 8443 v1.20.0 crio true true} ...
I0401 20:26:02.748686 318306 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.20.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=old-k8s-version-964633 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-964633 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0401 20:26:02.748780 318306 ssh_runner.go:195] Run: crio config
I0401 20:26:02.849548 318306 cni.go:84] Creating CNI manager for ""
I0401 20:26:02.849571 318306 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0401 20:26:02.849583 318306 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0401 20:26:02.849607 318306 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.20.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-964633 NodeName:old-k8s-version-964633 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPo
dPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
I0401 20:26:02.850140 318306 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/crio/crio.sock
name: "old-k8s-version-964633"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.20.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0401 20:26:02.850219 318306 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.20.0
I0401 20:26:02.865078 318306 binaries.go:44] Found k8s binaries, skipping transfer
I0401 20:26:02.865163 318306 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0401 20:26:02.882272 318306 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (480 bytes)
I0401 20:26:02.905086 318306 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0401 20:26:02.927769 318306 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2117 bytes)
I0401 20:26:02.948596 318306 ssh_runner.go:195] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0401 20:26:02.953796 318306 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0401 20:26:02.968323 318306 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 20:26:03.078699 318306 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0401 20:26:03.101534 318306 certs.go:68] Setting up /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633 for IP: 192.168.85.2
I0401 20:26:03.101565 318306 certs.go:194] generating shared ca certs ...
I0401 20:26:03.101587 318306 certs.go:226] acquiring lock for ca certs: {Name:mkd05003433d6acd6ff5e2aab58050e1004ceb11 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:03.101835 318306 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20506-16361/.minikube/ca.key
I0401 20:26:03.101896 318306 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20506-16361/.minikube/proxy-client-ca.key
I0401 20:26:03.101906 318306 certs.go:256] generating profile certs ...
I0401 20:26:03.101984 318306 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/client.key
I0401 20:26:03.102003 318306 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/client.crt with IP's: []
I0401 20:26:03.572399 318306 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/client.crt ...
I0401 20:26:03.572427 318306 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/client.crt: {Name:mkc20cce4a0884d62bf870044c4c9a7efad88228 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:03.572608 318306 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/client.key ...
I0401 20:26:03.572628 318306 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/client.key: {Name:mka283b2e7e42fee2fafad8cc1594a8fd919db4a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:03.572745 318306 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/apiserver.key.4d8a9adb
I0401 20:26:03.572769 318306 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/apiserver.crt.4d8a9adb with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.85.2]
I0401 20:26:03.851325 318306 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/apiserver.crt.4d8a9adb ...
I0401 20:26:03.851360 318306 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/apiserver.crt.4d8a9adb: {Name:mkac69ae9b976c12286617a4b4474554bcb8e893 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:03.851593 318306 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/apiserver.key.4d8a9adb ...
I0401 20:26:03.851614 318306 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/apiserver.key.4d8a9adb: {Name:mk28216c6f49ef6faecf1e696ba063e0b7862608 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:03.851743 318306 certs.go:381] copying /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/apiserver.crt.4d8a9adb -> /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/apiserver.crt
I0401 20:26:03.851840 318306 certs.go:385] copying /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/apiserver.key.4d8a9adb -> /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/apiserver.key
I0401 20:26:03.851919 318306 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/proxy-client.key
I0401 20:26:03.851945 318306 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/proxy-client.crt with IP's: []
I0401 20:26:04.162953 318306 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/proxy-client.crt ...
I0401 20:26:04.162984 318306 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/proxy-client.crt: {Name:mkd1dd4963ede83ed3f6c579f55c700bb427c976 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:04.163154 318306 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/proxy-client.key ...
I0401 20:26:04.163172 318306 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/proxy-client.key: {Name:mkc0d9879a41d0f866e3a040461dec3555e322a1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:04.163414 318306 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/23163.pem (1338 bytes)
W0401 20:26:04.163470 318306 certs.go:480] ignoring /home/jenkins/minikube-integration/20506-16361/.minikube/certs/23163_empty.pem, impossibly tiny 0 bytes
I0401 20:26:04.163482 318306 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca-key.pem (1679 bytes)
I0401 20:26:04.163504 318306 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem (1078 bytes)
I0401 20:26:04.163529 318306 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/cert.pem (1123 bytes)
I0401 20:26:04.163549 318306 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/key.pem (1675 bytes)
I0401 20:26:04.163584 318306 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/files/etc/ssl/certs/231632.pem (1708 bytes)
I0401 20:26:04.164210 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0401 20:26:04.194183 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0401 20:26:04.221537 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0401 20:26:04.250424 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0401 20:26:04.281460 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I0401 20:26:04.319634 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0401 20:26:04.354718 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0401 20:26:04.387916 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/old-k8s-version-964633/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0401 20:26:04.421729 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0401 20:26:04.452771 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/certs/23163.pem --> /usr/share/ca-certificates/23163.pem (1338 bytes)
I0401 20:26:04.487848 318306 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/files/etc/ssl/certs/231632.pem --> /usr/share/ca-certificates/231632.pem (1708 bytes)
I0401 20:26:04.517602 318306 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0401 20:26:04.536069 318306 ssh_runner.go:195] Run: openssl version
I0401 20:26:04.542406 318306 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0401 20:26:04.554470 318306 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0401 20:26:04.558885 318306 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 1 19:46 /usr/share/ca-certificates/minikubeCA.pem
I0401 20:26:04.558944 318306 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0401 20:26:04.566739 318306 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0401 20:26:04.576277 318306 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/23163.pem && ln -fs /usr/share/ca-certificates/23163.pem /etc/ssl/certs/23163.pem"
I0401 20:26:04.586045 318306 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/23163.pem
I0401 20:26:04.591030 318306 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 1 19:52 /usr/share/ca-certificates/23163.pem
I0401 20:26:04.591096 318306 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/23163.pem
I0401 20:26:04.599545 318306 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/23163.pem /etc/ssl/certs/51391683.0"
I0401 20:26:04.612828 318306 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/231632.pem && ln -fs /usr/share/ca-certificates/231632.pem /etc/ssl/certs/231632.pem"
I0401 20:26:04.623327 318306 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/231632.pem
I0401 20:26:04.627672 318306 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 1 19:52 /usr/share/ca-certificates/231632.pem
I0401 20:26:04.627725 318306 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/231632.pem
I0401 20:26:04.634941 318306 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/231632.pem /etc/ssl/certs/3ec20f2e.0"
I0401 20:26:04.646552 318306 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0401 20:26:04.650551 318306 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0401 20:26:04.650614 318306 kubeadm.go:392] StartCluster: {Name:old-k8s-version-964633 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-964633 Namespace:default APIServerHAVIP: APIServerName:minikube
CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false C
ustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0401 20:26:04.650696 318306 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0401 20:26:04.650739 318306 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0401 20:26:04.715533 318306 cri.go:89] found id: ""
I0401 20:26:04.715612 318306 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0401 20:26:04.727157 318306 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0401 20:26:04.737898 318306 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0401 20:26:04.737966 318306 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0401 20:26:04.747781 318306 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0401 20:26:04.747822 318306 kubeadm.go:157] found existing configuration files:
I0401 20:26:04.747873 318306 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0401 20:26:04.759866 318306 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0401 20:26:04.759911 318306 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0401 20:26:04.770127 318306 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0401 20:26:04.780017 318306 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0401 20:26:04.780079 318306 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0401 20:26:04.791126 318306 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0401 20:26:04.804509 318306 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0401 20:26:04.804571 318306 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0401 20:26:04.814989 318306 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0401 20:26:04.828539 318306 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0401 20:26:04.828611 318306 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0401 20:26:04.839458 318306 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.20.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0401 20:26:04.973534 318306 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1078-gcp\n", err: exit status 1
I0401 20:26:05.091493 318306 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0401 20:26:26.214362 318306 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0401 20:26:26.214472 318306 kubeadm.go:310] [preflight] Running pre-flight checks
I0401 20:26:26.214629 318306 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0401 20:26:26.214721 318306 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1078-gcp[0m
I0401 20:26:26.214772 318306 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0401 20:26:26.214839 318306 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0401 20:26:26.214911 318306 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0401 20:26:26.214980 318306 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0401 20:26:26.215050 318306 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0401 20:26:26.215120 318306 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0401 20:26:26.215191 318306 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0401 20:26:26.215257 318306 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0401 20:26:26.215328 318306 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0401 20:26:26.215434 318306 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0401 20:26:26.215559 318306 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0401 20:26:26.215673 318306 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0401 20:26:26.215753 318306 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0401 20:26:26.217135 318306 out.go:235] - Generating certificates and keys ...
I0401 20:26:26.217235 318306 kubeadm.go:310] [certs] Using existing ca certificate authority
I0401 20:26:26.217313 318306 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0401 20:26:26.217422 318306 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0401 20:26:26.217503 318306 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0401 20:26:26.217623 318306 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0401 20:26:26.217724 318306 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0401 20:26:26.217832 318306 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0401 20:26:26.218026 318306 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-964633] and IPs [192.168.85.2 127.0.0.1 ::1]
I0401 20:26:26.218112 318306 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0401 20:26:26.218299 318306 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-964633] and IPs [192.168.85.2 127.0.0.1 ::1]
I0401 20:26:26.218403 318306 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0401 20:26:26.218506 318306 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0401 20:26:26.218576 318306 kubeadm.go:310] [certs] Generating "sa" key and public key
I0401 20:26:26.218652 318306 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0401 20:26:26.218719 318306 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0401 20:26:26.218796 318306 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0401 20:26:26.218887 318306 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0401 20:26:26.218972 318306 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0401 20:26:26.219140 318306 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0401 20:26:26.219260 318306 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0401 20:26:26.219320 318306 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0401 20:26:26.219415 318306 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0401 20:26:26.221597 318306 out.go:235] - Booting up control plane ...
I0401 20:26:26.221711 318306 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0401 20:26:26.221832 318306 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0401 20:26:26.221920 318306 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0401 20:26:26.222041 318306 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0401 20:26:26.222287 318306 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0401 20:26:26.222368 318306 kubeadm.go:310] [apiclient] All control plane components are healthy after 16.002573 seconds
I0401 20:26:26.222512 318306 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0401 20:26:26.222668 318306 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config-1.20" in namespace kube-system with the configuration for the kubelets in the cluster
I0401 20:26:26.222767 318306 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0401 20:26:26.223041 318306 kubeadm.go:310] [mark-control-plane] Marking the node old-k8s-version-964633 as control-plane by adding the labels "node-role.kubernetes.io/master=''" and "node-role.kubernetes.io/control-plane='' (deprecated)"
I0401 20:26:26.223123 318306 kubeadm.go:310] [bootstrap-token] Using token: fypcag.rftl5mjclps03e3q
I0401 20:26:26.224467 318306 out.go:235] - Configuring RBAC rules ...
I0401 20:26:26.224625 318306 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0401 20:26:26.224753 318306 kubeadm.go:310] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0401 20:26:26.224943 318306 kubeadm.go:310] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0401 20:26:26.225135 318306 kubeadm.go:310] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0401 20:26:26.225281 318306 kubeadm.go:310] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0401 20:26:26.225432 318306 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0401 20:26:26.225610 318306 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0401 20:26:26.225682 318306 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0401 20:26:26.225797 318306 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0401 20:26:26.225810 318306 kubeadm.go:310]
I0401 20:26:26.225889 318306 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0401 20:26:26.225899 318306 kubeadm.go:310]
I0401 20:26:26.226006 318306 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0401 20:26:26.226017 318306 kubeadm.go:310]
I0401 20:26:26.226057 318306 kubeadm.go:310] mkdir -p $HOME/.kube
I0401 20:26:26.226155 318306 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0401 20:26:26.226230 318306 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0401 20:26:26.226240 318306 kubeadm.go:310]
I0401 20:26:26.226321 318306 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0401 20:26:26.226340 318306 kubeadm.go:310]
I0401 20:26:26.226412 318306 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0401 20:26:26.226428 318306 kubeadm.go:310]
I0401 20:26:26.226497 318306 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0401 20:26:26.226616 318306 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0401 20:26:26.226709 318306 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0401 20:26:26.226724 318306 kubeadm.go:310]
I0401 20:26:26.226842 318306 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0401 20:26:26.226966 318306 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0401 20:26:26.226982 318306 kubeadm.go:310]
I0401 20:26:26.227118 318306 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token fypcag.rftl5mjclps03e3q \
I0401 20:26:26.227294 318306 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:3d93fb35a345f61a73d1a5c805e66c154297b8bb9225b71f12b591697818ec37 \
I0401 20:26:26.227335 318306 kubeadm.go:310] --control-plane
I0401 20:26:26.227345 318306 kubeadm.go:310]
I0401 20:26:26.227466 318306 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0401 20:26:26.227481 318306 kubeadm.go:310]
I0401 20:26:26.227595 318306 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token fypcag.rftl5mjclps03e3q \
I0401 20:26:26.227775 318306 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:3d93fb35a345f61a73d1a5c805e66c154297b8bb9225b71f12b591697818ec37
I0401 20:26:26.227801 318306 cni.go:84] Creating CNI manager for ""
I0401 20:26:26.227810 318306 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0401 20:26:26.229908 318306 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0401 20:26:26.231065 318306 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0401 20:26:26.234959 318306 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.20.0/kubectl ...
I0401 20:26:26.234975 318306 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0401 20:26:26.252673 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0401 20:26:26.634659 318306 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0401 20:26:26.634773 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:26.634829 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes old-k8s-version-964633 minikube.k8s.io/updated_at=2025_04_01T20_26_26_0700 minikube.k8s.io/version=v1.35.0 minikube.k8s.io/commit=73c6e1c927350a51068882397e0642f8dfb63f2a minikube.k8s.io/name=old-k8s-version-964633 minikube.k8s.io/primary=true
I0401 20:26:26.766148 318306 ops.go:34] apiserver oom_adj: -16
I0401 20:26:26.766281 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:27.266570 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:27.766918 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:28.266941 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:28.766395 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:29.266515 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:29.767351 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:30.266722 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:30.766361 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:31.266995 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:31.766839 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:32.267336 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:32.767370 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:33.266984 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:33.766978 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:34.266517 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:34.766984 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:35.266596 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:35.767257 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:36.266597 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:36.767309 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:37.266993 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:37.766426 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:38.266400 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:38.767030 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:39.266608 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:39.766436 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:40.267001 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:40.767416 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:41.266944 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:41.766662 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:42.266968 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:42.466972 318306 kubeadm.go:1113] duration metric: took 15.832229799s to wait for elevateKubeSystemPrivileges
I0401 20:26:42.467009 318306 kubeadm.go:394] duration metric: took 37.816397182s to StartCluster
I0401 20:26:42.467028 318306 settings.go:142] acquiring lock: {Name:mk97b1c786280c2571e72d442bae7d86f342cc2c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:42.467098 318306 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/20506-16361/kubeconfig
I0401 20:26:42.469304 318306 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/kubeconfig: {Name:mk2c8ba46a7915412f877cabac9093904e092601 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:42.469558 318306 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0401 20:26:42.469667 318306 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0401 20:26:42.469700 318306 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0401 20:26:42.469867 318306 config.go:182] Loaded profile config "old-k8s-version-964633": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0401 20:26:42.469873 318306 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-964633"
I0401 20:26:42.469881 318306 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-964633"
I0401 20:26:42.469894 318306 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-964633"
I0401 20:26:42.469901 318306 addons.go:238] Setting addon storage-provisioner=true in "old-k8s-version-964633"
I0401 20:26:42.469937 318306 host.go:66] Checking if "old-k8s-version-964633" exists ...
I0401 20:26:42.470179 318306 cli_runner.go:164] Run: docker container inspect old-k8s-version-964633 --format={{.State.Status}}
I0401 20:26:42.470479 318306 cli_runner.go:164] Run: docker container inspect old-k8s-version-964633 --format={{.State.Status}}
I0401 20:26:42.471691 318306 out.go:177] * Verifying Kubernetes components...
I0401 20:26:42.472775 318306 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 20:26:42.493228 318306 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0401 20:26:42.493646 318306 addons.go:238] Setting addon default-storageclass=true in "old-k8s-version-964633"
I0401 20:26:42.493679 318306 host.go:66] Checking if "old-k8s-version-964633" exists ...
I0401 20:26:42.494020 318306 cli_runner.go:164] Run: docker container inspect old-k8s-version-964633 --format={{.State.Status}}
I0401 20:26:42.494633 318306 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0401 20:26:42.494650 318306 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0401 20:26:42.494699 318306 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-964633
I0401 20:26:42.515738 318306 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
I0401 20:26:42.515763 318306 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0401 20:26:42.515813 318306 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-964633
I0401 20:26:42.516120 318306 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33088 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/old-k8s-version-964633/id_rsa Username:docker}
I0401 20:26:42.550355 318306 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33088 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/old-k8s-version-964633/id_rsa Username:docker}
I0401 20:26:42.656623 318306 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0401 20:26:42.680516 318306 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.85.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.20.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0401 20:26:42.724595 318306 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0401 20:26:42.836425 318306 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0401 20:26:43.519128 318306 start.go:971] {"host.minikube.internal": 192.168.85.1} host record injected into CoreDNS's ConfigMap
I0401 20:26:43.520669 318306 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-964633" to be "Ready" ...
I0401 20:26:43.534575 318306 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
I0401 20:26:43.535896 318306 addons.go:514] duration metric: took 1.066200808s for enable addons: enabled=[storage-provisioner default-storageclass]
I0401 20:26:44.025251 318306 kapi.go:214] "coredns" deployment in "kube-system" namespace and "old-k8s-version-964633" context rescaled to 1 replicas
I0401 20:26:45.524906 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:26:48.024193 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:26:50.524047 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:26:52.524370 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:26:54.524429 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:26:56.524842 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:26:59.024502 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:01.523890 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:03.524529 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:06.023956 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:08.024174 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:10.024345 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:12.524277 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:15.024349 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:17.024507 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:19.525042 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:22.023928 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:24.024471 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:26.524299 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:28.524523 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:31.024283 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:33.524538 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:36.024009 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:38.024183 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:40.524873 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:43.023891 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:45.024138 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:47.024321 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:49.524407 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:52.023887 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:54.024576 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:56.024959 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:58.524756 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:01.024138 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:03.524265 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:05.524563 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:08.024452 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:10.024756 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:12.025361 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:14.524521 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:16.524987 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:19.023946 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:21.524549 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:23.524895 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:25.525026 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:28.024231 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:30.524109 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:32.524672 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:34.524774 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:36.524951 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:39.023986 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:41.524623 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:44.024595 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:46.523928 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:48.524190 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:50.524340 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:53.024675 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:55.523833 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:58.024006 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:00.024503 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:02.524673 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:05.024010 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:07.523719 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:09.524925 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:12.023977 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:14.024449 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:16.523729 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:18.524124 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:20.524738 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:23.023758 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:25.024198 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:27.525032 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:30.023864 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:32.524925 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:35.024046 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:37.024167 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:39.524569 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:42.023653 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:44.024644 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:46.524378 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:49.023827 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:51.024273 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:53.524530 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:56.023648 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:58.024095 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:00.524597 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:02.524746 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:05.023985 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:07.026315 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:09.524057 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:12.024045 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:14.524429 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:16.524494 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:19.024468 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:21.024745 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:23.524216 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:26.024624 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:28.524527 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:31.023563 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:33.023805 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:35.024667 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:37.523708 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:40.023581 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:42.023613 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:43.523708 318306 node_ready.go:38] duration metric: took 4m0.003003222s for node "old-k8s-version-964633" to be "Ready" ...
I0401 20:30:43.525700 318306 out.go:201]
W0401 20:30:43.527169 318306 out.go:270] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: context deadline exceeded
X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: context deadline exceeded
W0401 20:30:43.527189 318306 out.go:270] *
*
W0401 20:30:43.528115 318306 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0401 20:30:43.529169 318306 out.go:201]
** /stderr **
start_stop_delete_test.go:186: failed starting minikube -first start-. args "out/minikube-linux-amd64 start -p old-k8s-version-964633 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=crio --kubernetes-version=v1.20.0": exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect old-k8s-version-964633
helpers_test.go:235: (dbg) docker inspect old-k8s-version-964633:
-- stdout --
[
{
"Id": "ed2d0d1c2b7e920b6faf6dae9ac3ef2128da72aa20bb32898d7017b9200dfff6",
"Created": "2025-04-01T20:25:51.557164575Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 319295,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-04-01T20:25:51.595131743Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:b0734d4b8a5a2dbe50c35bd8745d33dc9ec48b1b1af7ad72f6736a52b01c8ce5",
"ResolvConfPath": "/var/lib/docker/containers/ed2d0d1c2b7e920b6faf6dae9ac3ef2128da72aa20bb32898d7017b9200dfff6/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/ed2d0d1c2b7e920b6faf6dae9ac3ef2128da72aa20bb32898d7017b9200dfff6/hostname",
"HostsPath": "/var/lib/docker/containers/ed2d0d1c2b7e920b6faf6dae9ac3ef2128da72aa20bb32898d7017b9200dfff6/hosts",
"LogPath": "/var/lib/docker/containers/ed2d0d1c2b7e920b6faf6dae9ac3ef2128da72aa20bb32898d7017b9200dfff6/ed2d0d1c2b7e920b6faf6dae9ac3ef2128da72aa20bb32898d7017b9200dfff6-json.log",
"Name": "/old-k8s-version-964633",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"old-k8s-version-964633:/var",
"/lib/modules:/lib/modules:ro"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "old-k8s-version-964633",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 4613734400,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "ed2d0d1c2b7e920b6faf6dae9ac3ef2128da72aa20bb32898d7017b9200dfff6",
"LowerDir": "/var/lib/docker/overlay2/b421b7651ef379232ab7786ffe2ead1877b1d5462c8ffcb5213b3203b251d58b-init/diff:/var/lib/docker/overlay2/58ab0f969881f9dc36059731f89b7320a7f189f8480f6c78bc37388b422863d3/diff",
"MergedDir": "/var/lib/docker/overlay2/b421b7651ef379232ab7786ffe2ead1877b1d5462c8ffcb5213b3203b251d58b/merged",
"UpperDir": "/var/lib/docker/overlay2/b421b7651ef379232ab7786ffe2ead1877b1d5462c8ffcb5213b3203b251d58b/diff",
"WorkDir": "/var/lib/docker/overlay2/b421b7651ef379232ab7786ffe2ead1877b1d5462c8ffcb5213b3203b251d58b/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "old-k8s-version-964633",
"Source": "/var/lib/docker/volumes/old-k8s-version-964633/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "old-k8s-version-964633",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-964633",
"name.minikube.sigs.k8s.io": "old-k8s-version-964633",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "f156c5de777c528d6f9375314eb0d4cbc858057b93c8250916b99a0c025d2197",
"SandboxKey": "/var/run/docker/netns/f156c5de777c",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33088"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33089"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33092"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33090"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33091"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-964633": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "0a:e3:3a:a8:12:66",
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "8fa1190968e91c2b4b46ed5001c6999dbffa85fccb349d7fe54ec6eb7dee75cd",
"EndpointID": "243297cc045b5d60c15285cd09a136adfdf271f0421c51d1725f61e9cf50e39f",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"old-k8s-version-964633",
"ed2d0d1c2b7e"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-964633 -n old-k8s-version-964633
helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/FirstStart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p old-k8s-version-964633 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p old-k8s-version-964633 logs -n 25: (1.138763084s)
helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/FirstStart logs:
-- stdout --
==> Audit <==
|---------|------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
| ssh | -p flannel-460236 sudo cat | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| | /var/lib/kubelet/config.yaml | | | | | |
| ssh | -p bridge-460236 sudo crio | bridge-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| | config | | | | | |
| ssh | -p flannel-460236 sudo | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | |
| | systemctl status docker --all | | | | | |
| | --full --no-pager | | | | | |
| delete | -p bridge-460236 | bridge-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| ssh | -p flannel-460236 sudo | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| | systemctl cat docker | | | | | |
| | --no-pager | | | | | |
| ssh | -p flannel-460236 sudo cat | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | |
| | /etc/docker/daemon.json | | | | | |
| ssh | -p flannel-460236 sudo docker | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | |
| | system info | | | | | |
| ssh | -p flannel-460236 sudo | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | |
| | systemctl status cri-docker | | | | | |
| | --all --full --no-pager | | | | | |
| ssh | -p flannel-460236 sudo | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| | systemctl cat cri-docker | | | | | |
| | --no-pager | | | | | |
| ssh | -p flannel-460236 sudo cat | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | |
| | /etc/systemd/system/cri-docker.service.d/10-cni.conf | | | | | |
| ssh | -p flannel-460236 sudo cat | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| | /usr/lib/systemd/system/cri-docker.service | | | | | |
| ssh | -p flannel-460236 sudo | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| | cri-dockerd --version | | | | | |
| ssh | -p flannel-460236 sudo | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | |
| | systemctl status containerd | | | | | |
| | --all --full --no-pager | | | | | |
| start | -p embed-certs-974821 | embed-certs-974821 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --embed-certs --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.32.2 | | | | | |
| ssh | -p flannel-460236 sudo | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| | systemctl cat containerd | | | | | |
| | --no-pager | | | | | |
| ssh | -p flannel-460236 sudo cat | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| | /lib/systemd/system/containerd.service | | | | | |
| ssh | -p flannel-460236 sudo cat | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| | /etc/containerd/config.toml | | | | | |
| ssh | -p flannel-460236 sudo | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| | containerd config dump | | | | | |
| ssh | -p flannel-460236 sudo | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| | systemctl status crio --all | | | | | |
| | --full --no-pager | | | | | |
| ssh | -p flannel-460236 sudo | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| | systemctl cat crio --no-pager | | | | | |
| ssh | -p flannel-460236 sudo find | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| | /etc/crio -type f -exec sh -c | | | | | |
| | 'echo {}; cat {}' \; | | | | | |
| ssh | -p flannel-460236 sudo crio | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| | config | | | | | |
| delete | -p flannel-460236 | flannel-460236 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| delete | -p | disable-driver-mounts-564557 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | 01 Apr 25 20:26 UTC |
| | disable-driver-mounts-564557 | | | | | |
| start | -p | default-k8s-diff-port-993330 | jenkins | v1.35.0 | 01 Apr 25 20:26 UTC | |
| | default-k8s-diff-port-993330 | | | | | |
| | --memory=2200 | | | | | |
| | --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=crio | | | | | |
| | --kubernetes-version=v1.32.2 | | | | | |
|---------|------------------------------------------------------|------------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2025/04/01 20:26:18
Running on machine: ubuntu-20-agent
Binary: Built with gc go1.24.0 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0401 20:26:18.730820 333931 out.go:345] Setting OutFile to fd 1 ...
I0401 20:26:18.733545 333931 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0401 20:26:18.733563 333931 out.go:358] Setting ErrFile to fd 2...
I0401 20:26:18.733571 333931 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0401 20:26:18.738068 333931 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20506-16361/.minikube/bin
I0401 20:26:18.738963 333931 out.go:352] Setting JSON to false
I0401 20:26:18.740623 333931 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent","uptime":4125,"bootTime":1743535054,"procs":294,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1078-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0401 20:26:18.740803 333931 start.go:139] virtualization: kvm guest
I0401 20:26:18.742724 333931 out.go:177] * [default-k8s-diff-port-993330] minikube v1.35.0 on Ubuntu 20.04 (kvm/amd64)
I0401 20:26:18.744296 333931 out.go:177] - MINIKUBE_LOCATION=20506
I0401 20:26:18.745845 333931 notify.go:220] Checking for updates...
I0401 20:26:18.747318 333931 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0401 20:26:18.748893 333931 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20506-16361/kubeconfig
I0401 20:26:18.750366 333931 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20506-16361/.minikube
I0401 20:26:18.751459 333931 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0401 20:26:18.752672 333931 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0401 20:26:18.754306 333931 config.go:182] Loaded profile config "embed-certs-974821": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0401 20:26:18.754458 333931 config.go:182] Loaded profile config "no-preload-671514": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0401 20:26:18.754565 333931 config.go:182] Loaded profile config "old-k8s-version-964633": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0401 20:26:18.754701 333931 driver.go:394] Setting default libvirt URI to qemu:///system
I0401 20:26:18.789341 333931 docker.go:123] docker version: linux-28.0.4:Docker Engine - Community
I0401 20:26:18.789409 333931 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0401 20:26:18.881271 333931 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:90 OomKillDisable:true NGoroutines:99 SystemTime:2025-04-01 20:26:18.86763666 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1078-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x8
6_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Serv
erErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0401 20:26:18.881427 333931 docker.go:318] overlay module found
I0401 20:26:18.885256 333931 out.go:177] * Using the docker driver based on user configuration
I0401 20:26:18.886587 333931 start.go:297] selected driver: docker
I0401 20:26:18.886610 333931 start.go:901] validating driver "docker" against <nil>
I0401 20:26:18.886630 333931 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0401 20:26:18.887954 333931 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0401 20:26:18.963854 333931 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:90 OomKillDisable:true NGoroutines:99 SystemTime:2025-04-01 20:26:18.950352252 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1078-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent Labels:[] ExperimentalBuild:false ServerVersion:28.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:05044ec0a9a75232cad458027ca83437aae3f4da} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:v1.2.5-0-g59923ef} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Ser
verErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.22.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.34.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0401 20:26:18.964074 333931 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0401 20:26:18.964363 333931 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0401 20:26:18.968028 333931 out.go:177] * Using Docker driver with root privileges
I0401 20:26:18.970719 333931 cni.go:84] Creating CNI manager for ""
I0401 20:26:18.970819 333931 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0401 20:26:18.970829 333931 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0401 20:26:18.970901 333931 start.go:340] cluster config:
{Name:default-k8s-diff-port-993330 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:default-k8s-diff-port-993330 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:
cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPa
th: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0401 20:26:18.973096 333931 out.go:177] * Starting "default-k8s-diff-port-993330" primary control-plane node in "default-k8s-diff-port-993330" cluster
I0401 20:26:18.974471 333931 cache.go:121] Beginning downloading kic base image for docker with crio
I0401 20:26:18.975839 333931 out.go:177] * Pulling base image v0.0.46-1741860993-20523 ...
I0401 20:26:18.976959 333931 preload.go:131] Checking if preload exists for k8s version v1.32.2 and runtime crio
I0401 20:26:18.977004 333931 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20506-16361/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-cri-o-overlay-amd64.tar.lz4
I0401 20:26:18.977013 333931 cache.go:56] Caching tarball of preloaded images
I0401 20:26:18.977014 333931 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 in local docker daemon
I0401 20:26:18.977118 333931 preload.go:172] Found /home/jenkins/minikube-integration/20506-16361/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I0401 20:26:18.977129 333931 cache.go:59] Finished verifying existence of preloaded tar for v1.32.2 on crio
I0401 20:26:18.977241 333931 profile.go:143] Saving config to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/config.json ...
I0401 20:26:18.977263 333931 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/config.json: {Name:mk41b8c624bf3b117b50b0e33d2457d4436df42e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:19.026924 333931 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 in local docker daemon, skipping pull
I0401 20:26:19.026949 333931 cache.go:145] gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 exists in daemon, skipping load
I0401 20:26:19.026964 333931 cache.go:230] Successfully downloaded all kic artifacts
I0401 20:26:19.026998 333931 start.go:360] acquireMachinesLock for default-k8s-diff-port-993330: {Name:mk06aff0f25d0080818cb1ab5e643246575bb967 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0401 20:26:19.027106 333931 start.go:364] duration metric: took 87.785µs to acquireMachinesLock for "default-k8s-diff-port-993330"
I0401 20:26:19.027138 333931 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-993330 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:default-k8s-diff-port-993330 Namespace:default API
ServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false
DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8444 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}
I0401 20:26:19.027241 333931 start.go:125] createHost starting for "" (driver="docker")
I0401 20:26:16.763271 330894 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20506-16361/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v embed-certs-974821:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 -I lz4 -xf /preloaded.tar -C /extractDir: (4.939069364s)
I0401 20:26:16.763308 330894 kic.go:203] duration metric: took 4.939248261s to extract preloaded images to volume ...
W0401 20:26:16.763457 330894 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0401 20:26:16.763573 330894 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0401 20:26:16.847617 330894 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname embed-certs-974821 --name embed-certs-974821 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=embed-certs-974821 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=embed-certs-974821 --network embed-certs-974821 --ip 192.168.94.2 --volume embed-certs-974821:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185
I0401 20:26:17.529078 330894 cli_runner.go:164] Run: docker container inspect embed-certs-974821 --format={{.State.Running}}
I0401 20:26:17.555101 330894 cli_runner.go:164] Run: docker container inspect embed-certs-974821 --format={{.State.Status}}
I0401 20:26:17.586968 330894 cli_runner.go:164] Run: docker exec embed-certs-974821 stat /var/lib/dpkg/alternatives/iptables
I0401 20:26:17.648014 330894 oci.go:144] the created container "embed-certs-974821" has a running status.
I0401 20:26:17.648051 330894 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20506-16361/.minikube/machines/embed-certs-974821/id_rsa...
I0401 20:26:18.285330 330894 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20506-16361/.minikube/machines/embed-certs-974821/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0401 20:26:18.311984 330894 cli_runner.go:164] Run: docker container inspect embed-certs-974821 --format={{.State.Status}}
I0401 20:26:18.345653 330894 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0401 20:26:18.345686 330894 kic_runner.go:114] Args: [docker exec --privileged embed-certs-974821 chown docker:docker /home/docker/.ssh/authorized_keys]
I0401 20:26:18.411930 330894 cli_runner.go:164] Run: docker container inspect embed-certs-974821 --format={{.State.Status}}
I0401 20:26:18.443321 330894 machine.go:93] provisionDockerMachine start ...
I0401 20:26:18.443410 330894 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-974821
I0401 20:26:18.467216 330894 main.go:141] libmachine: Using SSH client type: native
I0401 20:26:18.467559 330894 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 127.0.0.1 33098 <nil> <nil>}
I0401 20:26:18.467574 330894 main.go:141] libmachine: About to run SSH command:
hostname
I0401 20:26:18.609796 330894 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-974821
I0401 20:26:18.609837 330894 ubuntu.go:169] provisioning hostname "embed-certs-974821"
I0401 20:26:18.609906 330894 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-974821
I0401 20:26:18.630114 330894 main.go:141] libmachine: Using SSH client type: native
I0401 20:26:18.630435 330894 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 127.0.0.1 33098 <nil> <nil>}
I0401 20:26:18.630455 330894 main.go:141] libmachine: About to run SSH command:
sudo hostname embed-certs-974821 && echo "embed-certs-974821" | sudo tee /etc/hostname
I0401 20:26:18.800604 330894 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-974821
I0401 20:26:18.800683 330894 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-974821
I0401 20:26:18.831071 330894 main.go:141] libmachine: Using SSH client type: native
I0401 20:26:18.831374 330894 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 127.0.0.1 33098 <nil> <nil>}
I0401 20:26:18.831407 330894 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sembed-certs-974821' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-974821/g' /etc/hosts;
else
echo '127.0.1.1 embed-certs-974821' | sudo tee -a /etc/hosts;
fi
fi
I0401 20:26:18.987643 330894 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0401 20:26:18.987672 330894 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/20506-16361/.minikube CaCertPath:/home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20506-16361/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20506-16361/.minikube}
I0401 20:26:18.987707 330894 ubuntu.go:177] setting up certificates
I0401 20:26:18.987721 330894 provision.go:84] configureAuth start
I0401 20:26:18.987773 330894 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-974821
I0401 20:26:19.010995 330894 provision.go:143] copyHostCerts
I0401 20:26:19.011066 330894 exec_runner.go:144] found /home/jenkins/minikube-integration/20506-16361/.minikube/cert.pem, removing ...
I0401 20:26:19.011080 330894 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20506-16361/.minikube/cert.pem
I0401 20:26:19.011159 330894 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20506-16361/.minikube/cert.pem (1123 bytes)
I0401 20:26:19.011260 330894 exec_runner.go:144] found /home/jenkins/minikube-integration/20506-16361/.minikube/key.pem, removing ...
I0401 20:26:19.011270 330894 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20506-16361/.minikube/key.pem
I0401 20:26:19.011301 330894 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20506-16361/.minikube/key.pem (1675 bytes)
I0401 20:26:19.011371 330894 exec_runner.go:144] found /home/jenkins/minikube-integration/20506-16361/.minikube/ca.pem, removing ...
I0401 20:26:19.011378 330894 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20506-16361/.minikube/ca.pem
I0401 20:26:19.011411 330894 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20506-16361/.minikube/ca.pem (1078 bytes)
I0401 20:26:19.011519 330894 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20506-16361/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca-key.pem org=jenkins.embed-certs-974821 san=[127.0.0.1 192.168.94.2 embed-certs-974821 localhost minikube]
I0401 20:26:19.375012 330894 provision.go:177] copyRemoteCerts
I0401 20:26:19.375087 330894 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0401 20:26:19.375140 330894 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-974821
I0401 20:26:19.400831 330894 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33098 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/embed-certs-974821/id_rsa Username:docker}
I0401 20:26:19.503241 330894 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/machines/server.pem --> /etc/docker/server.pem (1220 bytes)
I0401 20:26:19.531832 330894 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0401 20:26:19.561562 330894 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0401 20:26:19.591125 330894 provision.go:87] duration metric: took 603.38883ms to configureAuth
I0401 20:26:19.591155 330894 ubuntu.go:193] setting minikube options for container-runtime
I0401 20:26:19.591379 330894 config.go:182] Loaded profile config "embed-certs-974821": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0401 20:26:19.591497 330894 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-974821
I0401 20:26:19.620112 330894 main.go:141] libmachine: Using SSH client type: native
I0401 20:26:19.620321 330894 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 127.0.0.1 33098 <nil> <nil>}
I0401 20:26:19.620334 330894 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0401 20:26:20.028896 330894 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0401 20:26:20.028925 330894 machine.go:96] duration metric: took 1.585582101s to provisionDockerMachine
I0401 20:26:20.028936 330894 client.go:171] duration metric: took 9.097879081s to LocalClient.Create
I0401 20:26:20.028950 330894 start.go:167] duration metric: took 9.097939352s to libmachine.API.Create "embed-certs-974821"
I0401 20:26:20.028959 330894 start.go:293] postStartSetup for "embed-certs-974821" (driver="docker")
I0401 20:26:20.028972 330894 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0401 20:26:20.029037 330894 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0401 20:26:20.029089 330894 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-974821
I0401 20:26:20.051160 330894 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33098 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/embed-certs-974821/id_rsa Username:docker}
I0401 20:26:20.157215 330894 ssh_runner.go:195] Run: cat /etc/os-release
I0401 20:26:20.160770 330894 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0401 20:26:20.160808 330894 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0401 20:26:20.160818 330894 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0401 20:26:20.160825 330894 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0401 20:26:20.160837 330894 filesync.go:126] Scanning /home/jenkins/minikube-integration/20506-16361/.minikube/addons for local assets ...
I0401 20:26:20.160897 330894 filesync.go:126] Scanning /home/jenkins/minikube-integration/20506-16361/.minikube/files for local assets ...
I0401 20:26:20.160997 330894 filesync.go:149] local asset: /home/jenkins/minikube-integration/20506-16361/.minikube/files/etc/ssl/certs/231632.pem -> 231632.pem in /etc/ssl/certs
I0401 20:26:20.161151 330894 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0401 20:26:20.173719 330894 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/files/etc/ssl/certs/231632.pem --> /etc/ssl/certs/231632.pem (1708 bytes)
I0401 20:26:20.205924 330894 start.go:296] duration metric: took 176.952692ms for postStartSetup
I0401 20:26:20.206280 330894 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-974821
I0401 20:26:20.233912 330894 profile.go:143] Saving config to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/config.json ...
I0401 20:26:20.234197 330894 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0401 20:26:20.234246 330894 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-974821
I0401 20:26:20.264690 330894 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33098 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/embed-certs-974821/id_rsa Username:docker}
I0401 20:26:20.375270 330894 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0401 20:26:20.380996 330894 start.go:128] duration metric: took 9.45211333s to createHost
I0401 20:26:20.381027 330894 start.go:83] releasing machines lock for "embed-certs-974821", held for 9.452287035s
I0401 20:26:20.381088 330894 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-974821
I0401 20:26:20.404010 330894 ssh_runner.go:195] Run: cat /version.json
I0401 20:26:20.404054 330894 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-974821
I0401 20:26:20.404141 330894 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0401 20:26:20.404219 330894 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-974821
I0401 20:26:20.436974 330894 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33098 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/embed-certs-974821/id_rsa Username:docker}
I0401 20:26:20.443906 330894 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33098 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/embed-certs-974821/id_rsa Username:docker}
I0401 20:26:20.643641 330894 ssh_runner.go:195] Run: systemctl --version
I0401 20:26:20.648179 330894 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0401 20:26:18.704089 320217 cache_images.go:321] Transferred and loaded /home/jenkins/minikube-integration/20506-16361/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 from cache
I0401 20:26:18.704123 320217 cache_images.go:123] Successfully loaded all cached images
I0401 20:26:18.704128 320217 cache_images.go:92] duration metric: took 17.284939204s to LoadCachedImages
I0401 20:26:18.704139 320217 kubeadm.go:934] updating node { 192.168.76.2 8443 v1.32.2 crio true true} ...
I0401 20:26:18.704219 320217 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.32.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=no-preload-671514 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.32.2 ClusterName:no-preload-671514 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0401 20:26:18.704276 320217 ssh_runner.go:195] Run: crio config
I0401 20:26:18.757951 320217 cni.go:84] Creating CNI manager for ""
I0401 20:26:18.757967 320217 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0401 20:26:18.757976 320217 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0401 20:26:18.757998 320217 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.32.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:no-preload-671514 NodeName:no-preload-671514 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0401 20:26:18.758098 320217 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "no-preload-671514"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.76.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
- name: "proxy-refresh-interval"
value: "70000"
kubernetesVersion: v1.32.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0401 20:26:18.758154 320217 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.32.2
I0401 20:26:18.768955 320217 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.32.2: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/binaries/v1.32.2': No such file or directory
Initiating transfer...
I0401 20:26:18.769017 320217 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.32.2
I0401 20:26:18.780560 320217 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.32.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.32.2/bin/linux/amd64/kubectl.sha256
I0401 20:26:18.780618 320217 download.go:108] Downloading: https://dl.k8s.io/release/v1.32.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.32.2/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/20506-16361/.minikube/cache/linux/amd64/v1.32.2/kubelet
I0401 20:26:18.780639 320217 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.32.2/kubectl
I0401 20:26:18.780759 320217 download.go:108] Downloading: https://dl.k8s.io/release/v1.32.2/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.32.2/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/20506-16361/.minikube/cache/linux/amd64/v1.32.2/kubeadm
I0401 20:26:18.785435 320217 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.32.2/kubectl: stat -c "%s %y" /var/lib/minikube/binaries/v1.32.2/kubectl: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.32.2/kubectl': No such file or directory
I0401 20:26:18.785465 320217 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/cache/linux/amd64/v1.32.2/kubectl --> /var/lib/minikube/binaries/v1.32.2/kubectl (57323672 bytes)
I0401 20:26:20.056132 320217 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0401 20:26:20.071013 320217 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.32.2/kubelet
I0401 20:26:20.075222 320217 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.32.2/kubelet: stat -c "%s %y" /var/lib/minikube/binaries/v1.32.2/kubelet: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.32.2/kubelet': No such file or directory
I0401 20:26:20.075249 320217 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/cache/linux/amd64/v1.32.2/kubelet --> /var/lib/minikube/binaries/v1.32.2/kubelet (77406468 bytes)
I0401 20:26:20.353036 320217 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.32.2/kubeadm
I0401 20:26:20.359017 320217 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.32.2/kubeadm: stat -c "%s %y" /var/lib/minikube/binaries/v1.32.2/kubeadm: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.32.2/kubeadm': No such file or directory
I0401 20:26:20.359060 320217 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/cache/linux/amd64/v1.32.2/kubeadm --> /var/lib/minikube/binaries/v1.32.2/kubeadm (70942872 bytes)
I0401 20:26:20.620194 320217 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0401 20:26:20.630621 320217 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (367 bytes)
I0401 20:26:20.649377 320217 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0401 20:26:20.669072 320217 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2291 bytes)
I0401 20:26:20.687859 320217 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0401 20:26:20.692137 320217 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0401 20:26:20.705020 320217 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 20:26:20.783000 320217 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0401 20:26:20.797428 320217 certs.go:68] Setting up /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514 for IP: 192.168.76.2
I0401 20:26:20.797458 320217 certs.go:194] generating shared ca certs ...
I0401 20:26:20.797479 320217 certs.go:226] acquiring lock for ca certs: {Name:mkd05003433d6acd6ff5e2aab58050e1004ceb11 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:20.797648 320217 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20506-16361/.minikube/ca.key
I0401 20:26:20.797718 320217 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20506-16361/.minikube/proxy-client-ca.key
I0401 20:26:20.797732 320217 certs.go:256] generating profile certs ...
I0401 20:26:20.797824 320217 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/client.key
I0401 20:26:20.797841 320217 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/client.crt with IP's: []
I0401 20:26:21.025289 320217 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/client.crt ...
I0401 20:26:21.025326 320217 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/client.crt: {Name:mke9875eb54d53b0e963b356ad83bcd75e7a7412 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:21.025561 320217 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/client.key ...
I0401 20:26:21.025582 320217 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/client.key: {Name:mk5cf5928a944f1ac50d55701032ad8dae5bfdcd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:21.025703 320217 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/apiserver.key.228ec789
I0401 20:26:21.025727 320217 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/apiserver.crt.228ec789 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.76.2]
I0401 20:26:21.703494 320217 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/apiserver.crt.228ec789 ...
I0401 20:26:21.703527 320217 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/apiserver.crt.228ec789: {Name:mkff154c452b8abb791f6205356ff8f00084ac42 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:21.703729 320217 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/apiserver.key.228ec789 ...
I0401 20:26:21.703749 320217 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/apiserver.key.228ec789: {Name:mk98a1753bc671ea092085863390fd551854922e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:21.703850 320217 certs.go:381] copying /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/apiserver.crt.228ec789 -> /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/apiserver.crt
I0401 20:26:21.703945 320217 certs.go:385] copying /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/apiserver.key.228ec789 -> /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/apiserver.key
I0401 20:26:21.704021 320217 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/proxy-client.key
I0401 20:26:21.704043 320217 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/proxy-client.crt with IP's: []
I0401 20:26:21.823952 320217 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/proxy-client.crt ...
I0401 20:26:21.823994 320217 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/proxy-client.crt: {Name:mk12ddb26dc8992914033bccb24e739dc4a1ef16 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:21.824260 320217 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/proxy-client.key ...
I0401 20:26:21.824291 320217 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/proxy-client.key: {Name:mkdb31dfa4b6dd47b5225d572106f6b4e48a1935 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:21.824569 320217 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/23163.pem (1338 bytes)
W0401 20:26:21.824627 320217 certs.go:480] ignoring /home/jenkins/minikube-integration/20506-16361/.minikube/certs/23163_empty.pem, impossibly tiny 0 bytes
I0401 20:26:21.824643 320217 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca-key.pem (1679 bytes)
I0401 20:26:21.824677 320217 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem (1078 bytes)
I0401 20:26:21.824715 320217 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/cert.pem (1123 bytes)
I0401 20:26:21.824748 320217 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/key.pem (1675 bytes)
I0401 20:26:21.824812 320217 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/files/etc/ssl/certs/231632.pem (1708 bytes)
I0401 20:26:21.825605 320217 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0401 20:26:21.850775 320217 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0401 20:26:21.877956 320217 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0401 20:26:21.901694 320217 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0401 20:26:21.925814 320217 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I0401 20:26:21.958552 320217 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0401 20:26:21.988393 320217 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0401 20:26:22.012826 320217 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/no-preload-671514/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0401 20:26:22.050282 320217 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0401 20:26:22.076704 320217 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/certs/23163.pem --> /usr/share/ca-certificates/23163.pem (1338 bytes)
I0401 20:26:22.099879 320217 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/files/etc/ssl/certs/231632.pem --> /usr/share/ca-certificates/231632.pem (1708 bytes)
I0401 20:26:22.123774 320217 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0401 20:26:22.145012 320217 ssh_runner.go:195] Run: openssl version
I0401 20:26:22.151397 320217 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0401 20:26:22.162414 320217 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0401 20:26:22.166551 320217 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 1 19:46 /usr/share/ca-certificates/minikubeCA.pem
I0401 20:26:22.166619 320217 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0401 20:26:22.173527 320217 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0401 20:26:22.183936 320217 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/23163.pem && ln -fs /usr/share/ca-certificates/23163.pem /etc/ssl/certs/23163.pem"
I0401 20:26:22.194218 320217 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/23163.pem
I0401 20:26:22.198190 320217 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 1 19:52 /usr/share/ca-certificates/23163.pem
I0401 20:26:22.198311 320217 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/23163.pem
I0401 20:26:22.206703 320217 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/23163.pem /etc/ssl/certs/51391683.0"
I0401 20:26:22.216650 320217 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/231632.pem && ln -fs /usr/share/ca-certificates/231632.pem /etc/ssl/certs/231632.pem"
I0401 20:26:22.227467 320217 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/231632.pem
I0401 20:26:22.231786 320217 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 1 19:52 /usr/share/ca-certificates/231632.pem
I0401 20:26:22.231858 320217 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/231632.pem
I0401 20:26:22.239197 320217 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/231632.pem /etc/ssl/certs/3ec20f2e.0"
I0401 20:26:22.268104 320217 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0401 20:26:22.275324 320217 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0401 20:26:22.275398 320217 kubeadm.go:392] StartCluster: {Name:no-preload-671514 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:no-preload-671514 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISer
verNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemu
FirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0401 20:26:22.275510 320217 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0401 20:26:22.275581 320217 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0401 20:26:22.342807 320217 cri.go:89] found id: ""
I0401 20:26:22.342887 320217 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0401 20:26:22.352857 320217 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0401 20:26:22.397706 320217 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0401 20:26:22.397797 320217 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0401 20:26:22.406979 320217 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0401 20:26:22.407000 320217 kubeadm.go:157] found existing configuration files:
I0401 20:26:22.407039 320217 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0401 20:26:22.416134 320217 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0401 20:26:22.416218 320217 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0401 20:26:22.425226 320217 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0401 20:26:22.434731 320217 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0401 20:26:22.434800 320217 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0401 20:26:22.447967 320217 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0401 20:26:22.457983 320217 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0401 20:26:22.458075 320217 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0401 20:26:22.469883 320217 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0401 20:26:22.479202 320217 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0401 20:26:22.479268 320217 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0401 20:26:22.488113 320217 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.32.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0401 20:26:22.556959 320217 kubeadm.go:310] [init] Using Kubernetes version: v1.32.2
I0401 20:26:22.557052 320217 kubeadm.go:310] [preflight] Running pre-flight checks
I0401 20:26:22.577518 320217 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0401 20:26:22.577611 320217 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1078-gcp[0m
I0401 20:26:22.577671 320217 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0401 20:26:22.577732 320217 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0401 20:26:22.577821 320217 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0401 20:26:22.577891 320217 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0401 20:26:22.577964 320217 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0401 20:26:22.578040 320217 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0401 20:26:22.578124 320217 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0401 20:26:22.578277 320217 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0401 20:26:22.578356 320217 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0401 20:26:22.578457 320217 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0401 20:26:22.633543 320217 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0401 20:26:22.633691 320217 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0401 20:26:22.633859 320217 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0401 20:26:22.672052 320217 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0401 20:26:22.744648 320217 out.go:235] - Generating certificates and keys ...
I0401 20:26:22.744803 320217 kubeadm.go:310] [certs] Using existing ca certificate authority
I0401 20:26:22.744884 320217 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0401 20:26:19.030494 333931 out.go:235] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0401 20:26:19.030759 333931 start.go:159] libmachine.API.Create for "default-k8s-diff-port-993330" (driver="docker")
I0401 20:26:19.030792 333931 client.go:168] LocalClient.Create starting
I0401 20:26:19.030892 333931 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem
I0401 20:26:19.030926 333931 main.go:141] libmachine: Decoding PEM data...
I0401 20:26:19.030951 333931 main.go:141] libmachine: Parsing certificate...
I0401 20:26:19.031015 333931 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20506-16361/.minikube/certs/cert.pem
I0401 20:26:19.031039 333931 main.go:141] libmachine: Decoding PEM data...
I0401 20:26:19.031052 333931 main.go:141] libmachine: Parsing certificate...
I0401 20:26:19.031486 333931 cli_runner.go:164] Run: docker network inspect default-k8s-diff-port-993330 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0401 20:26:19.058636 333931 cli_runner.go:211] docker network inspect default-k8s-diff-port-993330 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0401 20:26:19.058698 333931 network_create.go:284] running [docker network inspect default-k8s-diff-port-993330] to gather additional debugging logs...
I0401 20:26:19.058720 333931 cli_runner.go:164] Run: docker network inspect default-k8s-diff-port-993330
W0401 20:26:19.076276 333931 cli_runner.go:211] docker network inspect default-k8s-diff-port-993330 returned with exit code 1
I0401 20:26:19.076321 333931 network_create.go:287] error running [docker network inspect default-k8s-diff-port-993330]: docker network inspect default-k8s-diff-port-993330: exit status 1
stdout:
[]
stderr:
Error response from daemon: network default-k8s-diff-port-993330 not found
I0401 20:26:19.076339 333931 network_create.go:289] output of [docker network inspect default-k8s-diff-port-993330]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network default-k8s-diff-port-993330 not found
** /stderr **
I0401 20:26:19.076470 333931 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0401 20:26:19.100145 333931 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-64a5a6ce16e8 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:de:10:1d:21:82:a2} reservation:<nil>}
I0401 20:26:19.101014 333931 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-81fe12fae94d IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:76:cc:45:d3:a7:72} reservation:<nil>}
I0401 20:26:19.101930 333931 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-d1f8fe59a39e IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:0e:15:5e:6b:fd:d1} reservation:<nil>}
I0401 20:26:19.102831 333931 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-b666aa65b1b8 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:32:ed:87:e7:d7:c9} reservation:<nil>}
I0401 20:26:19.103655 333931 network.go:211] skipping subnet 192.168.85.0/24 that is taken: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName:br-8fa1190968e9 IfaceIPv4:192.168.85.1 IfaceMTU:1500 IfaceMAC:f6:aa:29:6a:ad:93} reservation:<nil>}
I0401 20:26:19.104914 333931 network.go:211] skipping subnet 192.168.94.0/24 that is taken: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 IsPrivate:true Interface:{IfaceName:br-7bc427b9d0a7 IfaceIPv4:192.168.94.1 IfaceMTU:1500 IfaceMAC:2a:7f:b7:10:d1:64} reservation:<nil>}
I0401 20:26:19.106178 333931 network.go:206] using free private subnet 192.168.103.0/24: &{IP:192.168.103.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.103.0/24 Gateway:192.168.103.1 ClientMin:192.168.103.2 ClientMax:192.168.103.254 Broadcast:192.168.103.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001f86d90}
I0401 20:26:19.106207 333931 network_create.go:124] attempt to create docker network default-k8s-diff-port-993330 192.168.103.0/24 with gateway 192.168.103.1 and MTU of 1500 ...
I0401 20:26:19.106258 333931 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.103.0/24 --gateway=192.168.103.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=default-k8s-diff-port-993330 default-k8s-diff-port-993330
I0401 20:26:19.172538 333931 network_create.go:108] docker network default-k8s-diff-port-993330 192.168.103.0/24 created
I0401 20:26:19.172574 333931 kic.go:121] calculated static IP "192.168.103.2" for the "default-k8s-diff-port-993330" container
I0401 20:26:19.172642 333931 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0401 20:26:19.192037 333931 cli_runner.go:164] Run: docker volume create default-k8s-diff-port-993330 --label name.minikube.sigs.k8s.io=default-k8s-diff-port-993330 --label created_by.minikube.sigs.k8s.io=true
I0401 20:26:19.213490 333931 oci.go:103] Successfully created a docker volume default-k8s-diff-port-993330
I0401 20:26:19.213570 333931 cli_runner.go:164] Run: docker run --rm --name default-k8s-diff-port-993330-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=default-k8s-diff-port-993330 --entrypoint /usr/bin/test -v default-k8s-diff-port-993330:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 -d /var/lib
I0401 20:26:20.063796 333931 oci.go:107] Successfully prepared a docker volume default-k8s-diff-port-993330
I0401 20:26:20.063838 333931 preload.go:131] Checking if preload exists for k8s version v1.32.2 and runtime crio
I0401 20:26:20.063873 333931 kic.go:194] Starting extracting preloaded images to volume ...
I0401 20:26:20.063966 333931 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20506-16361/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v default-k8s-diff-port-993330:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 -I lz4 -xf /preloaded.tar -C /extractDir
I0401 20:26:20.798923 330894 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0401 20:26:20.804592 330894 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0401 20:26:20.825829 330894 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0401 20:26:20.825910 330894 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0401 20:26:20.857889 330894 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0401 20:26:20.857914 330894 start.go:495] detecting cgroup driver to use...
I0401 20:26:20.857950 330894 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0401 20:26:20.857999 330894 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0401 20:26:20.876027 330894 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0401 20:26:20.886840 330894 docker.go:217] disabling cri-docker service (if available) ...
I0401 20:26:20.886894 330894 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0401 20:26:20.899593 330894 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0401 20:26:20.913852 330894 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0401 20:26:20.999530 330894 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0401 20:26:21.105398 330894 docker.go:233] disabling docker service ...
I0401 20:26:21.105462 330894 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0401 20:26:21.128681 330894 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0401 20:26:21.143119 330894 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0401 20:26:21.239431 330894 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0401 20:26:21.347556 330894 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0401 20:26:21.362149 330894 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0401 20:26:21.378024 330894 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...
I0401 20:26:21.378091 330894 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:26:21.387719 330894 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0401 20:26:21.387780 330894 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:26:21.397252 330894 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:26:21.407209 330894 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:26:21.416854 330894 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0401 20:26:21.425951 330894 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:26:21.435894 330894 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:26:21.451330 330894 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:26:21.460997 330894 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0401 20:26:21.469673 330894 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0401 20:26:21.478054 330894 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 20:26:21.575835 330894 ssh_runner.go:195] Run: sudo systemctl restart crio
I0401 20:26:24.329419 330894 ssh_runner.go:235] Completed: sudo systemctl restart crio: (2.753533672s)
I0401 20:26:24.329455 330894 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0401 20:26:24.329517 330894 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0401 20:26:24.334301 330894 start.go:563] Will wait 60s for crictl version
I0401 20:26:24.334347 330894 ssh_runner.go:195] Run: which crictl
I0401 20:26:24.338065 330894 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0401 20:26:24.393080 330894 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0401 20:26:24.393163 330894 ssh_runner.go:195] Run: crio --version
I0401 20:26:24.436816 330894 ssh_runner.go:195] Run: crio --version
I0401 20:26:24.491421 330894 out.go:177] * Preparing Kubernetes v1.32.2 on CRI-O 1.24.6 ...
I0401 20:26:23.013929 320217 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0401 20:26:23.124710 320217 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0401 20:26:23.261834 320217 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0401 20:26:23.421361 320217 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0401 20:26:23.643148 320217 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0401 20:26:23.643311 320217 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost no-preload-671514] and IPs [192.168.76.2 127.0.0.1 ::1]
I0401 20:26:23.896342 320217 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0401 20:26:23.896584 320217 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost no-preload-671514] and IPs [192.168.76.2 127.0.0.1 ::1]
I0401 20:26:24.180117 320217 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0401 20:26:24.383338 320217 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0401 20:26:24.608762 320217 kubeadm.go:310] [certs] Generating "sa" key and public key
I0401 20:26:24.614000 320217 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0401 20:26:24.874525 320217 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0401 20:26:25.114907 320217 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0401 20:26:25.371100 320217 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0401 20:26:25.498988 320217 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0401 20:26:25.684916 320217 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0401 20:26:25.685557 320217 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0401 20:26:25.687998 320217 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0401 20:26:24.492924 330894 cli_runner.go:164] Run: docker network inspect embed-certs-974821 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0401 20:26:24.515702 330894 ssh_runner.go:195] Run: grep 192.168.94.1 host.minikube.internal$ /etc/hosts
I0401 20:26:24.521193 330894 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0401 20:26:24.536171 330894 kubeadm.go:883] updating cluster {Name:embed-certs-974821 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:embed-certs-974821 Namespace:default APIServerHAVIP: APIServerName:minikubeCA AP
IServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0401 20:26:24.536328 330894 preload.go:131] Checking if preload exists for k8s version v1.32.2 and runtime crio
I0401 20:26:24.536409 330894 ssh_runner.go:195] Run: sudo crictl images --output json
I0401 20:26:24.640432 330894 crio.go:514] all images are preloaded for cri-o runtime.
I0401 20:26:24.640460 330894 crio.go:433] Images already preloaded, skipping extraction
I0401 20:26:24.640514 330894 ssh_runner.go:195] Run: sudo crictl images --output json
I0401 20:26:24.685542 330894 crio.go:514] all images are preloaded for cri-o runtime.
I0401 20:26:24.685565 330894 cache_images.go:84] Images are preloaded, skipping loading
I0401 20:26:24.685574 330894 kubeadm.go:934] updating node { 192.168.94.2 8443 v1.32.2 crio true true} ...
I0401 20:26:24.685668 330894 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.32.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=embed-certs-974821 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2
[Install]
config:
{KubernetesVersion:v1.32.2 ClusterName:embed-certs-974821 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0401 20:26:24.685743 330894 ssh_runner.go:195] Run: crio config
I0401 20:26:24.766212 330894 cni.go:84] Creating CNI manager for ""
I0401 20:26:24.766237 330894 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0401 20:26:24.766252 330894 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0401 20:26:24.766284 330894 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.32.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-974821 NodeName:embed-certs-974821 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/e
tc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0401 20:26:24.766431 330894 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.94.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "embed-certs-974821"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.94.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
- name: "proxy-refresh-interval"
value: "70000"
kubernetesVersion: v1.32.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0401 20:26:24.766497 330894 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.32.2
I0401 20:26:24.778790 330894 binaries.go:44] Found k8s binaries, skipping transfer
I0401 20:26:24.778851 330894 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0401 20:26:24.789824 330894 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (368 bytes)
I0401 20:26:24.811427 330894 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0401 20:26:24.832231 330894 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2292 bytes)
I0401 20:26:24.850731 330894 ssh_runner.go:195] Run: grep 192.168.94.2 control-plane.minikube.internal$ /etc/hosts
I0401 20:26:24.854382 330894 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0401 20:26:24.866403 330894 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 20:26:24.972070 330894 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0401 20:26:24.986029 330894 certs.go:68] Setting up /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821 for IP: 192.168.94.2
I0401 20:26:24.986052 330894 certs.go:194] generating shared ca certs ...
I0401 20:26:24.986071 330894 certs.go:226] acquiring lock for ca certs: {Name:mkd05003433d6acd6ff5e2aab58050e1004ceb11 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:24.986217 330894 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20506-16361/.minikube/ca.key
I0401 20:26:24.986270 330894 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20506-16361/.minikube/proxy-client-ca.key
I0401 20:26:24.986282 330894 certs.go:256] generating profile certs ...
I0401 20:26:24.986350 330894 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/client.key
I0401 20:26:24.986366 330894 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/client.crt with IP's: []
I0401 20:26:25.561289 330894 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/client.crt ...
I0401 20:26:25.561329 330894 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/client.crt: {Name:mk536b76487556389d29ad8574ff5ad7bbbb92f5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:25.561535 330894 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/client.key ...
I0401 20:26:25.561595 330894 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/client.key: {Name:mk06a6896cbdd8d679b12e456058f02b8f5cecd3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:25.561758 330894 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/apiserver.key.9ef4ba6e
I0401 20:26:25.561783 330894 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/apiserver.crt.9ef4ba6e with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.94.2]
I0401 20:26:25.644415 330894 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/apiserver.crt.9ef4ba6e ...
I0401 20:26:25.644442 330894 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/apiserver.crt.9ef4ba6e: {Name:mk34470e247b340bed5a173c03f86a16dc60e78e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:25.644616 330894 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/apiserver.key.9ef4ba6e ...
I0401 20:26:25.644634 330894 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/apiserver.key.9ef4ba6e: {Name:mk4c295a29c57f2c76710e0b9b364042d092e6af Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:25.644731 330894 certs.go:381] copying /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/apiserver.crt.9ef4ba6e -> /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/apiserver.crt
I0401 20:26:25.644851 330894 certs.go:385] copying /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/apiserver.key.9ef4ba6e -> /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/apiserver.key
I0401 20:26:25.644945 330894 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/proxy-client.key
I0401 20:26:25.644968 330894 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/proxy-client.crt with IP's: []
I0401 20:26:26.214362 318306 kubeadm.go:310] [init] Using Kubernetes version: v1.20.0
I0401 20:26:26.214472 318306 kubeadm.go:310] [preflight] Running pre-flight checks
I0401 20:26:26.214629 318306 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0401 20:26:26.214721 318306 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1078-gcp[0m
I0401 20:26:26.214772 318306 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0401 20:26:26.214839 318306 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0401 20:26:26.214911 318306 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0401 20:26:26.214980 318306 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0401 20:26:26.215050 318306 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0401 20:26:26.215120 318306 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0401 20:26:26.215191 318306 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0401 20:26:26.215257 318306 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0401 20:26:26.215328 318306 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0401 20:26:26.215434 318306 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0401 20:26:26.215559 318306 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0401 20:26:26.215673 318306 kubeadm.go:310] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
I0401 20:26:26.215753 318306 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0401 20:26:26.217135 318306 out.go:235] - Generating certificates and keys ...
I0401 20:26:26.217235 318306 kubeadm.go:310] [certs] Using existing ca certificate authority
I0401 20:26:26.217313 318306 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0401 20:26:26.217422 318306 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0401 20:26:26.217503 318306 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0401 20:26:26.217623 318306 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0401 20:26:26.217724 318306 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0401 20:26:26.217832 318306 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0401 20:26:26.218026 318306 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost old-k8s-version-964633] and IPs [192.168.85.2 127.0.0.1 ::1]
I0401 20:26:26.218112 318306 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0401 20:26:26.218299 318306 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost old-k8s-version-964633] and IPs [192.168.85.2 127.0.0.1 ::1]
I0401 20:26:26.218403 318306 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0401 20:26:26.218506 318306 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0401 20:26:26.218576 318306 kubeadm.go:310] [certs] Generating "sa" key and public key
I0401 20:26:26.218652 318306 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0401 20:26:26.218719 318306 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0401 20:26:26.218796 318306 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0401 20:26:26.218887 318306 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0401 20:26:26.218972 318306 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0401 20:26:26.219140 318306 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0401 20:26:26.219260 318306 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0401 20:26:26.219320 318306 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0401 20:26:26.219415 318306 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0401 20:26:26.221597 318306 out.go:235] - Booting up control plane ...
I0401 20:26:26.221711 318306 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0401 20:26:26.221832 318306 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0401 20:26:26.221920 318306 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0401 20:26:26.222041 318306 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0401 20:26:26.222287 318306 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
I0401 20:26:26.222368 318306 kubeadm.go:310] [apiclient] All control plane components are healthy after 16.002573 seconds
I0401 20:26:26.222512 318306 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0401 20:26:26.222668 318306 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config-1.20" in namespace kube-system with the configuration for the kubelets in the cluster
I0401 20:26:26.222767 318306 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0401 20:26:26.223041 318306 kubeadm.go:310] [mark-control-plane] Marking the node old-k8s-version-964633 as control-plane by adding the labels "node-role.kubernetes.io/master=''" and "node-role.kubernetes.io/control-plane='' (deprecated)"
I0401 20:26:26.223123 318306 kubeadm.go:310] [bootstrap-token] Using token: fypcag.rftl5mjclps03e3q
I0401 20:26:26.224467 318306 out.go:235] - Configuring RBAC rules ...
I0401 20:26:26.224625 318306 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0401 20:26:26.224753 318306 kubeadm.go:310] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0401 20:26:26.224943 318306 kubeadm.go:310] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0401 20:26:26.225135 318306 kubeadm.go:310] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0401 20:26:26.225281 318306 kubeadm.go:310] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0401 20:26:26.225432 318306 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0401 20:26:26.225610 318306 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0401 20:26:26.225682 318306 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0401 20:26:26.225797 318306 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0401 20:26:26.225810 318306 kubeadm.go:310]
I0401 20:26:26.225889 318306 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0401 20:26:26.225899 318306 kubeadm.go:310]
I0401 20:26:26.226006 318306 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0401 20:26:26.226017 318306 kubeadm.go:310]
I0401 20:26:26.226057 318306 kubeadm.go:310] mkdir -p $HOME/.kube
I0401 20:26:26.226155 318306 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0401 20:26:26.226230 318306 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0401 20:26:26.226240 318306 kubeadm.go:310]
I0401 20:26:26.226321 318306 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0401 20:26:26.226340 318306 kubeadm.go:310]
I0401 20:26:26.226412 318306 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0401 20:26:26.226428 318306 kubeadm.go:310]
I0401 20:26:26.226497 318306 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0401 20:26:26.226616 318306 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0401 20:26:26.226709 318306 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0401 20:26:26.226724 318306 kubeadm.go:310]
I0401 20:26:26.226842 318306 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0401 20:26:26.226966 318306 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0401 20:26:26.226982 318306 kubeadm.go:310]
I0401 20:26:26.227118 318306 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token fypcag.rftl5mjclps03e3q \
I0401 20:26:26.227294 318306 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:3d93fb35a345f61a73d1a5c805e66c154297b8bb9225b71f12b591697818ec37 \
I0401 20:26:26.227335 318306 kubeadm.go:310] --control-plane
I0401 20:26:26.227345 318306 kubeadm.go:310]
I0401 20:26:26.227466 318306 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0401 20:26:26.227481 318306 kubeadm.go:310]
I0401 20:26:26.227595 318306 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token fypcag.rftl5mjclps03e3q \
I0401 20:26:26.227775 318306 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:3d93fb35a345f61a73d1a5c805e66c154297b8bb9225b71f12b591697818ec37
I0401 20:26:26.227801 318306 cni.go:84] Creating CNI manager for ""
I0401 20:26:26.227810 318306 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0401 20:26:26.229908 318306 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0401 20:26:26.093967 330894 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/proxy-client.crt ...
I0401 20:26:26.094055 330894 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/proxy-client.crt: {Name:mkd7383c98f7836cbb1915ebedd5c06bc1373b2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:26.094280 330894 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/proxy-client.key ...
I0401 20:26:26.094332 330894 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/proxy-client.key: {Name:mk3bcba75fecb3e0555fc6c711acaf5f2149d6b5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:26.094626 330894 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/23163.pem (1338 bytes)
W0401 20:26:26.094703 330894 certs.go:480] ignoring /home/jenkins/minikube-integration/20506-16361/.minikube/certs/23163_empty.pem, impossibly tiny 0 bytes
I0401 20:26:26.094726 330894 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca-key.pem (1679 bytes)
I0401 20:26:26.094788 330894 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem (1078 bytes)
I0401 20:26:26.094838 330894 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/cert.pem (1123 bytes)
I0401 20:26:26.094891 330894 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/key.pem (1675 bytes)
I0401 20:26:26.094971 330894 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/files/etc/ssl/certs/231632.pem (1708 bytes)
I0401 20:26:26.095809 330894 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0401 20:26:26.118761 330894 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0401 20:26:26.145911 330894 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0401 20:26:26.170945 330894 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0401 20:26:26.193905 330894 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1428 bytes)
I0401 20:26:26.219847 330894 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0401 20:26:26.246393 330894 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0401 20:26:26.271327 330894 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/embed-certs-974821/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0401 20:26:26.297378 330894 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/certs/23163.pem --> /usr/share/ca-certificates/23163.pem (1338 bytes)
I0401 20:26:26.323815 330894 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/files/etc/ssl/certs/231632.pem --> /usr/share/ca-certificates/231632.pem (1708 bytes)
I0401 20:26:26.359204 330894 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0401 20:26:26.389791 330894 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0401 20:26:26.408612 330894 ssh_runner.go:195] Run: openssl version
I0401 20:26:26.414310 330894 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/231632.pem && ln -fs /usr/share/ca-certificates/231632.pem /etc/ssl/certs/231632.pem"
I0401 20:26:26.423887 330894 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/231632.pem
I0401 20:26:26.427471 330894 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 1 19:52 /usr/share/ca-certificates/231632.pem
I0401 20:26:26.427536 330894 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/231632.pem
I0401 20:26:26.434675 330894 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/231632.pem /etc/ssl/certs/3ec20f2e.0"
I0401 20:26:26.443767 330894 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0401 20:26:26.453242 330894 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0401 20:26:26.456856 330894 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 1 19:46 /usr/share/ca-certificates/minikubeCA.pem
I0401 20:26:26.456909 330894 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0401 20:26:26.463995 330894 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0401 20:26:26.474412 330894 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/23163.pem && ln -fs /usr/share/ca-certificates/23163.pem /etc/ssl/certs/23163.pem"
I0401 20:26:26.484100 330894 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/23163.pem
I0401 20:26:26.487750 330894 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 1 19:52 /usr/share/ca-certificates/23163.pem
I0401 20:26:26.487806 330894 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/23163.pem
I0401 20:26:26.495937 330894 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/23163.pem /etc/ssl/certs/51391683.0"
I0401 20:26:26.506268 330894 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0401 20:26:26.510090 330894 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0401 20:26:26.510144 330894 kubeadm.go:392] StartCluster: {Name:embed-certs-974821 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:embed-certs-974821 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQem
uFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0401 20:26:26.510251 330894 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0401 20:26:26.510306 330894 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0401 20:26:26.549531 330894 cri.go:89] found id: ""
I0401 20:26:26.549591 330894 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0401 20:26:26.560092 330894 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0401 20:26:26.569126 330894 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0401 20:26:26.569202 330894 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0401 20:26:26.578798 330894 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0401 20:26:26.578817 330894 kubeadm.go:157] found existing configuration files:
I0401 20:26:26.578863 330894 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0401 20:26:26.587232 330894 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0401 20:26:26.587280 330894 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0401 20:26:26.595948 330894 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0401 20:26:26.604492 330894 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0401 20:26:26.604560 330894 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0401 20:26:26.614446 330894 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0401 20:26:26.624719 330894 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0401 20:26:26.624783 330894 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0401 20:26:26.635355 330894 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0401 20:26:26.647037 330894 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0401 20:26:26.647109 330894 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0401 20:26:26.655651 330894 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.32.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0401 20:26:26.709584 330894 kubeadm.go:310] [init] Using Kubernetes version: v1.32.2
I0401 20:26:26.709907 330894 kubeadm.go:310] [preflight] Running pre-flight checks
I0401 20:26:26.735070 330894 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0401 20:26:26.735157 330894 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1078-gcp[0m
I0401 20:26:26.735198 330894 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0401 20:26:26.735253 330894 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0401 20:26:26.735307 330894 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0401 20:26:26.735359 330894 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0401 20:26:26.735411 330894 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0401 20:26:26.735468 330894 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0401 20:26:26.735536 330894 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0401 20:26:26.735593 330894 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0401 20:26:26.735669 330894 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0401 20:26:26.735730 330894 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0401 20:26:26.803818 330894 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0401 20:26:26.803970 330894 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0401 20:26:26.804091 330894 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0401 20:26:26.811281 330894 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0401 20:26:26.231065 318306 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0401 20:26:26.234959 318306 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.20.0/kubectl ...
I0401 20:26:26.234975 318306 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0401 20:26:26.252673 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0401 20:26:26.634659 318306 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0401 20:26:26.634773 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:26.634829 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes old-k8s-version-964633 minikube.k8s.io/updated_at=2025_04_01T20_26_26_0700 minikube.k8s.io/version=v1.35.0 minikube.k8s.io/commit=73c6e1c927350a51068882397e0642f8dfb63f2a minikube.k8s.io/name=old-k8s-version-964633 minikube.k8s.io/primary=true
I0401 20:26:26.766148 318306 ops.go:34] apiserver oom_adj: -16
I0401 20:26:26.766281 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:25.689888 320217 out.go:235] - Booting up control plane ...
I0401 20:26:25.690011 320217 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0401 20:26:25.690139 320217 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0401 20:26:25.690951 320217 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0401 20:26:25.702609 320217 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0401 20:26:25.710116 320217 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0401 20:26:25.710231 320217 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0401 20:26:25.811433 320217 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0401 20:26:25.811592 320217 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0401 20:26:26.813131 320217 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001728428s
I0401 20:26:26.813266 320217 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0401 20:26:24.237649 333931 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20506-16361/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.32.2-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v default-k8s-diff-port-993330:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 -I lz4 -xf /preloaded.tar -C /extractDir: (4.173629863s)
I0401 20:26:24.237687 333931 kic.go:203] duration metric: took 4.173809832s to extract preloaded images to volume ...
W0401 20:26:24.237885 333931 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0401 20:26:24.238031 333931 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0401 20:26:24.308572 333931 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname default-k8s-diff-port-993330 --name default-k8s-diff-port-993330 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=default-k8s-diff-port-993330 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=default-k8s-diff-port-993330 --network default-k8s-diff-port-993330 --ip 192.168.103.2 --volume default-k8s-diff-port-993330:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8444 --publish=127.0.0.1::8444 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185
I0401 20:26:24.677655 333931 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-993330 --format={{.State.Running}}
I0401 20:26:24.697969 333931 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-993330 --format={{.State.Status}}
I0401 20:26:24.727575 333931 cli_runner.go:164] Run: docker exec default-k8s-diff-port-993330 stat /var/lib/dpkg/alternatives/iptables
I0401 20:26:24.782583 333931 oci.go:144] the created container "default-k8s-diff-port-993330" has a running status.
I0401 20:26:24.782627 333931 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20506-16361/.minikube/machines/default-k8s-diff-port-993330/id_rsa...
I0401 20:26:25.212927 333931 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20506-16361/.minikube/machines/default-k8s-diff-port-993330/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0401 20:26:25.241317 333931 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-993330 --format={{.State.Status}}
I0401 20:26:25.267434 333931 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0401 20:26:25.267458 333931 kic_runner.go:114] Args: [docker exec --privileged default-k8s-diff-port-993330 chown docker:docker /home/docker/.ssh/authorized_keys]
I0401 20:26:25.329230 333931 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-993330 --format={{.State.Status}}
I0401 20:26:25.353890 333931 machine.go:93] provisionDockerMachine start ...
I0401 20:26:25.353997 333931 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-993330
I0401 20:26:25.375999 333931 main.go:141] libmachine: Using SSH client type: native
I0401 20:26:25.376240 333931 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 127.0.0.1 33103 <nil> <nil>}
I0401 20:26:25.376255 333931 main.go:141] libmachine: About to run SSH command:
hostname
I0401 20:26:25.513557 333931 main.go:141] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-993330
I0401 20:26:25.513586 333931 ubuntu.go:169] provisioning hostname "default-k8s-diff-port-993330"
I0401 20:26:25.513655 333931 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-993330
I0401 20:26:25.540806 333931 main.go:141] libmachine: Using SSH client type: native
I0401 20:26:25.541102 333931 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 127.0.0.1 33103 <nil> <nil>}
I0401 20:26:25.541127 333931 main.go:141] libmachine: About to run SSH command:
sudo hostname default-k8s-diff-port-993330 && echo "default-k8s-diff-port-993330" | sudo tee /etc/hostname
I0401 20:26:25.698212 333931 main.go:141] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-993330
I0401 20:26:25.698298 333931 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-993330
I0401 20:26:25.720353 333931 main.go:141] libmachine: Using SSH client type: native
I0401 20:26:25.720578 333931 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 127.0.0.1 33103 <nil> <nil>}
I0401 20:26:25.720601 333931 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sdefault-k8s-diff-port-993330' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-993330/g' /etc/hosts;
else
echo '127.0.1.1 default-k8s-diff-port-993330' | sudo tee -a /etc/hosts;
fi
fi
I0401 20:26:25.858508 333931 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0401 20:26:25.858541 333931 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/20506-16361/.minikube CaCertPath:/home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20506-16361/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20506-16361/.minikube}
I0401 20:26:25.858600 333931 ubuntu.go:177] setting up certificates
I0401 20:26:25.858616 333931 provision.go:84] configureAuth start
I0401 20:26:25.858676 333931 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-993330
I0401 20:26:25.884955 333931 provision.go:143] copyHostCerts
I0401 20:26:25.885010 333931 exec_runner.go:144] found /home/jenkins/minikube-integration/20506-16361/.minikube/ca.pem, removing ...
I0401 20:26:25.885017 333931 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20506-16361/.minikube/ca.pem
I0401 20:26:25.885078 333931 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20506-16361/.minikube/ca.pem (1078 bytes)
I0401 20:26:25.885156 333931 exec_runner.go:144] found /home/jenkins/minikube-integration/20506-16361/.minikube/cert.pem, removing ...
I0401 20:26:25.885160 333931 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20506-16361/.minikube/cert.pem
I0401 20:26:25.885189 333931 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20506-16361/.minikube/cert.pem (1123 bytes)
I0401 20:26:25.885238 333931 exec_runner.go:144] found /home/jenkins/minikube-integration/20506-16361/.minikube/key.pem, removing ...
I0401 20:26:25.885242 333931 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20506-16361/.minikube/key.pem
I0401 20:26:25.885264 333931 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20506-16361/.minikube/key.pem (1675 bytes)
I0401 20:26:25.885307 333931 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20506-16361/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca-key.pem org=jenkins.default-k8s-diff-port-993330 san=[127.0.0.1 192.168.103.2 default-k8s-diff-port-993330 localhost minikube]
I0401 20:26:26.231155 333931 provision.go:177] copyRemoteCerts
I0401 20:26:26.231203 333931 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0401 20:26:26.231240 333931 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-993330
I0401 20:26:26.253691 333931 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33103 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/default-k8s-diff-port-993330/id_rsa Username:docker}
I0401 20:26:26.355444 333931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0401 20:26:26.387181 333931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
I0401 20:26:26.412042 333931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0401 20:26:26.437283 333931 provision.go:87] duration metric: took 578.65574ms to configureAuth
I0401 20:26:26.437311 333931 ubuntu.go:193] setting minikube options for container-runtime
I0401 20:26:26.437495 333931 config.go:182] Loaded profile config "default-k8s-diff-port-993330": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0401 20:26:26.437593 333931 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-993330
I0401 20:26:26.458786 333931 main.go:141] libmachine: Using SSH client type: native
I0401 20:26:26.459087 333931 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x836360] 0x839060 <nil> [] 0s} 127.0.0.1 33103 <nil> <nil>}
I0401 20:26:26.459115 333931 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I0401 20:26:26.705379 333931 main.go:141] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I0401 20:26:26.705407 333931 machine.go:96] duration metric: took 1.351492058s to provisionDockerMachine
I0401 20:26:26.705418 333931 client.go:171] duration metric: took 7.674616564s to LocalClient.Create
I0401 20:26:26.705435 333931 start.go:167] duration metric: took 7.674676457s to libmachine.API.Create "default-k8s-diff-port-993330"
I0401 20:26:26.705445 333931 start.go:293] postStartSetup for "default-k8s-diff-port-993330" (driver="docker")
I0401 20:26:26.705458 333931 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0401 20:26:26.705523 333931 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0401 20:26:26.705571 333931 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-993330
I0401 20:26:26.729203 333931 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33103 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/default-k8s-diff-port-993330/id_rsa Username:docker}
I0401 20:26:26.828975 333931 ssh_runner.go:195] Run: cat /etc/os-release
I0401 20:26:26.833808 333931 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0401 20:26:26.833879 333931 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0401 20:26:26.833894 333931 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0401 20:26:26.833902 333931 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0401 20:26:26.833920 333931 filesync.go:126] Scanning /home/jenkins/minikube-integration/20506-16361/.minikube/addons for local assets ...
I0401 20:26:26.833982 333931 filesync.go:126] Scanning /home/jenkins/minikube-integration/20506-16361/.minikube/files for local assets ...
I0401 20:26:26.834088 333931 filesync.go:149] local asset: /home/jenkins/minikube-integration/20506-16361/.minikube/files/etc/ssl/certs/231632.pem -> 231632.pem in /etc/ssl/certs
I0401 20:26:26.834227 333931 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0401 20:26:26.847553 333931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/files/etc/ssl/certs/231632.pem --> /etc/ssl/certs/231632.pem (1708 bytes)
I0401 20:26:26.882157 333931 start.go:296] duration metric: took 176.700033ms for postStartSetup
I0401 20:26:26.882438 333931 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-993330
I0401 20:26:26.907978 333931 profile.go:143] Saving config to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/config.json ...
I0401 20:26:26.908226 333931 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0401 20:26:26.908265 333931 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-993330
I0401 20:26:26.931569 333931 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33103 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/default-k8s-diff-port-993330/id_rsa Username:docker}
I0401 20:26:27.031621 333931 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0401 20:26:27.037649 333931 start.go:128] duration metric: took 8.010390339s to createHost
I0401 20:26:27.037674 333931 start.go:83] releasing machines lock for "default-k8s-diff-port-993330", held for 8.010551296s
I0401 20:26:27.037773 333931 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-993330
I0401 20:26:27.063446 333931 ssh_runner.go:195] Run: cat /version.json
I0401 20:26:27.063461 333931 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0401 20:26:27.063512 333931 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-993330
I0401 20:26:27.063516 333931 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-993330
I0401 20:26:27.085169 333931 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33103 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/default-k8s-diff-port-993330/id_rsa Username:docker}
I0401 20:26:27.085851 333931 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33103 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/default-k8s-diff-port-993330/id_rsa Username:docker}
I0401 20:26:27.177526 333931 ssh_runner.go:195] Run: systemctl --version
I0401 20:26:27.254625 333931 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I0401 20:26:27.408621 333931 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0401 20:26:27.412929 333931 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0401 20:26:27.435652 333931 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
I0401 20:26:27.435786 333931 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0401 20:26:27.476503 333931 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0401 20:26:27.476525 333931 start.go:495] detecting cgroup driver to use...
I0401 20:26:27.476553 333931 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0401 20:26:27.476590 333931 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0401 20:26:27.492778 333931 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0401 20:26:27.504743 333931 docker.go:217] disabling cri-docker service (if available) ...
I0401 20:26:27.504810 333931 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0401 20:26:27.517961 333931 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0401 20:26:27.540325 333931 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0401 20:26:27.626850 333931 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0401 20:26:27.722127 333931 docker.go:233] disabling docker service ...
I0401 20:26:27.722208 333931 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0401 20:26:27.745690 333931 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0401 20:26:27.766319 333931 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0401 20:26:27.872763 333931 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0401 20:26:27.977279 333931 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0401 20:26:27.988271 333931 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I0401 20:26:28.004096 333931 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...
I0401 20:26:28.004153 333931 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:26:28.013450 333931 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I0401 20:26:28.013563 333931 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:26:28.029498 333931 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:26:28.046442 333931 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:26:28.058158 333931 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0401 20:26:28.068534 333931 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:26:28.080526 333931 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:26:28.095360 333931 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I0401 20:26:28.104061 333931 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0401 20:26:28.112928 333931 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0401 20:26:28.122276 333931 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 20:26:28.213597 333931 ssh_runner.go:195] Run: sudo systemctl restart crio
I0401 20:26:28.346275 333931 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
I0401 20:26:28.346362 333931 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I0401 20:26:28.354158 333931 start.go:563] Will wait 60s for crictl version
I0401 20:26:28.354224 333931 ssh_runner.go:195] Run: which crictl
I0401 20:26:28.359100 333931 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0401 20:26:28.396091 333931 start.go:579] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.24.6
RuntimeApiVersion: v1
I0401 20:26:28.396155 333931 ssh_runner.go:195] Run: crio --version
I0401 20:26:28.442519 333931 ssh_runner.go:195] Run: crio --version
I0401 20:26:28.489089 333931 out.go:177] * Preparing Kubernetes v1.32.2 on CRI-O 1.24.6 ...
I0401 20:26:28.490297 333931 cli_runner.go:164] Run: docker network inspect default-k8s-diff-port-993330 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0401 20:26:28.509926 333931 ssh_runner.go:195] Run: grep 192.168.103.1 host.minikube.internal$ /etc/hosts
I0401 20:26:28.513490 333931 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.103.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0401 20:26:28.526892 333931 kubeadm.go:883] updating cluster {Name:default-k8s-diff-port-993330 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:default-k8s-diff-port-993330 Namespace:default APIServerHAVIP: APISer
verName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8444 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disab
leMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0401 20:26:28.527052 333931 preload.go:131] Checking if preload exists for k8s version v1.32.2 and runtime crio
I0401 20:26:28.527122 333931 ssh_runner.go:195] Run: sudo crictl images --output json
I0401 20:26:28.614091 333931 crio.go:514] all images are preloaded for cri-o runtime.
I0401 20:26:28.614117 333931 crio.go:433] Images already preloaded, skipping extraction
I0401 20:26:28.614176 333931 ssh_runner.go:195] Run: sudo crictl images --output json
I0401 20:26:28.660869 333931 crio.go:514] all images are preloaded for cri-o runtime.
I0401 20:26:28.660895 333931 cache_images.go:84] Images are preloaded, skipping loading
I0401 20:26:28.660905 333931 kubeadm.go:934] updating node { 192.168.103.2 8444 v1.32.2 crio true true} ...
I0401 20:26:28.661007 333931 kubeadm.go:946] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.32.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=default-k8s-diff-port-993330 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.103.2
[Install]
config:
{KubernetesVersion:v1.32.2 ClusterName:default-k8s-diff-port-993330 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0401 20:26:28.661091 333931 ssh_runner.go:195] Run: crio config
I0401 20:26:28.708765 333931 cni.go:84] Creating CNI manager for ""
I0401 20:26:28.708807 333931 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0401 20:26:28.708857 333931 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0401 20:26:28.708894 333931 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.103.2 APIServerPort:8444 KubernetesVersion:v1.32.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-993330 NodeName:default-k8s-diff-port-993330 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.103.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.103.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/
ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0401 20:26:28.709044 333931 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.103.2
bindPort: 8444
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "default-k8s-diff-port-993330"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.103.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.103.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8444
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
- name: "proxy-refresh-interval"
value: "70000"
kubernetesVersion: v1.32.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0401 20:26:28.709114 333931 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.32.2
I0401 20:26:28.719490 333931 binaries.go:44] Found k8s binaries, skipping transfer
I0401 20:26:28.719560 333931 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0401 20:26:28.729732 333931 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (379 bytes)
I0401 20:26:28.754183 333931 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0401 20:26:28.780989 333931 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2305 bytes)
I0401 20:26:28.798890 333931 ssh_runner.go:195] Run: grep 192.168.103.2 control-plane.minikube.internal$ /etc/hosts
I0401 20:26:28.802435 333931 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.103.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0401 20:26:28.815031 333931 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 20:26:28.910070 333931 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0401 20:26:28.925155 333931 certs.go:68] Setting up /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330 for IP: 192.168.103.2
I0401 20:26:28.925176 333931 certs.go:194] generating shared ca certs ...
I0401 20:26:28.925195 333931 certs.go:226] acquiring lock for ca certs: {Name:mkd05003433d6acd6ff5e2aab58050e1004ceb11 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:28.925359 333931 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20506-16361/.minikube/ca.key
I0401 20:26:28.925412 333931 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20506-16361/.minikube/proxy-client-ca.key
I0401 20:26:28.925420 333931 certs.go:256] generating profile certs ...
I0401 20:26:28.925495 333931 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/client.key
I0401 20:26:28.925513 333931 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/client.crt with IP's: []
I0401 20:26:29.281951 333931 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/client.crt ...
I0401 20:26:29.281989 333931 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/client.crt: {Name:mk6b013708c87e84a520dd06c1ed59d935facbef Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:29.282216 333931 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/client.key ...
I0401 20:26:29.282235 333931 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/client.key: {Name:mk1377b596a46d9d05fab9e2aadea7e4ab7f7f4e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:29.282354 333931 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/apiserver.key.604428a1
I0401 20:26:29.282382 333931 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/apiserver.crt.604428a1 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.103.2]
I0401 20:26:29.465070 333931 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/apiserver.crt.604428a1 ...
I0401 20:26:29.465097 333931 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/apiserver.crt.604428a1: {Name:mkea6ce05ac60d3127494f34ad7738f4f7a9cd35 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:29.465262 333931 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/apiserver.key.604428a1 ...
I0401 20:26:29.465275 333931 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/apiserver.key.604428a1: {Name:mk5a5ce03c2007d1b6b62ccbf68a08ed19a29dda Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:29.465348 333931 certs.go:381] copying /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/apiserver.crt.604428a1 -> /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/apiserver.crt
I0401 20:26:29.465414 333931 certs.go:385] copying /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/apiserver.key.604428a1 -> /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/apiserver.key
I0401 20:26:29.465465 333931 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/proxy-client.key
I0401 20:26:29.465484 333931 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/proxy-client.crt with IP's: []
I0401 20:26:29.611491 333931 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/proxy-client.crt ...
I0401 20:26:29.611522 333931 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/proxy-client.crt: {Name:mk66e03f24770b70caf6b1a40486800503c8b2bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:29.611688 333931 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/proxy-client.key ...
I0401 20:26:29.611707 333931 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/proxy-client.key: {Name:mkc22fc28da1642635a034d156c68114235b18db Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:29.611877 333931 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/23163.pem (1338 bytes)
W0401 20:26:29.611912 333931 certs.go:480] ignoring /home/jenkins/minikube-integration/20506-16361/.minikube/certs/23163_empty.pem, impossibly tiny 0 bytes
I0401 20:26:29.611922 333931 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca-key.pem (1679 bytes)
I0401 20:26:29.611942 333931 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/ca.pem (1078 bytes)
I0401 20:26:29.611962 333931 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/cert.pem (1123 bytes)
I0401 20:26:29.611983 333931 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/certs/key.pem (1675 bytes)
I0401 20:26:29.612034 333931 certs.go:484] found cert: /home/jenkins/minikube-integration/20506-16361/.minikube/files/etc/ssl/certs/231632.pem (1708 bytes)
I0401 20:26:29.612583 333931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0401 20:26:29.638146 333931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0401 20:26:29.669130 333931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0401 20:26:29.694857 333931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0401 20:26:29.718710 333931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
I0401 20:26:29.753534 333931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0401 20:26:29.782658 333931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0401 20:26:29.806962 333931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/profiles/default-k8s-diff-port-993330/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0401 20:26:29.839501 333931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/certs/23163.pem --> /usr/share/ca-certificates/23163.pem (1338 bytes)
I0401 20:26:29.871232 333931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/files/etc/ssl/certs/231632.pem --> /usr/share/ca-certificates/231632.pem (1708 bytes)
I0401 20:26:29.893112 333931 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20506-16361/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0401 20:26:29.914364 333931 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0401 20:26:29.934661 333931 ssh_runner.go:195] Run: openssl version
I0401 20:26:29.941216 333931 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0401 20:26:29.952171 333931 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0401 20:26:29.956504 333931 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 1 19:46 /usr/share/ca-certificates/minikubeCA.pem
I0401 20:26:29.956566 333931 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0401 20:26:29.963803 333931 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0401 20:26:29.977730 333931 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/23163.pem && ln -fs /usr/share/ca-certificates/23163.pem /etc/ssl/certs/23163.pem"
I0401 20:26:29.987911 333931 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/23163.pem
I0401 20:26:29.991232 333931 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 1 19:52 /usr/share/ca-certificates/23163.pem
I0401 20:26:29.991300 333931 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/23163.pem
I0401 20:26:29.997632 333931 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/23163.pem /etc/ssl/certs/51391683.0"
I0401 20:26:30.006149 333931 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/231632.pem && ln -fs /usr/share/ca-certificates/231632.pem /etc/ssl/certs/231632.pem"
I0401 20:26:30.014612 333931 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/231632.pem
I0401 20:26:30.018527 333931 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 1 19:52 /usr/share/ca-certificates/231632.pem
I0401 20:26:30.018590 333931 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/231632.pem
I0401 20:26:30.025087 333931 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/231632.pem /etc/ssl/certs/3ec20f2e.0"
I0401 20:26:30.034266 333931 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0401 20:26:30.037338 333931 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0401 20:26:30.037388 333931 kubeadm.go:392] StartCluster: {Name:default-k8s-diff-port-993330 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.46-1741860993-20523@sha256:cd976907fa4d517c84fff1e5ef773b9fb3c738c4e1ded824ea5133470a66e185 Memory:2200 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.32.2 ClusterName:default-k8s-diff-port-993330 Namespace:default APIServerHAVIP: APIServer
Name:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.103.2 Port:8444 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0401 20:26:30.037477 333931 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I0401 20:26:30.037539 333931 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0401 20:26:30.072855 333931 cri.go:89] found id: ""
I0401 20:26:30.072920 333931 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0401 20:26:30.081457 333931 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0401 20:26:30.089669 333931 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0401 20:26:30.089712 333931 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0401 20:26:30.097449 333931 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0401 20:26:30.097463 333931 kubeadm.go:157] found existing configuration files:
I0401 20:26:30.097501 333931 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf
I0401 20:26:30.105087 333931 kubeadm.go:163] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0401 20:26:30.105130 333931 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0401 20:26:30.112747 333931 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf
I0401 20:26:30.120867 333931 kubeadm.go:163] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0401 20:26:30.120923 333931 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0401 20:26:30.128580 333931 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf
I0401 20:26:30.137287 333931 kubeadm.go:163] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0401 20:26:30.137341 333931 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0401 20:26:30.145231 333931 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf
I0401 20:26:30.153534 333931 kubeadm.go:163] "https://control-plane.minikube.internal:8444" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8444 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0401 20:26:30.153588 333931 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0401 20:26:30.161477 333931 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.32.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0401 20:26:30.198560 333931 kubeadm.go:310] [init] Using Kubernetes version: v1.32.2
I0401 20:26:30.198667 333931 kubeadm.go:310] [preflight] Running pre-flight checks
I0401 20:26:30.216234 333931 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0401 20:26:30.216434 333931 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1078-gcp[0m
I0401 20:26:30.216506 333931 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0401 20:26:30.216598 333931 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0401 20:26:30.216690 333931 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0401 20:26:30.216799 333931 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0401 20:26:30.216889 333931 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0401 20:26:30.216959 333931 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0401 20:26:30.217064 333931 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0401 20:26:30.217146 333931 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0401 20:26:30.217232 333931 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0401 20:26:30.217308 333931 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0401 20:26:30.273810 333931 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0401 20:26:30.273932 333931 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0401 20:26:30.274042 333931 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0401 20:26:30.281527 333931 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0401 20:26:26.812879 330894 out.go:235] - Generating certificates and keys ...
I0401 20:26:26.812982 330894 kubeadm.go:310] [certs] Using existing ca certificate authority
I0401 20:26:26.813062 330894 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0401 20:26:26.990038 330894 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0401 20:26:27.075365 330894 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0401 20:26:27.240420 330894 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0401 20:26:27.671842 330894 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0401 20:26:27.950747 330894 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0401 20:26:27.950932 330894 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [embed-certs-974821 localhost] and IPs [192.168.94.2 127.0.0.1 ::1]
I0401 20:26:28.122258 330894 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0401 20:26:28.122505 330894 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [embed-certs-974821 localhost] and IPs [192.168.94.2 127.0.0.1 ::1]
I0401 20:26:28.324660 330894 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0401 20:26:28.698594 330894 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0401 20:26:28.980523 330894 kubeadm.go:310] [certs] Generating "sa" key and public key
I0401 20:26:28.980792 330894 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0401 20:26:29.069840 330894 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0401 20:26:29.152275 330894 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0401 20:26:29.514308 330894 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0401 20:26:29.980640 330894 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0401 20:26:30.605506 330894 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0401 20:26:30.606016 330894 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0401 20:26:30.608326 330894 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0401 20:26:30.610434 330894 out.go:235] - Booting up control plane ...
I0401 20:26:30.610589 330894 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0401 20:26:30.610705 330894 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0401 20:26:30.611574 330894 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0401 20:26:30.621508 330894 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0401 20:26:30.627282 330894 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0401 20:26:30.627348 330894 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0401 20:26:31.315349 320217 kubeadm.go:310] [api-check] The API server is healthy after 4.502019518s
I0401 20:26:31.335358 320217 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0401 20:26:31.346880 320217 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0401 20:26:31.366089 320217 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0401 20:26:31.366379 320217 kubeadm.go:310] [mark-control-plane] Marking the node no-preload-671514 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0401 20:26:31.373667 320217 kubeadm.go:310] [bootstrap-token] Using token: v2u2yj.f0z2c0dsnua55yd0
I0401 20:26:27.266570 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:27.766918 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:28.266941 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:28.766395 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:29.266515 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:29.767351 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:30.266722 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:30.766361 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:31.266995 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:31.766839 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:31.374977 320217 out.go:235] - Configuring RBAC rules ...
I0401 20:26:31.375115 320217 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0401 20:26:31.379816 320217 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0401 20:26:31.386334 320217 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0401 20:26:31.388802 320217 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0401 20:26:31.391232 320217 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0401 20:26:31.394153 320217 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0401 20:26:31.722786 320217 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0401 20:26:32.174300 320217 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0401 20:26:32.723393 320217 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0401 20:26:32.724543 320217 kubeadm.go:310]
I0401 20:26:32.724651 320217 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0401 20:26:32.724664 320217 kubeadm.go:310]
I0401 20:26:32.724775 320217 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0401 20:26:32.724787 320217 kubeadm.go:310]
I0401 20:26:32.724824 320217 kubeadm.go:310] mkdir -p $HOME/.kube
I0401 20:26:32.724911 320217 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0401 20:26:32.724987 320217 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0401 20:26:32.724997 320217 kubeadm.go:310]
I0401 20:26:32.725074 320217 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0401 20:26:32.725082 320217 kubeadm.go:310]
I0401 20:26:32.725154 320217 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0401 20:26:32.725166 320217 kubeadm.go:310]
I0401 20:26:32.725241 320217 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0401 20:26:32.725350 320217 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0401 20:26:32.725455 320217 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0401 20:26:32.725467 320217 kubeadm.go:310]
I0401 20:26:32.725587 320217 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0401 20:26:32.725710 320217 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0401 20:26:32.725721 320217 kubeadm.go:310]
I0401 20:26:32.725870 320217 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token v2u2yj.f0z2c0dsnua55yd0 \
I0401 20:26:32.726022 320217 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:3d93fb35a345f61a73d1a5c805e66c154297b8bb9225b71f12b591697818ec37 \
I0401 20:26:32.726056 320217 kubeadm.go:310] --control-plane
I0401 20:26:32.726067 320217 kubeadm.go:310]
I0401 20:26:32.726193 320217 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0401 20:26:32.726204 320217 kubeadm.go:310]
I0401 20:26:32.726320 320217 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token v2u2yj.f0z2c0dsnua55yd0 \
I0401 20:26:32.726469 320217 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:3d93fb35a345f61a73d1a5c805e66c154297b8bb9225b71f12b591697818ec37
I0401 20:26:32.729728 320217 kubeadm.go:310] [WARNING SystemVerification]: cgroups v1 support is in maintenance mode, please migrate to cgroups v2
I0401 20:26:32.730022 320217 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1078-gcp\n", err: exit status 1
I0401 20:26:32.730191 320217 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0401 20:26:32.730219 320217 cni.go:84] Creating CNI manager for ""
I0401 20:26:32.730232 320217 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0401 20:26:32.732410 320217 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0401 20:26:32.733706 320217 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0401 20:26:32.738954 320217 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.32.2/kubectl ...
I0401 20:26:32.738974 320217 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0401 20:26:30.284751 333931 out.go:235] - Generating certificates and keys ...
I0401 20:26:30.284847 333931 kubeadm.go:310] [certs] Using existing ca certificate authority
I0401 20:26:30.284901 333931 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0401 20:26:30.404295 333931 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0401 20:26:30.590835 333931 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0401 20:26:30.690873 333931 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0401 20:26:30.799742 333931 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0401 20:26:31.033161 333931 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0401 20:26:31.033434 333931 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [default-k8s-diff-port-993330 localhost] and IPs [192.168.103.2 127.0.0.1 ::1]
I0401 20:26:31.368534 333931 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0401 20:26:31.368741 333931 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [default-k8s-diff-port-993330 localhost] and IPs [192.168.103.2 127.0.0.1 ::1]
I0401 20:26:31.553327 333931 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0401 20:26:31.704997 333931 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0401 20:26:31.942936 333931 kubeadm.go:310] [certs] Generating "sa" key and public key
I0401 20:26:31.943238 333931 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0401 20:26:32.110376 333931 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0401 20:26:32.206799 333931 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0401 20:26:32.461113 333931 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0401 20:26:32.741829 333931 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0401 20:26:32.890821 333931 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0401 20:26:32.891603 333931 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0401 20:26:32.894643 333931 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0401 20:26:32.896444 333931 out.go:235] - Booting up control plane ...
I0401 20:26:32.896578 333931 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0401 20:26:32.896677 333931 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0401 20:26:32.897497 333931 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0401 20:26:32.907942 333931 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0401 20:26:32.914928 333931 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0401 20:26:32.915037 333931 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0401 20:26:33.016556 333931 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0401 20:26:33.016705 333931 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0401 20:26:30.718671 330894 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0401 20:26:30.718822 330894 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0401 20:26:31.220016 330894 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 501.470178ms
I0401 20:26:31.220166 330894 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0401 20:26:36.222594 330894 kubeadm.go:310] [api-check] The API server is healthy after 5.002496615s
I0401 20:26:36.235583 330894 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0401 20:26:36.249901 330894 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0401 20:26:36.277246 330894 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0401 20:26:36.277520 330894 kubeadm.go:310] [mark-control-plane] Marking the node embed-certs-974821 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0401 20:26:36.286921 330894 kubeadm.go:310] [bootstrap-token] Using token: jv93nh.i3b9z4yv7qswasld
I0401 20:26:32.267336 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:32.767370 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:33.266984 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:33.766978 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:34.266517 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:34.766984 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:35.266596 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:35.767257 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:36.266597 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:36.767309 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:32.763227 320217 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0401 20:26:33.071865 320217 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0401 20:26:33.071993 320217 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:33.072093 320217 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes no-preload-671514 minikube.k8s.io/updated_at=2025_04_01T20_26_33_0700 minikube.k8s.io/version=v1.35.0 minikube.k8s.io/commit=73c6e1c927350a51068882397e0642f8dfb63f2a minikube.k8s.io/name=no-preload-671514 minikube.k8s.io/primary=true
I0401 20:26:33.175980 320217 ops.go:34] apiserver oom_adj: -16
I0401 20:26:33.176076 320217 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:33.677193 320217 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:34.176502 320217 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:34.676231 320217 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:35.176527 320217 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:35.676298 320217 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:36.176529 320217 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:36.677167 320217 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:37.176802 320217 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:37.278447 320217 kubeadm.go:1113] duration metric: took 4.206494119s to wait for elevateKubeSystemPrivileges
I0401 20:26:37.278489 320217 kubeadm.go:394] duration metric: took 15.003095359s to StartCluster
I0401 20:26:37.278512 320217 settings.go:142] acquiring lock: {Name:mk97b1c786280c2571e72d442bae7d86f342cc2c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:37.278583 320217 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/20506-16361/kubeconfig
I0401 20:26:37.279329 320217 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/kubeconfig: {Name:mk2c8ba46a7915412f877cabac9093904e092601 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:37.279550 320217 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}
I0401 20:26:37.279680 320217 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0401 20:26:37.279711 320217 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0401 20:26:37.279836 320217 addons.go:69] Setting storage-provisioner=true in profile "no-preload-671514"
I0401 20:26:37.279863 320217 addons.go:238] Setting addon storage-provisioner=true in "no-preload-671514"
I0401 20:26:37.279894 320217 config.go:182] Loaded profile config "no-preload-671514": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0401 20:26:37.279899 320217 addons.go:69] Setting default-storageclass=true in profile "no-preload-671514"
I0401 20:26:37.279902 320217 host.go:66] Checking if "no-preload-671514" exists ...
I0401 20:26:37.279915 320217 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "no-preload-671514"
I0401 20:26:37.280266 320217 cli_runner.go:164] Run: docker container inspect no-preload-671514 --format={{.State.Status}}
I0401 20:26:37.280505 320217 cli_runner.go:164] Run: docker container inspect no-preload-671514 --format={{.State.Status}}
I0401 20:26:37.281094 320217 out.go:177] * Verifying Kubernetes components...
I0401 20:26:37.282386 320217 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 20:26:37.302764 320217 addons.go:238] Setting addon default-storageclass=true in "no-preload-671514"
I0401 20:26:37.302802 320217 host.go:66] Checking if "no-preload-671514" exists ...
I0401 20:26:37.303094 320217 cli_runner.go:164] Run: docker container inspect no-preload-671514 --format={{.State.Status}}
I0401 20:26:37.304839 320217 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0401 20:26:36.288406 330894 out.go:235] - Configuring RBAC rules ...
I0401 20:26:36.288562 330894 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0401 20:26:36.295218 330894 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0401 20:26:36.302469 330894 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0401 20:26:36.305295 330894 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0401 20:26:36.309869 330894 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0401 20:26:36.314191 330894 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0401 20:26:36.635951 330894 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0401 20:26:37.059943 330894 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0401 20:26:37.629951 330894 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0401 20:26:37.631276 330894 kubeadm.go:310]
I0401 20:26:37.631368 330894 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0401 20:26:37.631398 330894 kubeadm.go:310]
I0401 20:26:37.631497 330894 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0401 20:26:37.631505 330894 kubeadm.go:310]
I0401 20:26:37.631535 330894 kubeadm.go:310] mkdir -p $HOME/.kube
I0401 20:26:37.631609 330894 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0401 20:26:37.631668 330894 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0401 20:26:37.631678 330894 kubeadm.go:310]
I0401 20:26:37.631753 330894 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0401 20:26:37.631762 330894 kubeadm.go:310]
I0401 20:26:37.631817 330894 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0401 20:26:37.631824 330894 kubeadm.go:310]
I0401 20:26:37.631887 330894 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0401 20:26:37.632009 330894 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0401 20:26:37.632130 330894 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0401 20:26:37.632148 330894 kubeadm.go:310]
I0401 20:26:37.632267 330894 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0401 20:26:37.632379 330894 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0401 20:26:37.632399 330894 kubeadm.go:310]
I0401 20:26:37.632522 330894 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token jv93nh.i3b9z4yv7qswasld \
I0401 20:26:37.632661 330894 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:3d93fb35a345f61a73d1a5c805e66c154297b8bb9225b71f12b591697818ec37 \
I0401 20:26:37.632687 330894 kubeadm.go:310] --control-plane
I0401 20:26:37.632693 330894 kubeadm.go:310]
I0401 20:26:37.632803 330894 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0401 20:26:37.632809 330894 kubeadm.go:310]
I0401 20:26:37.632932 330894 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token jv93nh.i3b9z4yv7qswasld \
I0401 20:26:37.633069 330894 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:3d93fb35a345f61a73d1a5c805e66c154297b8bb9225b71f12b591697818ec37
I0401 20:26:37.636726 330894 kubeadm.go:310] [WARNING SystemVerification]: cgroups v1 support is in maintenance mode, please migrate to cgroups v2
I0401 20:26:37.637011 330894 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1078-gcp\n", err: exit status 1
I0401 20:26:37.637144 330894 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0401 20:26:37.637172 330894 cni.go:84] Creating CNI manager for ""
I0401 20:26:37.637181 330894 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0401 20:26:37.639062 330894 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0401 20:26:37.306217 320217 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0401 20:26:37.306234 320217 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0401 20:26:37.306275 320217 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-671514
I0401 20:26:37.323290 320217 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
I0401 20:26:37.323315 320217 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0401 20:26:37.323369 320217 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" no-preload-671514
I0401 20:26:37.331420 320217 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/no-preload-671514/id_rsa Username:docker}
I0401 20:26:37.345142 320217 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33093 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/no-preload-671514/id_rsa Username:docker}
I0401 20:26:37.522615 320217 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.76.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0401 20:26:37.540123 320217 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0401 20:26:37.543553 320217 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0401 20:26:37.640023 320217 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0401 20:26:38.172685 320217 start.go:971] {"host.minikube.internal": 192.168.76.1} host record injected into CoreDNS's ConfigMap
I0401 20:26:38.436398 320217 node_ready.go:35] waiting up to 6m0s for node "no-preload-671514" to be "Ready" ...
I0401 20:26:38.445032 320217 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
I0401 20:26:34.018093 333931 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001682271s
I0401 20:26:34.018217 333931 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0401 20:26:38.520345 333931 kubeadm.go:310] [api-check] The API server is healthy after 4.502202922s
I0401 20:26:38.531202 333931 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0401 20:26:38.540027 333931 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0401 20:26:38.556557 333931 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0401 20:26:38.556824 333931 kubeadm.go:310] [mark-control-plane] Marking the node default-k8s-diff-port-993330 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0401 20:26:38.563300 333931 kubeadm.go:310] [bootstrap-token] Using token: 2lh0m0.lu1o5bo0yjsw64dl
I0401 20:26:38.564844 333931 out.go:235] - Configuring RBAC rules ...
I0401 20:26:38.564988 333931 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0401 20:26:38.567957 333931 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0401 20:26:38.573118 333931 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0401 20:26:38.576607 333931 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0401 20:26:38.578930 333931 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0401 20:26:38.581375 333931 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0401 20:26:38.925681 333931 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0401 20:26:39.351078 333931 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0401 20:26:39.926955 333931 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0401 20:26:39.927840 333931 kubeadm.go:310]
I0401 20:26:39.927902 333931 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0401 20:26:39.927928 333931 kubeadm.go:310]
I0401 20:26:39.928044 333931 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0401 20:26:39.928060 333931 kubeadm.go:310]
I0401 20:26:39.928086 333931 kubeadm.go:310] mkdir -p $HOME/.kube
I0401 20:26:39.928167 333931 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0401 20:26:39.928278 333931 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0401 20:26:39.928289 333931 kubeadm.go:310]
I0401 20:26:39.928359 333931 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0401 20:26:39.928370 333931 kubeadm.go:310]
I0401 20:26:39.928436 333931 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0401 20:26:39.928446 333931 kubeadm.go:310]
I0401 20:26:39.928526 333931 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0401 20:26:39.928612 333931 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0401 20:26:39.928705 333931 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0401 20:26:39.928715 333931 kubeadm.go:310]
I0401 20:26:39.928829 333931 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0401 20:26:39.928936 333931 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0401 20:26:39.928947 333931 kubeadm.go:310]
I0401 20:26:39.929063 333931 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8444 --token 2lh0m0.lu1o5bo0yjsw64dl \
I0401 20:26:39.929213 333931 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:3d93fb35a345f61a73d1a5c805e66c154297b8bb9225b71f12b591697818ec37 \
I0401 20:26:39.929237 333931 kubeadm.go:310] --control-plane
I0401 20:26:39.929241 333931 kubeadm.go:310]
I0401 20:26:39.929308 333931 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0401 20:26:39.929314 333931 kubeadm.go:310]
I0401 20:26:39.929387 333931 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8444 --token 2lh0m0.lu1o5bo0yjsw64dl \
I0401 20:26:39.929489 333931 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:3d93fb35a345f61a73d1a5c805e66c154297b8bb9225b71f12b591697818ec37
I0401 20:26:39.931816 333931 kubeadm.go:310] [WARNING SystemVerification]: cgroups v1 support is in maintenance mode, please migrate to cgroups v2
I0401 20:26:39.932039 333931 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1078-gcp\n", err: exit status 1
I0401 20:26:39.932158 333931 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0401 20:26:39.932194 333931 cni.go:84] Creating CNI manager for ""
I0401 20:26:39.932202 333931 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
I0401 20:26:39.933739 333931 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0401 20:26:37.640277 330894 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0401 20:26:37.645480 330894 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.32.2/kubectl ...
I0401 20:26:37.645520 330894 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0401 20:26:37.663929 330894 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0401 20:26:38.020915 330894 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0401 20:26:38.021121 330894 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:38.021228 330894 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes embed-certs-974821 minikube.k8s.io/updated_at=2025_04_01T20_26_38_0700 minikube.k8s.io/version=v1.35.0 minikube.k8s.io/commit=73c6e1c927350a51068882397e0642f8dfb63f2a minikube.k8s.io/name=embed-certs-974821 minikube.k8s.io/primary=true
I0401 20:26:38.194466 330894 ops.go:34] apiserver oom_adj: -16
I0401 20:26:38.194609 330894 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:38.694720 330894 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:39.194956 330894 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:39.695587 330894 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:40.195419 330894 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:40.694763 330894 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:37.266993 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:37.766426 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:38.266400 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:38.767030 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:39.266608 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:39.766436 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:40.267001 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:40.767416 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:41.266944 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:41.766662 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:41.195260 330894 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:41.694911 330894 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:42.194732 330894 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:42.294801 330894 kubeadm.go:1113] duration metric: took 4.2737406s to wait for elevateKubeSystemPrivileges
I0401 20:26:42.294833 330894 kubeadm.go:394] duration metric: took 15.78469047s to StartCluster
I0401 20:26:42.294856 330894 settings.go:142] acquiring lock: {Name:mk97b1c786280c2571e72d442bae7d86f342cc2c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:42.294916 330894 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/20506-16361/kubeconfig
I0401 20:26:42.298069 330894 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/kubeconfig: {Name:mk2c8ba46a7915412f877cabac9093904e092601 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:42.302205 330894 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}
I0401 20:26:42.302395 330894 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0401 20:26:42.302735 330894 config.go:182] Loaded profile config "embed-certs-974821": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0401 20:26:42.302795 330894 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0401 20:26:42.303010 330894 addons.go:69] Setting default-storageclass=true in profile "embed-certs-974821"
I0401 20:26:42.303039 330894 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-974821"
I0401 20:26:42.303016 330894 addons.go:69] Setting storage-provisioner=true in profile "embed-certs-974821"
I0401 20:26:42.303098 330894 addons.go:238] Setting addon storage-provisioner=true in "embed-certs-974821"
I0401 20:26:42.303134 330894 host.go:66] Checking if "embed-certs-974821" exists ...
I0401 20:26:42.303589 330894 cli_runner.go:164] Run: docker container inspect embed-certs-974821 --format={{.State.Status}}
I0401 20:26:42.303817 330894 out.go:177] * Verifying Kubernetes components...
I0401 20:26:42.303923 330894 cli_runner.go:164] Run: docker container inspect embed-certs-974821 --format={{.State.Status}}
I0401 20:26:42.305504 330894 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 20:26:42.333501 330894 addons.go:238] Setting addon default-storageclass=true in "embed-certs-974821"
I0401 20:26:42.333545 330894 host.go:66] Checking if "embed-certs-974821" exists ...
I0401 20:26:42.333933 330894 cli_runner.go:164] Run: docker container inspect embed-certs-974821 --format={{.State.Status}}
I0401 20:26:42.337940 330894 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0401 20:26:42.266968 318306 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.20.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:42.466972 318306 kubeadm.go:1113] duration metric: took 15.832229799s to wait for elevateKubeSystemPrivileges
I0401 20:26:42.467009 318306 kubeadm.go:394] duration metric: took 37.816397182s to StartCluster
I0401 20:26:42.467028 318306 settings.go:142] acquiring lock: {Name:mk97b1c786280c2571e72d442bae7d86f342cc2c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:42.467098 318306 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/20506-16361/kubeconfig
I0401 20:26:42.469304 318306 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/kubeconfig: {Name:mk2c8ba46a7915412f877cabac9093904e092601 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:42.469558 318306 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:crio ControlPlane:true Worker:true}
I0401 20:26:42.469667 318306 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0401 20:26:42.469700 318306 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0401 20:26:42.469867 318306 config.go:182] Loaded profile config "old-k8s-version-964633": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.20.0
I0401 20:26:42.469873 318306 addons.go:69] Setting default-storageclass=true in profile "old-k8s-version-964633"
I0401 20:26:42.469881 318306 addons.go:69] Setting storage-provisioner=true in profile "old-k8s-version-964633"
I0401 20:26:42.469894 318306 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-964633"
I0401 20:26:42.469901 318306 addons.go:238] Setting addon storage-provisioner=true in "old-k8s-version-964633"
I0401 20:26:42.469937 318306 host.go:66] Checking if "old-k8s-version-964633" exists ...
I0401 20:26:42.470179 318306 cli_runner.go:164] Run: docker container inspect old-k8s-version-964633 --format={{.State.Status}}
I0401 20:26:42.470479 318306 cli_runner.go:164] Run: docker container inspect old-k8s-version-964633 --format={{.State.Status}}
I0401 20:26:42.471691 318306 out.go:177] * Verifying Kubernetes components...
I0401 20:26:42.472775 318306 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 20:26:42.493228 318306 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0401 20:26:38.446284 320217 addons.go:514] duration metric: took 1.166586324s for enable addons: enabled=[storage-provisioner default-storageclass]
I0401 20:26:38.676260 320217 kapi.go:214] "coredns" deployment in "kube-system" namespace and "no-preload-671514" context rescaled to 1 replicas
I0401 20:26:40.439677 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:26:42.439724 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:26:42.339190 330894 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0401 20:26:42.339210 330894 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0401 20:26:42.339263 330894 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-974821
I0401 20:26:42.363214 330894 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33098 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/embed-certs-974821/id_rsa Username:docker}
I0401 20:26:42.363722 330894 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
I0401 20:26:42.363738 330894 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0401 20:26:42.363802 330894 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-974821
I0401 20:26:42.402844 330894 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33098 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/embed-certs-974821/id_rsa Username:docker}
I0401 20:26:42.551219 330894 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.94.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0401 20:26:42.573705 330894 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0401 20:26:42.583133 330894 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0401 20:26:42.654174 330894 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0401 20:26:43.042754 330894 start.go:971] {"host.minikube.internal": 192.168.94.1} host record injected into CoreDNS's ConfigMap
I0401 20:26:43.337980 330894 node_ready.go:35] waiting up to 6m0s for node "embed-certs-974821" to be "Ready" ...
I0401 20:26:43.352907 330894 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
I0401 20:26:42.493646 318306 addons.go:238] Setting addon default-storageclass=true in "old-k8s-version-964633"
I0401 20:26:42.493679 318306 host.go:66] Checking if "old-k8s-version-964633" exists ...
I0401 20:26:42.494020 318306 cli_runner.go:164] Run: docker container inspect old-k8s-version-964633 --format={{.State.Status}}
I0401 20:26:42.494633 318306 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0401 20:26:42.494650 318306 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0401 20:26:42.494699 318306 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-964633
I0401 20:26:42.515738 318306 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
I0401 20:26:42.515763 318306 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0401 20:26:42.515813 318306 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-964633
I0401 20:26:42.516120 318306 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33088 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/old-k8s-version-964633/id_rsa Username:docker}
I0401 20:26:42.550355 318306 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33088 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/old-k8s-version-964633/id_rsa Username:docker}
I0401 20:26:42.656623 318306 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0401 20:26:42.680516 318306 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.85.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.20.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0401 20:26:42.724595 318306 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0401 20:26:42.836425 318306 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0401 20:26:43.519128 318306 start.go:971] {"host.minikube.internal": 192.168.85.1} host record injected into CoreDNS's ConfigMap
I0401 20:26:43.520669 318306 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-964633" to be "Ready" ...
I0401 20:26:43.534575 318306 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
I0401 20:26:39.934893 333931 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0401 20:26:39.938758 333931 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.32.2/kubectl ...
I0401 20:26:39.938778 333931 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0401 20:26:39.958872 333931 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0401 20:26:40.172083 333931 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0401 20:26:40.172177 333931 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:40.172216 333931 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes default-k8s-diff-port-993330 minikube.k8s.io/updated_at=2025_04_01T20_26_40_0700 minikube.k8s.io/version=v1.35.0 minikube.k8s.io/commit=73c6e1c927350a51068882397e0642f8dfb63f2a minikube.k8s.io/name=default-k8s-diff-port-993330 minikube.k8s.io/primary=true
I0401 20:26:40.270134 333931 ops.go:34] apiserver oom_adj: -16
I0401 20:26:40.270220 333931 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:40.770479 333931 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:41.270979 333931 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:41.770866 333931 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:42.270999 333931 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:42.770351 333931 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:43.270939 333931 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:43.771222 333931 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.32.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0401 20:26:43.837350 333931 kubeadm.go:1113] duration metric: took 3.665237931s to wait for elevateKubeSystemPrivileges
I0401 20:26:43.837382 333931 kubeadm.go:394] duration metric: took 13.799996617s to StartCluster
I0401 20:26:43.837397 333931 settings.go:142] acquiring lock: {Name:mk97b1c786280c2571e72d442bae7d86f342cc2c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:43.837462 333931 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/20506-16361/kubeconfig
I0401 20:26:43.839431 333931 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20506-16361/kubeconfig: {Name:mk2c8ba46a7915412f877cabac9093904e092601 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0401 20:26:43.839725 333931 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0401 20:26:43.839747 333931 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.103.2 Port:8444 KubernetesVersion:v1.32.2 ContainerRuntime:crio ControlPlane:true Worker:true}
I0401 20:26:43.839814 333931 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0401 20:26:43.839917 333931 addons.go:69] Setting storage-provisioner=true in profile "default-k8s-diff-port-993330"
I0401 20:26:43.839930 333931 config.go:182] Loaded profile config "default-k8s-diff-port-993330": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.32.2
I0401 20:26:43.839940 333931 addons.go:238] Setting addon storage-provisioner=true in "default-k8s-diff-port-993330"
I0401 20:26:43.839971 333931 host.go:66] Checking if "default-k8s-diff-port-993330" exists ...
I0401 20:26:43.839969 333931 addons.go:69] Setting default-storageclass=true in profile "default-k8s-diff-port-993330"
I0401 20:26:43.840003 333931 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-diff-port-993330"
I0401 20:26:43.840381 333931 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-993330 --format={{.State.Status}}
I0401 20:26:43.840514 333931 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-993330 --format={{.State.Status}}
I0401 20:26:43.841476 333931 out.go:177] * Verifying Kubernetes components...
I0401 20:26:43.842721 333931 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0401 20:26:43.865449 333931 addons.go:238] Setting addon default-storageclass=true in "default-k8s-diff-port-993330"
I0401 20:26:43.865485 333931 host.go:66] Checking if "default-k8s-diff-port-993330" exists ...
I0401 20:26:43.865882 333931 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-993330 --format={{.State.Status}}
I0401 20:26:43.866716 333931 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0401 20:26:43.868101 333931 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0401 20:26:43.868119 333931 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0401 20:26:43.868177 333931 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-993330
I0401 20:26:43.890569 333931 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
I0401 20:26:43.890597 333931 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0401 20:26:43.890657 333931 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-993330
I0401 20:26:43.898155 333931 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33103 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/default-k8s-diff-port-993330/id_rsa Username:docker}
I0401 20:26:43.912202 333931 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33103 SSHKeyPath:/home/jenkins/minikube-integration/20506-16361/.minikube/machines/default-k8s-diff-port-993330/id_rsa Username:docker}
I0401 20:26:43.945216 333931 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.103.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.32.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0401 20:26:43.970994 333931 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0401 20:26:44.042282 333931 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0401 20:26:44.045601 333931 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.32.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0401 20:26:44.448761 333931 start.go:971] {"host.minikube.internal": 192.168.103.1} host record injected into CoreDNS's ConfigMap
I0401 20:26:44.452898 333931 node_ready.go:35] waiting up to 6m0s for node "default-k8s-diff-port-993330" to be "Ready" ...
I0401 20:26:44.821825 333931 out.go:177] * Enabled addons: default-storageclass, storage-provisioner
I0401 20:26:43.354186 330894 addons.go:514] duration metric: took 1.051390383s for enable addons: enabled=[storage-provisioner default-storageclass]
I0401 20:26:43.547860 330894 kapi.go:214] "coredns" deployment in "kube-system" namespace and "embed-certs-974821" context rescaled to 1 replicas
I0401 20:26:45.340753 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:26:43.535896 318306 addons.go:514] duration metric: took 1.066200808s for enable addons: enabled=[storage-provisioner default-storageclass]
I0401 20:26:44.025251 318306 kapi.go:214] "coredns" deployment in "kube-system" namespace and "old-k8s-version-964633" context rescaled to 1 replicas
I0401 20:26:45.524906 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:26:44.440384 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:26:46.939256 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:26:44.823053 333931 addons.go:514] duration metric: took 983.234963ms for enable addons: enabled=[default-storageclass storage-provisioner]
I0401 20:26:44.953860 333931 kapi.go:214] "coredns" deployment in "kube-system" namespace and "default-k8s-diff-port-993330" context rescaled to 1 replicas
I0401 20:26:46.456438 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:26:48.456551 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:26:47.342409 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:26:49.841363 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:26:48.024193 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:26:50.524047 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:26:48.939954 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:26:51.439185 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:26:50.956413 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:26:52.956547 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:26:52.341170 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:26:54.341289 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:26:52.524370 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:26:54.524429 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:26:56.524842 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:26:53.439869 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:26:55.440142 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:26:55.456231 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:26:57.456435 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:26:56.341467 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:26:58.841427 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:26:59.024502 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:01.523890 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:26:57.939586 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:26:59.940097 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:02.439242 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:26:59.956123 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:02.455889 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:00.843010 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:03.341703 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:03.524529 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:06.023956 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:04.439881 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:06.440252 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:04.455966 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:06.957181 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:05.841302 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:08.341628 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:10.341652 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:08.024174 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:10.024345 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:08.938996 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:10.939970 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:09.456272 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:11.956091 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:12.841434 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:14.841660 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:12.524277 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:15.024349 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:13.439697 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:15.939138 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:13.956426 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:16.456496 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:17.341723 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:19.841268 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:17.024507 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:19.525042 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:17.939874 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:20.439243 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:22.440378 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:18.955912 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:20.956005 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:22.956678 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:22.340700 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:24.341052 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:22.023928 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:24.024471 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:26.524299 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:24.939393 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:26.939417 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:25.455481 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:27.455703 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:26.841009 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:29.341483 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:28.524523 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:31.024283 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:28.939450 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:30.939696 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:29.456090 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:31.955815 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:31.841119 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:34.341539 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:33.524538 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:36.024009 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:32.939747 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:35.439767 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:33.956299 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:36.456275 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:36.841510 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:39.341347 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:38.024183 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:40.524873 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:37.940003 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:39.940246 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:42.439385 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:38.955607 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:40.956800 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:43.455679 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:41.341555 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:43.840788 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:43.023891 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:45.024138 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:44.940246 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:46.940455 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:45.456215 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:47.456553 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:45.841064 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:47.841124 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:50.341001 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:47.024321 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:49.524407 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:49.439985 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:51.940335 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:49.955951 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:51.956409 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:52.341410 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:54.841093 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:52.023887 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:54.024576 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:56.024959 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:54.439454 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:56.939508 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:54.456208 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:56.955789 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:27:57.340641 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:59.340854 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:27:58.524756 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:01.024138 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:27:58.939647 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:01.439794 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:27:59.456520 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:01.956243 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:01.341412 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:03.840829 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:03.524265 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:05.524563 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:03.939744 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:06.440045 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:04.456056 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:06.956111 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:05.841482 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:08.340852 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:10.341317 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:08.024452 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:10.024756 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:08.939549 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:10.939811 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:08.956207 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:11.455839 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:13.456094 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:12.341366 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:14.841183 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:12.025361 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:14.524521 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:16.524987 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:12.939969 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:15.439776 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:15.456143 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:17.956747 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:17.341377 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:19.341483 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:19.023946 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:21.524549 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:17.939662 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:19.939721 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:21.940239 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:20.455830 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:22.456722 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:21.841634 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:24.341452 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:23.524895 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:25.525026 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:24.438964 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:26.439292 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:24.955724 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:26.956285 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:26.840369 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:28.841243 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:28.024231 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:30.524109 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:28.440189 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:30.939597 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:29.455911 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:31.456314 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:30.841367 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:33.341327 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:32.524672 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:34.524774 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:36.524951 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:33.439550 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:35.440245 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:33.955987 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:35.956227 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:38.456694 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:35.840689 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:37.841065 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:39.841588 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:39.023986 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:41.524623 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:37.939005 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:39.939536 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:42.439706 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:40.955698 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:42.956224 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:42.341507 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:44.841327 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:44.024595 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:46.523928 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:44.940152 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:47.439732 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:45.455937 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:47.955630 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:47.340938 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:49.841495 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:48.524190 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:50.524340 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:49.938992 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:51.940205 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:49.956277 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:52.456432 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:52.341370 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:54.341564 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:53.024675 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:55.523833 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:54.439752 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:56.440174 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:54.456580 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:56.956122 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:28:56.341664 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:58.841264 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:28:58.024006 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:00.024503 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:28:58.939186 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:00.939375 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:28:58.956316 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:01.456102 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:01.341241 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:03.341319 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:05.341600 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:02.524673 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:05.024010 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:02.939860 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:05.439453 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:03.956025 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:05.956133 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:08.456171 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:07.841143 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:10.341122 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:07.523719 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:09.524925 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:07.939821 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:10.438914 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:12.439235 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:10.956001 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:12.956142 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:12.341661 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:14.841049 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:12.023977 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:14.024449 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:16.523729 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:14.439825 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:16.939668 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:15.455614 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:17.456241 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:16.841077 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:18.841131 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:18.524124 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:20.524738 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:19.440109 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:21.940032 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:19.956104 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:22.455902 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:21.341247 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:23.341368 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:23.023758 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:25.024198 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:23.940105 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:26.439762 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:24.456217 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:26.956261 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:25.841203 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:28.341579 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:27.525032 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:30.023864 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:28.940457 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:31.439874 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:29.456184 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:31.456285 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:30.841364 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:33.340883 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:35.341199 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:32.524925 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:35.024046 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:33.939810 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:36.439359 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:33.956165 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:36.455757 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:38.455847 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:37.341322 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:39.341383 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:37.024167 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:39.524569 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:38.439759 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:40.939916 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:40.456088 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:42.456200 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:41.840811 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:43.841328 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:42.023653 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:44.024644 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:46.524378 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:43.439783 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:45.940130 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:44.955680 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:46.956328 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:46.341244 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:48.341270 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:49.023827 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:51.024273 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:48.439324 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:50.439633 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:52.440208 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:49.455631 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:51.455836 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:50.841179 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:53.340781 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:55.341224 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:53.524530 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:56.023648 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:54.940220 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:57.439520 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:29:53.955662 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:56.456471 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:58.456544 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:29:57.341258 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:59.840812 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:29:58.024095 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:00.524597 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:29:59.440222 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:01.940070 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:00.955859 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:02.956272 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:01.841344 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:04.341580 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:02.524746 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:05.023985 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:04.439796 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:06.439839 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:05.456215 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:07.456449 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:06.841422 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:09.341295 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:07.026315 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:09.524057 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:08.440063 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:10.939342 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:09.955836 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:11.956424 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:11.341361 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:13.341635 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:12.024045 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:14.524429 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:16.524494 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:12.939384 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:14.940258 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:17.439661 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:14.455827 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:16.456323 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:15.841119 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:17.841150 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:19.841518 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:19.024468 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:21.024745 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:19.439858 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:21.939976 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:18.955508 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:20.956126 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:22.956183 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:22.341249 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:24.341376 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:23.524216 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:26.024624 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:24.439649 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:26.440156 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:25.456302 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:27.456379 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:26.841261 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:29.341505 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:28.524527 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:31.023563 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:28.939308 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:30.939745 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:29.955593 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:31.955956 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:31.841328 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:33.841451 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:33.023805 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:35.024667 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:33.439114 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:35.439616 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:37.939989 320217 node_ready.go:53] node "no-preload-671514" has status "Ready":"False"
I0401 20:30:38.436499 320217 node_ready.go:38] duration metric: took 4m0.000055311s for node "no-preload-671514" to be "Ready" ...
I0401 20:30:38.438173 320217 out.go:201]
W0401 20:30:38.439456 320217 out.go:270] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: context deadline exceeded
W0401 20:30:38.439475 320217 out.go:270] *
W0401 20:30:38.440324 320217 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0401 20:30:38.441563 320217 out.go:201]
I0401 20:30:34.456114 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:36.456183 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:36.341225 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:38.341405 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:37.523708 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:40.023581 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:40.841224 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:43.341058 330894 node_ready.go:53] node "embed-certs-974821" has status "Ready":"False"
I0401 20:30:43.341082 330894 node_ready.go:38] duration metric: took 4m0.003071122s for node "embed-certs-974821" to be "Ready" ...
I0401 20:30:43.342750 330894 out.go:201]
W0401 20:30:43.343924 330894 out.go:270] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: context deadline exceeded
W0401 20:30:43.343942 330894 out.go:270] *
W0401 20:30:43.344884 330894 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0401 20:30:43.346230 330894 out.go:201]
I0401 20:30:42.023613 318306 node_ready.go:53] node "old-k8s-version-964633" has status "Ready":"False"
I0401 20:30:43.523708 318306 node_ready.go:38] duration metric: took 4m0.003003222s for node "old-k8s-version-964633" to be "Ready" ...
I0401 20:30:43.525700 318306 out.go:201]
W0401 20:30:43.527169 318306 out.go:270] X Exiting due to GUEST_START: failed to start node: wait 6m0s for node: waiting for node to be ready: waitNodeCondition: context deadline exceeded
W0401 20:30:43.527189 318306 out.go:270] *
W0401 20:30:43.528115 318306 out.go:293] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0401 20:30:43.529169 318306 out.go:201]
I0401 20:30:38.956138 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:40.956284 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
I0401 20:30:43.455702 333931 node_ready.go:53] node "default-k8s-diff-port-993330" has status "Ready":"False"
==> CRI-O <==
Apr 01 20:27:15 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:27:15.619846848Z" level=info msg="Image docker.io/kindest/kindnetd:v20250214-acbabc1a not found" id=a8efaee6-fed8-4d46-8cdb-712c88b1cedb name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:27:27 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:27:27.554841296Z" level=info msg="Checking image status: docker.io/kindest/kindnetd:v20250214-acbabc1a" id=168e3c22-6d61-4263-bfd1-7e4c244dff47 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:27:27 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:27:27.555145721Z" level=info msg="Image docker.io/kindest/kindnetd:v20250214-acbabc1a not found" id=168e3c22-6d61-4263-bfd1-7e4c244dff47 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:27:27 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:27:27.555617513Z" level=info msg="Pulling image: docker.io/kindest/kindnetd:v20250214-acbabc1a" id=2828cb2e-023b-4220-8500-3f3285999904 name=/runtime.v1alpha2.ImageService/PullImage
Apr 01 20:27:27 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:27:27.580362033Z" level=info msg="Trying to access \"docker.io/kindest/kindnetd:v20250214-acbabc1a\""
Apr 01 20:28:10 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:28:10.554753441Z" level=info msg="Checking image status: docker.io/kindest/kindnetd:v20250214-acbabc1a" id=0419f232-fe5d-4f82-b11a-e8e2ca33be04 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:28:10 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:28:10.555132519Z" level=info msg="Image docker.io/kindest/kindnetd:v20250214-acbabc1a not found" id=0419f232-fe5d-4f82-b11a-e8e2ca33be04 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:28:24 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:28:24.554701748Z" level=info msg="Checking image status: docker.io/kindest/kindnetd:v20250214-acbabc1a" id=5fd8353a-24a8-419d-a5ee-4a03251ab4ed name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:28:24 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:28:24.554990267Z" level=info msg="Image docker.io/kindest/kindnetd:v20250214-acbabc1a not found" id=5fd8353a-24a8-419d-a5ee-4a03251ab4ed name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:28:24 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:28:24.555577402Z" level=info msg="Pulling image: docker.io/kindest/kindnetd:v20250214-acbabc1a" id=e7bad9db-52d6-4d16-80f7-9b8450e40262 name=/runtime.v1alpha2.ImageService/PullImage
Apr 01 20:28:24 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:28:24.556972507Z" level=info msg="Trying to access \"docker.io/kindest/kindnetd:v20250214-acbabc1a\""
Apr 01 20:29:07 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:29:07.554706397Z" level=info msg="Checking image status: docker.io/kindest/kindnetd:v20250214-acbabc1a" id=2ba0296c-5e60-439b-908e-125303d54087 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:29:07 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:29:07.554999310Z" level=info msg="Image docker.io/kindest/kindnetd:v20250214-acbabc1a not found" id=2ba0296c-5e60-439b-908e-125303d54087 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:29:21 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:29:21.554586824Z" level=info msg="Checking image status: docker.io/kindest/kindnetd:v20250214-acbabc1a" id=2454b06e-ed82-4386-a372-f29562f6be87 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:29:21 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:29:21.554864514Z" level=info msg="Image docker.io/kindest/kindnetd:v20250214-acbabc1a not found" id=2454b06e-ed82-4386-a372-f29562f6be87 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:29:32 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:29:32.554678493Z" level=info msg="Checking image status: docker.io/kindest/kindnetd:v20250214-acbabc1a" id=86d5f108-2c6a-41a5-b69e-f682c7d5405a name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:29:32 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:29:32.554893407Z" level=info msg="Image docker.io/kindest/kindnetd:v20250214-acbabc1a not found" id=86d5f108-2c6a-41a5-b69e-f682c7d5405a name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:29:46 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:29:46.554820264Z" level=info msg="Checking image status: docker.io/kindest/kindnetd:v20250214-acbabc1a" id=867caf98-bdaa-4b6f-964c-68df0aed3494 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:29:46 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:29:46.555106289Z" level=info msg="Image docker.io/kindest/kindnetd:v20250214-acbabc1a not found" id=867caf98-bdaa-4b6f-964c-68df0aed3494 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:29:46 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:29:46.555793257Z" level=info msg="Pulling image: docker.io/kindest/kindnetd:v20250214-acbabc1a" id=7532c3df-5dce-4192-9f67-aaaa30f899a6 name=/runtime.v1alpha2.ImageService/PullImage
Apr 01 20:29:46 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:29:46.566117010Z" level=info msg="Trying to access \"docker.io/kindest/kindnetd:v20250214-acbabc1a\""
Apr 01 20:30:32 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:30:32.554663792Z" level=info msg="Checking image status: docker.io/kindest/kindnetd:v20250214-acbabc1a" id=cc3b73f1-74eb-4e9a-93bb-542f69fac4c8 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:30:32 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:30:32.554961851Z" level=info msg="Image docker.io/kindest/kindnetd:v20250214-acbabc1a not found" id=cc3b73f1-74eb-4e9a-93bb-542f69fac4c8 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:30:43 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:30:43.554648575Z" level=info msg="Checking image status: docker.io/kindest/kindnetd:v20250214-acbabc1a" id=23c81cd6-cedd-464f-a77d-6aaffef18f39 name=/runtime.v1alpha2.ImageService/ImageStatus
Apr 01 20:30:43 old-k8s-version-964633 crio[1034]: time="2025-04-01 20:30:43.554941339Z" level=info msg="Image docker.io/kindest/kindnetd:v20250214-acbabc1a not found" id=23c81cd6-cedd-464f-a77d-6aaffef18f39 name=/runtime.v1alpha2.ImageService/ImageStatus
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
7b18de8419e15 10cc881966cfd9287656c2fce1f144625602653d1e8b011487a7a71feb100bdc 4 minutes ago Running kube-proxy 0 45b225c010954 kube-proxy-vb8ks
4384af78a1883 b9fa1895dcaa6d3dd241d6d9340e939ca30fc0946464ec9f205a8cbe738a8080 4 minutes ago Running kube-controller-manager 0 7e4cef1969b72 kube-controller-manager-old-k8s-version-964633
9513e7ad765e4 0369cf4303ffdb467dc219990960a9baa8512a54b0ad9283eaf55bd6c0adb934 4 minutes ago Running etcd 0 aabb404aa7c03 etcd-old-k8s-version-964633
f2526055eea0e 3138b6e3d471224fd516f758f3b53309219bcb6824e07686b3cd60d78012c899 4 minutes ago Running kube-scheduler 0 0a05fd341a521 kube-scheduler-old-k8s-version-964633
2064fb7c665fb ca9843d3b545457f24b012d6d579ba85f132f2406aa171ad84d53caa55e5de99 4 minutes ago Running kube-apiserver 0 b311a7ae56993 kube-apiserver-old-k8s-version-964633
==> describe nodes <==
Name: old-k8s-version-964633
Roles: control-plane,master
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=old-k8s-version-964633
kubernetes.io/os=linux
minikube.k8s.io/commit=73c6e1c927350a51068882397e0642f8dfb63f2a
minikube.k8s.io/name=old-k8s-version-964633
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_04_01T20_26_26_0700
minikube.k8s.io/version=v1.35.0
node-role.kubernetes.io/control-plane=
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/crio/crio.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 01 Apr 2025 20:26:22 +0000
Taints: node.kubernetes.io/not-ready:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: old-k8s-version-964633
AcquireTime: <unset>
RenewTime: Tue, 01 Apr 2025 20:30:41 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Tue, 01 Apr 2025 20:26:41 +0000 Tue, 01 Apr 2025 20:26:17 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Tue, 01 Apr 2025 20:26:41 +0000 Tue, 01 Apr 2025 20:26:17 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Tue, 01 Apr 2025 20:26:41 +0000 Tue, 01 Apr 2025 20:26:17 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready False Tue, 01 Apr 2025 20:26:41 +0000 Tue, 01 Apr 2025 20:26:17 +0000 KubeletNotReady runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-964633
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32859364Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32859364Ki
pods: 110
System Info:
Machine ID: de7c8d50f85047d185c1ae1aa27193dd
System UUID: b6833a70-aaa0-48ad-8ca9-62cc3e7ff289
Boot ID: 998ee032-5d07-42e5-839c-f756579cd457
Kernel Version: 5.15.0-1078-gcp
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.24.6
Kubelet Version: v1.20.0
Kube-Proxy Version: v1.20.0
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (6 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system etcd-old-k8s-version-964633 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 4m13s
kube-system kindnet-rmrss 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 4m2s
kube-system kube-apiserver-old-k8s-version-964633 250m (3%) 0 (0%) 0 (0%) 0 (0%) 4m13s
kube-system kube-controller-manager-old-k8s-version-964633 200m (2%) 0 (0%) 0 (0%) 0 (0%) 4m13s
kube-system kube-proxy-vb8ks 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m2s
kube-system kube-scheduler-old-k8s-version-964633 100m (1%) 0 (0%) 0 (0%) 0 (0%) 4m12s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (9%) 100m (1%)
memory 150Mi (0%) 50Mi (0%)
ephemeral-storage 100Mi (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 4m30s (x5 over 4m30s) kubelet Node old-k8s-version-964633 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 4m30s (x5 over 4m30s) kubelet Node old-k8s-version-964633 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 4m30s (x5 over 4m30s) kubelet Node old-k8s-version-964633 status is now: NodeHasSufficientPID
Normal Starting 4m13s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 4m13s kubelet Node old-k8s-version-964633 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 4m13s kubelet Node old-k8s-version-964633 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 4m13s kubelet Node old-k8s-version-964633 status is now: NodeHasSufficientPID
Normal Starting 4m1s kube-proxy Starting kube-proxy.
==> dmesg <==
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 82 bf db e2 a3 5f 08 06
[ +0.449515] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff 82 bf db e2 a3 5f 08 06
[ +12.597246] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 9a 7d 80 58 6c 04 08 06
[ +0.000711] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000004] ll header: 00000000: ff ff ff ff ff ff 82 bf db e2 a3 5f 08 06
[ +7.845356] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff 5e 38 fd 47 e7 a9 08 06
[Apr 1 20:25] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 8a 3f 3e 00 a5 1c 08 06
[ +20.323175] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 76 cf 85 1a 8e a5 08 06
[ +0.638468] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 5e 38 fd 47 e7 a9 08 06
[ +7.023939] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff ba 25 24 8c ac a9 08 06
[ +12.985251] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff 96 51 bc 34 44 0d 08 06
[ +0.000445] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 76 cf 85 1a 8e a5 08 06
[ +5.338672] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff 96 d5 ae e5 6c ae 08 06
[ +0.000372] IPv4: martian source 10.244.0.3 from 10.244.0.2, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff ba 25 24 8c ac a9 08 06
==> etcd [9513e7ad765e4b69c4cbbfbd6cb33f21a3a48b715bdea7a1ff49cc1566bcc760] <==
2025-04-01 20:26:35.601706 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:26:45.601736 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:26:55.601700 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:27:05.601725 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:27:15.601835 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:27:25.601760 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:27:35.601788 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:27:45.601737 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:27:55.601837 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:28:05.601793 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:28:15.601826 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:28:25.601685 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:28:35.601952 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:28:45.601732 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:28:55.601666 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:29:05.601871 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:29:15.601839 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:29:25.601802 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:29:35.601762 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:29:45.601855 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:29:55.601828 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:30:05.601820 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:30:15.601802 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:30:25.601737 I | etcdserver/api/etcdhttp: /health OK (status code 200)
2025-04-01 20:30:35.603071 I | etcdserver/api/etcdhttp: /health OK (status code 200)
==> kernel <==
20:30:44 up 1:13, 0 users, load average: 0.33, 2.72, 2.48
Linux old-k8s-version-964633 5.15.0-1078-gcp #87~20.04.1-Ubuntu SMP Mon Feb 24 10:23:16 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kube-apiserver [2064fb7c665fb767c07a50e206db452bfd0e93dc10750dd7ecf94bfe4beb0cc4] <==
I0401 20:26:26.199202 1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0401 20:26:31.519672 1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0401 20:26:42.222977 1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0401 20:26:42.389064 1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0401 20:27:00.489800 1 client.go:360] parsed scheme: "passthrough"
I0401 20:27:00.489847 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0401 20:27:00.489856 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0401 20:27:31.963520 1 client.go:360] parsed scheme: "passthrough"
I0401 20:27:31.963564 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0401 20:27:31.963572 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0401 20:28:09.786998 1 client.go:360] parsed scheme: "passthrough"
I0401 20:28:09.787050 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0401 20:28:09.787058 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0401 20:28:48.574878 1 client.go:360] parsed scheme: "passthrough"
I0401 20:28:48.574931 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0401 20:28:48.574942 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0401 20:29:28.626747 1 client.go:360] parsed scheme: "passthrough"
I0401 20:29:28.626797 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0401 20:29:28.626805 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0401 20:29:59.334439 1 client.go:360] parsed scheme: "passthrough"
I0401 20:29:59.334485 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0401 20:29:59.334493 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0401 20:30:35.802535 1 client.go:360] parsed scheme: "passthrough"
I0401 20:30:35.802577 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 <nil> 0 <nil>}] <nil> <nil>}
I0401 20:30:35.802585 1 clientconn.go:948] ClientConn switching balancer to "pick_first"
==> kube-controller-manager [4384af78a188378e4c730aadae8ad08f38d60dd777008b0a8138a2838ea2ab7f] <==
I0401 20:26:42.217841 1 shared_informer.go:247] Caches are synced for ReplicationController
I0401 20:26:42.217905 1 shared_informer.go:247] Caches are synced for job
I0401 20:26:42.218052 1 shared_informer.go:247] Caches are synced for attach detach
I0401 20:26:42.218327 1 shared_informer.go:247] Caches are synced for ReplicaSet
I0401 20:26:42.218385 1 shared_informer.go:247] Caches are synced for bootstrap_signer
I0401 20:26:42.218730 1 shared_informer.go:247] Caches are synced for deployment
I0401 20:26:42.219644 1 shared_informer.go:247] Caches are synced for crt configmap
I0401 20:26:42.222868 1 shared_informer.go:247] Caches are synced for endpoint_slice
E0401 20:26:42.228067 1 clusterroleaggregation_controller.go:181] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
I0401 20:26:42.229898 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
I0401 20:26:42.242716 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-8m52n"
I0401 20:26:42.255473 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-5bjk4"
I0401 20:26:42.271135 1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring
I0401 20:26:42.377788 1 shared_informer.go:247] Caches are synced for daemon sets
I0401 20:26:42.379364 1 shared_informer.go:247] Caches are synced for stateful set
I0401 20:26:42.400582 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-vb8ks"
I0401 20:26:42.400651 1 shared_informer.go:247] Caches are synced for resource quota
I0401 20:26:42.426096 1 shared_informer.go:247] Caches are synced for resource quota
I0401 20:26:42.434446 1 event.go:291] "Event occurred" object="kube-system/kindnet" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-rmrss"
I0401 20:26:42.566911 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
I0401 20:26:42.917995 1 shared_informer.go:247] Caches are synced for garbage collector
I0401 20:26:42.918028 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0401 20:26:42.918408 1 shared_informer.go:247] Caches are synced for garbage collector
I0401 20:26:43.539217 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-74ff55c5b to 1"
I0401 20:26:43.546242 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-74ff55c5b-8m52n"
==> kube-proxy [7b18de8419e1524ddac8727fd7e9261582448e897f548b26ad3311e27cf0e6fb] <==
I0401 20:26:43.259998 1 node.go:172] Successfully retrieved node IP: 192.168.85.2
I0401 20:26:43.318328 1 server_others.go:142] kube-proxy node IP is an IPv4 address (192.168.85.2), assume IPv4 operation
W0401 20:26:43.349273 1 server_others.go:578] Unknown proxy mode "", assuming iptables proxy
I0401 20:26:43.349451 1 server_others.go:185] Using iptables Proxier.
I0401 20:26:43.349906 1 server.go:650] Version: v1.20.0
I0401 20:26:43.351034 1 config.go:315] Starting service config controller
I0401 20:26:43.351107 1 shared_informer.go:240] Waiting for caches to sync for service config
I0401 20:26:43.351164 1 config.go:224] Starting endpoint slice config controller
I0401 20:26:43.356628 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0401 20:26:43.451303 1 shared_informer.go:247] Caches are synced for service config
I0401 20:26:43.456955 1 shared_informer.go:247] Caches are synced for endpoint slice config
==> kube-scheduler [f2526055eea0e40e9b5009904a748c68af694b09fbeb58de9177b4b5f55ffcea] <==
E0401 20:26:22.050850 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0401 20:26:22.050959 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0401 20:26:22.051031 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0401 20:26:22.051104 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0401 20:26:22.051131 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0401 20:26:22.051219 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0401 20:26:22.051235 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0401 20:26:22.051280 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0401 20:26:22.051338 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0401 20:26:22.051403 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0401 20:26:22.051414 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0401 20:26:22.051526 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0401 20:26:22.922830 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0401 20:26:22.955835 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0401 20:26:23.011220 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0401 20:26:23.021829 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0401 20:26:23.029700 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.PodDisruptionBudget: failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0401 20:26:23.064263 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0401 20:26:23.099742 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0401 20:26:23.120264 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0401 20:26:23.332498 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0401 20:26:23.438632 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0401 20:26:23.512784 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0401 20:26:23.649265 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
I0401 20:26:26.547552 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Apr 01 20:29:21 old-k8s-version-964633 kubelet[2076]: E0401 20:29:21.555181 2076 pod_workers.go:191] Error syncing pod 96d81bdc-b456-4cb9-b8fd-996bdc90c878 ("kindnet-rmrss_kube-system(96d81bdc-b456-4cb9-b8fd-996bdc90c878)"), skipping: failed to "StartContainer" for "kindnet-cni" with ImagePullBackOff: "Back-off pulling image \"docker.io/kindest/kindnetd:v20250214-acbabc1a\""
Apr 01 20:29:21 old-k8s-version-964633 kubelet[2076]: E0401 20:29:21.671821 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:29:26 old-k8s-version-964633 kubelet[2076]: E0401 20:29:26.672548 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:29:31 old-k8s-version-964633 kubelet[2076]: E0401 20:29:31.673192 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:29:32 old-k8s-version-964633 kubelet[2076]: E0401 20:29:32.555150 2076 pod_workers.go:191] Error syncing pod 96d81bdc-b456-4cb9-b8fd-996bdc90c878 ("kindnet-rmrss_kube-system(96d81bdc-b456-4cb9-b8fd-996bdc90c878)"), skipping: failed to "StartContainer" for "kindnet-cni" with ImagePullBackOff: "Back-off pulling image \"docker.io/kindest/kindnetd:v20250214-acbabc1a\""
Apr 01 20:29:36 old-k8s-version-964633 kubelet[2076]: E0401 20:29:36.673863 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:29:41 old-k8s-version-964633 kubelet[2076]: E0401 20:29:41.674535 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:29:46 old-k8s-version-964633 kubelet[2076]: E0401 20:29:46.675179 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:29:51 old-k8s-version-964633 kubelet[2076]: E0401 20:29:51.675844 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:29:56 old-k8s-version-964633 kubelet[2076]: E0401 20:29:56.676602 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:30:01 old-k8s-version-964633 kubelet[2076]: E0401 20:30:01.677329 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:30:06 old-k8s-version-964633 kubelet[2076]: E0401 20:30:06.678016 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:30:11 old-k8s-version-964633 kubelet[2076]: E0401 20:30:11.678714 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:30:16 old-k8s-version-964633 kubelet[2076]: E0401 20:30:16.679300 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:30:18 old-k8s-version-964633 kubelet[2076]: E0401 20:30:18.357521 2076 remote_image.go:113] PullImage "docker.io/kindest/kindnetd:v20250214-acbabc1a" from image service failed: rpc error: code = Unknown desc = reading manifest v20250214-acbabc1a in docker.io/kindest/kindnetd: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit
Apr 01 20:30:18 old-k8s-version-964633 kubelet[2076]: E0401 20:30:18.357584 2076 kuberuntime_image.go:51] Pull image "docker.io/kindest/kindnetd:v20250214-acbabc1a" failed: rpc error: code = Unknown desc = reading manifest v20250214-acbabc1a in docker.io/kindest/kindnetd: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit
Apr 01 20:30:18 old-k8s-version-964633 kubelet[2076]: E0401 20:30:18.357742 2076 kuberuntime_manager.go:829] container &Container{Name:kindnet-cni,Image:docker.io/kindest/kindnetd:v20250214-acbabc1a,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:HOST_IP,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:status.hostIP,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},EnvVar{Name:POD_IP,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:status.podIP,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},EnvVar{Name:POD_SUBNET,Value:10.244.0.0/16,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{52428800 0} {<nil>} 50Mi BinarySI},},Requests:ResourceList{cpu: {{100 -3} {<nil>} 100m DecimalSI},memory: {{52428800 0} {<nil>} 50Mi BinarySI},},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-cfg,ReadOnly:false,MountP
ath:/etc/cni/net.d,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:xtables-lock,ReadOnly:false,MountPath:/run/xtables.lock,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:lib-modules,ReadOnly:true,MountPath:/lib/modules,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kindnet-token-pbwhx,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[NET_RAW NET_ADMIN],Drop:[],},Privileged:*false,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,} start failed in pod ki
ndnet-rmrss_kube-system(96d81bdc-b456-4cb9-b8fd-996bdc90c878): ErrImagePull: rpc error: code = Unknown desc = reading manifest v20250214-acbabc1a in docker.io/kindest/kindnetd: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit
Apr 01 20:30:18 old-k8s-version-964633 kubelet[2076]: E0401 20:30:18.357814 2076 pod_workers.go:191] Error syncing pod 96d81bdc-b456-4cb9-b8fd-996bdc90c878 ("kindnet-rmrss_kube-system(96d81bdc-b456-4cb9-b8fd-996bdc90c878)"), skipping: failed to "StartContainer" for "kindnet-cni" with ErrImagePull: "rpc error: code = Unknown desc = reading manifest v20250214-acbabc1a in docker.io/kindest/kindnetd: toomanyrequests: You have reached your unauthenticated pull rate limit. https://www.docker.com/increase-rate-limit"
Apr 01 20:30:21 old-k8s-version-964633 kubelet[2076]: E0401 20:30:21.679919 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:30:26 old-k8s-version-964633 kubelet[2076]: E0401 20:30:26.680585 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:30:31 old-k8s-version-964633 kubelet[2076]: E0401 20:30:31.681294 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:30:32 old-k8s-version-964633 kubelet[2076]: E0401 20:30:32.555254 2076 pod_workers.go:191] Error syncing pod 96d81bdc-b456-4cb9-b8fd-996bdc90c878 ("kindnet-rmrss_kube-system(96d81bdc-b456-4cb9-b8fd-996bdc90c878)"), skipping: failed to "StartContainer" for "kindnet-cni" with ImagePullBackOff: "Back-off pulling image \"docker.io/kindest/kindnetd:v20250214-acbabc1a\""
Apr 01 20:30:36 old-k8s-version-964633 kubelet[2076]: E0401 20:30:36.681920 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:30:41 old-k8s-version-964633 kubelet[2076]: E0401 20:30:41.682576 2076 kubelet.go:2160] Container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: No CNI configuration file in /etc/cni/net.d/. Has your network provider started?
Apr 01 20:30:43 old-k8s-version-964633 kubelet[2076]: E0401 20:30:43.555139 2076 pod_workers.go:191] Error syncing pod 96d81bdc-b456-4cb9-b8fd-996bdc90c878 ("kindnet-rmrss_kube-system(96d81bdc-b456-4cb9-b8fd-996bdc90c878)"), skipping: failed to "StartContainer" for "kindnet-cni" with ImagePullBackOff: "Back-off pulling image \"docker.io/kindest/kindnetd:v20250214-acbabc1a\""
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-964633 -n old-k8s-version-964633
helpers_test.go:261: (dbg) Run: kubectl --context old-k8s-version-964633 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: coredns-74ff55c5b-5bjk4 kindnet-rmrss storage-provisioner
helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/FirstStart]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context old-k8s-version-964633 describe pod coredns-74ff55c5b-5bjk4 kindnet-rmrss storage-provisioner
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-964633 describe pod coredns-74ff55c5b-5bjk4 kindnet-rmrss storage-provisioner: exit status 1 (72.534176ms)
** stderr **
Error from server (NotFound): pods "coredns-74ff55c5b-5bjk4" not found
Error from server (NotFound): pods "kindnet-rmrss" not found
Error from server (NotFound): pods "storage-provisioner" not found
** /stderr **
helpers_test.go:279: kubectl --context old-k8s-version-964633 describe pod coredns-74ff55c5b-5bjk4 kindnet-rmrss storage-provisioner: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (298.92s)