7a7892355cfa060afe2cc9d2507b1d1308b66169:2025-10-02:41740
| Order | failed test | Duration |
|---|---|---|
| 233 | TestMultiNode/serial/AddNode | 12.72 |
| 234 | TestMultiNode/serial/MultiNodeLabels | 1.9 |
=== RUN TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run: out/minikube-linux-amd64 node add -p multinode-269236 -v=5 --alsologtostderr
multinode_test.go:121: (dbg) Non-zero exit: out/minikube-linux-amd64 node add -p multinode-269236 -v=5 --alsologtostderr: exit status 80 (10.846393181s)
-- stdout --
* Adding node m03 to cluster multinode-269236 as [worker]
* Starting "multinode-269236-m03" worker node in "multinode-269236" cluster
* Pulling base image v0.0.48-1759382731-21643 ...
* Preparing Kubernetes v1.34.1 on containerd 1.7.28 ...
-- /stdout --
** stderr **
I1002 20:37:56.782392 278784 out.go:360] Setting OutFile to fd 1 ...
I1002 20:37:56.782511 278784 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:37:56.782522 278784 out.go:374] Setting ErrFile to fd 2...
I1002 20:37:56.782529 278784 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:37:56.782763 278784 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:37:56.783112 278784 mustload.go:65] Loading cluster: multinode-269236
I1002 20:37:56.783522 278784 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:37:56.783983 278784 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:37:56.802250 278784 host.go:66] Checking if "multinode-269236" exists ...
I1002 20:37:56.802521 278784 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 20:37:56.855788 278784 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:52 OomKillDisable:false NGoroutines:65 SystemTime:2025-10-02 20:37:56.846033659 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1041-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652174848 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-2 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:b98a3aace656320842a23f4a392a33f46af97866 Expected:} RuncCommit:{ID:v1.3.0-0-g4ca628d1 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.29.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.4] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v0.1.40] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1002 20:37:56.855940 278784 api_server.go:166] Checking apiserver status ...
I1002 20:37:56.855985 278784 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1002 20:37:56.856024 278784 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:37:56.873820 278784 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:37:56.981037 278784 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1374/cgroup
W1002 20:37:56.989946 278784 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1374/cgroup: Process exited with status 1
stdout:
stderr:
I1002 20:37:56.990038 278784 ssh_runner.go:195] Run: ls
I1002 20:37:56.994024 278784 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
I1002 20:37:56.998635 278784 api_server.go:279] https://192.168.67.2:8443/healthz returned 200:
ok
I1002 20:37:57.000619 278784 out.go:179] * Adding node m03 to cluster multinode-269236 as [worker]
I1002 20:37:57.002143 278784 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:37:57.002292 278784 profile.go:143] Saving config to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/config.json ...
I1002 20:37:57.003945 278784 out.go:179] * Starting "multinode-269236-m03" worker node in "multinode-269236" cluster
I1002 20:37:57.004977 278784 cache.go:123] Beginning downloading kic base image for docker with containerd
I1002 20:37:57.006038 278784 out.go:179] * Pulling base image v0.0.48-1759382731-21643 ...
I1002 20:37:57.007149 278784 preload.go:183] Checking if preload exists for k8s version v1.34.1 and runtime containerd
I1002 20:37:57.007214 278784 preload.go:198] Found local preload: /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4
I1002 20:37:57.007230 278784 cache.go:58] Caching tarball of preloaded images
I1002 20:37:57.007261 278784 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d in local docker daemon
I1002 20:37:57.007341 278784 preload.go:233] Found /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
I1002 20:37:57.007359 278784 cache.go:61] Finished verifying existence of preloaded tar for v1.34.1 on containerd
I1002 20:37:57.007521 278784 profile.go:143] Saving config to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/config.json ...
I1002 20:37:57.028932 278784 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d in local docker daemon, skipping pull
I1002 20:37:57.028952 278784 cache.go:147] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d exists in daemon, skipping load
I1002 20:37:57.028975 278784 cache.go:232] Successfully downloaded all kic artifacts
I1002 20:37:57.029005 278784 start.go:360] acquireMachinesLock for multinode-269236-m03: {Name:mk296f06b3a29088e0799179381a1bdc6f3a9d84 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 20:37:57.029105 278784 start.go:364] duration metric: took 81.558µs to acquireMachinesLock for "multinode-269236-m03"
I1002 20:37:57.029127 278784 start.go:93] Provisioning new machine with config: &{Name:multinode-269236 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true} {Name:m02 IP:192.168.67.3 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:false Worker:true} {Name:m03 IP: Port:0 KubernetesVersion:v1.34.1 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false
kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath:
StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:0 KubernetesVersion:v1.34.1 ContainerRuntime: ControlPlane:false Worker:true}
I1002 20:37:57.029227 278784 start.go:125] createHost starting for "m03" (driver="docker")
I1002 20:37:57.031386 278784 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
I1002 20:37:57.031489 278784 start.go:159] libmachine.API.Create for "multinode-269236" (driver="docker")
I1002 20:37:57.031522 278784 client.go:168] LocalClient.Create starting
I1002 20:37:57.031622 278784 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem
I1002 20:37:57.031658 278784 main.go:141] libmachine: Decoding PEM data...
I1002 20:37:57.031693 278784 main.go:141] libmachine: Parsing certificate...
I1002 20:37:57.031749 278784 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem
I1002 20:37:57.031770 278784 main.go:141] libmachine: Decoding PEM data...
I1002 20:37:57.031781 278784 main.go:141] libmachine: Parsing certificate...
I1002 20:37:57.032019 278784 cli_runner.go:164] Run: docker network inspect multinode-269236 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1002 20:37:57.050050 278784 network_create.go:77] Found existing network {name:multinode-269236 subnet:0xc001457e90 gateway:[0 0 0 0 0 0 0 0 0 0 255 255 192 168 67 1] mtu:1500}
I1002 20:37:57.050091 278784 kic.go:121] calculated static IP "192.168.67.4" for the "multinode-269236-m03" container
I1002 20:37:57.050193 278784 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1002 20:37:57.068130 278784 cli_runner.go:164] Run: docker volume create multinode-269236-m03 --label name.minikube.sigs.k8s.io=multinode-269236-m03 --label created_by.minikube.sigs.k8s.io=true
I1002 20:37:57.087980 278784 oci.go:103] Successfully created a docker volume multinode-269236-m03
I1002 20:37:57.088082 278784 cli_runner.go:164] Run: docker run --rm --name multinode-269236-m03-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-269236-m03 --entrypoint /usr/bin/test -v multinode-269236-m03:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d -d /var/lib
I1002 20:37:57.471161 278784 oci.go:107] Successfully prepared a docker volume multinode-269236-m03
I1002 20:37:57.471199 278784 preload.go:183] Checking if preload exists for k8s version v1.34.1 and runtime containerd
I1002 20:37:57.471221 278784 kic.go:194] Starting extracting preloaded images to volume ...
I1002 20:37:57.471274 278784 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-269236-m03:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d -I lz4 -xf /preloaded.tar -C /extractDir
I1002 20:38:01.993585 278784 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-269236-m03:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d -I lz4 -xf /preloaded.tar -C /extractDir: (4.522267614s)
I1002 20:38:01.993616 278784 kic.go:203] duration metric: took 4.522391779s to extract preloaded images to volume ...
W1002 20:38:01.993702 278784 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1002 20:38:01.993728 278784 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1002 20:38:01.993761 278784 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1002 20:38:02.048786 278784 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname multinode-269236-m03 --name multinode-269236-m03 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-269236-m03 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=multinode-269236-m03 --network multinode-269236 --ip 192.168.67.4 --volume multinode-269236-m03:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d
I1002 20:38:02.335389 278784 cli_runner.go:164] Run: docker container inspect multinode-269236-m03 --format={{.State.Running}}
I1002 20:38:02.354650 278784 cli_runner.go:164] Run: docker container inspect multinode-269236-m03 --format={{.State.Status}}
I1002 20:38:02.373548 278784 cli_runner.go:164] Run: docker exec multinode-269236-m03 stat /var/lib/dpkg/alternatives/iptables
I1002 20:38:02.419472 278784 oci.go:144] the created container "multinode-269236-m03" has a running status.
I1002 20:38:02.419525 278784 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m03/id_rsa...
I1002 20:38:02.982183 278784 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m03/id_rsa.pub -> /home/docker/.ssh/authorized_keys
I1002 20:38:02.982249 278784 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m03/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1002 20:38:03.012329 278784 cli_runner.go:164] Run: docker container inspect multinode-269236-m03 --format={{.State.Status}}
I1002 20:38:03.032922 278784 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1002 20:38:03.032953 278784 kic_runner.go:114] Args: [docker exec --privileged multinode-269236-m03 chown docker:docker /home/docker/.ssh/authorized_keys]
I1002 20:38:03.073409 278784 cli_runner.go:164] Run: docker container inspect multinode-269236-m03 --format={{.State.Status}}
I1002 20:38:03.092919 278784 machine.go:93] provisionDockerMachine start ...
I1002 20:38:03.093033 278784 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m03
I1002 20:38:03.113093 278784 main.go:141] libmachine: Using SSH client type: native
I1002 20:38:03.113346 278784 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840040] 0x842d40 <nil> [] 0s} 127.0.0.1 33039 <nil> <nil>}
I1002 20:38:03.113365 278784 main.go:141] libmachine: About to run SSH command:
hostname
I1002 20:38:03.263367 278784 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-269236-m03
I1002 20:38:03.263399 278784 ubuntu.go:182] provisioning hostname "multinode-269236-m03"
I1002 20:38:03.263480 278784 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m03
I1002 20:38:03.282490 278784 main.go:141] libmachine: Using SSH client type: native
I1002 20:38:03.282748 278784 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840040] 0x842d40 <nil> [] 0s} 127.0.0.1 33039 <nil> <nil>}
I1002 20:38:03.282765 278784 main.go:141] libmachine: About to run SSH command:
sudo hostname multinode-269236-m03 && echo "multinode-269236-m03" | sudo tee /etc/hostname
I1002 20:38:03.439530 278784 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-269236-m03
I1002 20:38:03.439627 278784 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m03
I1002 20:38:03.458419 278784 main.go:141] libmachine: Using SSH client type: native
I1002 20:38:03.458717 278784 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840040] 0x842d40 <nil> [] 0s} 127.0.0.1 33039 <nil> <nil>}
I1002 20:38:03.458753 278784 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smultinode-269236-m03' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-269236-m03/g' /etc/hosts;
else
echo '127.0.1.1 multinode-269236-m03' | sudo tee -a /etc/hosts;
fi
fi
I1002 20:38:03.605780 278784 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1002 20:38:03.605812 278784 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21682-131316/.minikube CaCertPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21682-131316/.minikube}
I1002 20:38:03.605877 278784 ubuntu.go:190] setting up certificates
I1002 20:38:03.605898 278784 provision.go:84] configureAuth start
I1002 20:38:03.605961 278784 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236-m03
I1002 20:38:03.624305 278784 provision.go:143] copyHostCerts
I1002 20:38:03.624359 278784 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem
I1002 20:38:03.624403 278784 exec_runner.go:144] found /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem, removing ...
I1002 20:38:03.624416 278784 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem
I1002 20:38:03.624498 278784 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem (1078 bytes)
I1002 20:38:03.624615 278784 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem
I1002 20:38:03.624643 278784 exec_runner.go:144] found /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem, removing ...
I1002 20:38:03.624649 278784 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem
I1002 20:38:03.624688 278784 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem (1123 bytes)
I1002 20:38:03.624779 278784 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem
I1002 20:38:03.624805 278784 exec_runner.go:144] found /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem, removing ...
I1002 20:38:03.624813 278784 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem
I1002 20:38:03.624864 278784 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem (1675 bytes)
I1002 20:38:03.624970 278784 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca-key.pem org=jenkins.multinode-269236-m03 san=[127.0.0.1 192.168.67.4 localhost minikube multinode-269236-m03]
I1002 20:38:04.219953 278784 provision.go:177] copyRemoteCerts
I1002 20:38:04.220013 278784 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1002 20:38:04.220055 278784 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m03
I1002 20:38:04.238077 278784 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33039 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m03/id_rsa Username:docker}
I1002 20:38:04.341816 278784 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I1002 20:38:04.341907 278784 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1002 20:38:04.362768 278784 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem -> /etc/docker/server.pem
I1002 20:38:04.362837 278784 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem --> /etc/docker/server.pem (1229 bytes)
I1002 20:38:04.381353 278784 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I1002 20:38:04.381409 278784 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1002 20:38:04.400006 278784 provision.go:87] duration metric: took 794.094314ms to configureAuth
I1002 20:38:04.400035 278784 ubuntu.go:206] setting minikube options for container-runtime
I1002 20:38:04.400237 278784 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:38:04.400249 278784 machine.go:96] duration metric: took 1.307305062s to provisionDockerMachine
I1002 20:38:04.400256 278784 client.go:171] duration metric: took 7.368724931s to LocalClient.Create
I1002 20:38:04.400284 278784 start.go:167] duration metric: took 7.368788643s to libmachine.API.Create "multinode-269236"
I1002 20:38:04.400299 278784 start.go:293] postStartSetup for "multinode-269236-m03" (driver="docker")
I1002 20:38:04.400309 278784 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1002 20:38:04.400355 278784 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1002 20:38:04.400391 278784 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m03
I1002 20:38:04.418355 278784 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33039 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m03/id_rsa Username:docker}
I1002 20:38:04.523365 278784 ssh_runner.go:195] Run: cat /etc/os-release
I1002 20:38:04.527105 278784 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1002 20:38:04.527137 278784 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1002 20:38:04.527152 278784 filesync.go:126] Scanning /home/jenkins/minikube-integration/21682-131316/.minikube/addons for local assets ...
I1002 20:38:04.527217 278784 filesync.go:126] Scanning /home/jenkins/minikube-integration/21682-131316/.minikube/files for local assets ...
I1002 20:38:04.527315 278784 filesync.go:149] local asset: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem -> 1348342.pem in /etc/ssl/certs
I1002 20:38:04.527328 278784 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem -> /etc/ssl/certs/1348342.pem
I1002 20:38:04.527433 278784 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1002 20:38:04.535560 278784 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem --> /etc/ssl/certs/1348342.pem (1708 bytes)
I1002 20:38:04.558687 278784 start.go:296] duration metric: took 158.370356ms for postStartSetup
I1002 20:38:04.559159 278784 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236-m03
I1002 20:38:04.577510 278784 profile.go:143] Saving config to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/config.json ...
I1002 20:38:04.577786 278784 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1002 20:38:04.577827 278784 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m03
I1002 20:38:04.595938 278784 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33039 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m03/id_rsa Username:docker}
I1002 20:38:04.696068 278784 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1002 20:38:04.700725 278784 start.go:128] duration metric: took 7.671484031s to createHost
I1002 20:38:04.700750 278784 start.go:83] releasing machines lock for "multinode-269236-m03", held for 7.671633633s
I1002 20:38:04.700825 278784 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236-m03
I1002 20:38:04.718700 278784 ssh_runner.go:195] Run: systemctl --version
I1002 20:38:04.718744 278784 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m03
I1002 20:38:04.718753 278784 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1002 20:38:04.718815 278784 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m03
I1002 20:38:04.737357 278784 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33039 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m03/id_rsa Username:docker}
I1002 20:38:04.737632 278784 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33039 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m03/id_rsa Username:docker}
I1002 20:38:04.889214 278784 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1002 20:38:04.894144 278784 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1002 20:38:04.894223 278784 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1002 20:38:04.920959 278784 cni.go:262] disabled [/etc/cni/net.d/10-crio-bridge.conflist.disabled, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1002 20:38:04.920989 278784 start.go:495] detecting cgroup driver to use...
I1002 20:38:04.921026 278784 detect.go:190] detected "systemd" cgroup driver on host os
I1002 20:38:04.921081 278784 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1002 20:38:04.936059 278784 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1002 20:38:04.949318 278784 docker.go:218] disabling cri-docker service (if available) ...
I1002 20:38:04.949368 278784 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1002 20:38:04.967046 278784 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1002 20:38:04.988315 278784 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1002 20:38:05.073454 278784 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1002 20:38:05.163263 278784 docker.go:234] disabling docker service ...
I1002 20:38:05.163340 278784 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1002 20:38:05.183476 278784 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1002 20:38:05.196717 278784 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1002 20:38:05.281611 278784 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1002 20:38:05.367980 278784 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1002 20:38:05.381083 278784 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1002 20:38:05.396607 278784 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10.1"|' /etc/containerd/config.toml"
I1002 20:38:05.408301 278784 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1002 20:38:05.417909 278784 containerd.go:146] configuring containerd to use "systemd" as cgroup driver...
I1002 20:38:05.417975 278784 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = true|g' /etc/containerd/config.toml"
I1002 20:38:05.427748 278784 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1002 20:38:05.437908 278784 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1002 20:38:05.447761 278784 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1002 20:38:05.457498 278784 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1002 20:38:05.466359 278784 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1002 20:38:05.476741 278784 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I1002 20:38:05.486540 278784 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I1002 20:38:05.496908 278784 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1002 20:38:05.505219 278784 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1002 20:38:05.513427 278784 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 20:38:05.594187 278784 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1002 20:38:05.703810 278784 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I1002 20:38:05.703908 278784 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I1002 20:38:05.708263 278784 start.go:563] Will wait 60s for crictl version
I1002 20:38:05.708329 278784 ssh_runner.go:195] Run: which crictl
I1002 20:38:05.712359 278784 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1002 20:38:05.739484 278784 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: v1.7.28
RuntimeApiVersion: v1
I1002 20:38:05.739542 278784 ssh_runner.go:195] Run: containerd --version
I1002 20:38:05.765689 278784 ssh_runner.go:195] Run: containerd --version
I1002 20:38:05.791826 278784 out.go:179] * Preparing Kubernetes v1.34.1 on containerd 1.7.28 ...
I1002 20:38:05.793114 278784 cli_runner.go:164] Run: docker network inspect multinode-269236 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1002 20:38:05.812859 278784 ssh_runner.go:195] Run: grep 192.168.67.1 host.minikube.internal$ /etc/hosts
I1002 20:38:05.817226 278784 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.67.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1002 20:38:05.828080 278784 mustload.go:65] Loading cluster: multinode-269236
I1002 20:38:05.828361 278784 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:38:05.828619 278784 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:38:05.847638 278784 host.go:66] Checking if "multinode-269236" exists ...
I1002 20:38:05.847931 278784 certs.go:69] Setting up /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236 for IP: 192.168.67.4
I1002 20:38:05.847945 278784 certs.go:195] generating shared ca certs ...
I1002 20:38:05.847958 278784 certs.go:227] acquiring lock for ca certs: {Name:mkf552d5738eef3436c5e81c3d27f053587b3fba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:38:05.848073 278784 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.key
I1002 20:38:05.848113 278784 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.key
I1002 20:38:05.848127 278784 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I1002 20:38:05.848141 278784 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I1002 20:38:05.848153 278784 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I1002 20:38:05.848165 278784 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I1002 20:38:05.848223 278784 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834.pem (1338 bytes)
W1002 20:38:05.848252 278784 certs.go:480] ignoring /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834_empty.pem, impossibly tiny 0 bytes
I1002 20:38:05.848261 278784 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca-key.pem (1675 bytes)
I1002 20:38:05.848285 278784 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem (1078 bytes)
I1002 20:38:05.848309 278784 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem (1123 bytes)
I1002 20:38:05.848328 278784 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem (1675 bytes)
I1002 20:38:05.848361 278784 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem (1708 bytes)
I1002 20:38:05.848387 278784 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I1002 20:38:05.848400 278784 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834.pem -> /usr/share/ca-certificates/134834.pem
I1002 20:38:05.848412 278784 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem -> /usr/share/ca-certificates/1348342.pem
I1002 20:38:05.848431 278784 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1002 20:38:05.867871 278784 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1002 20:38:05.887651 278784 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1002 20:38:05.906794 278784 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1002 20:38:05.926203 278784 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1002 20:38:05.948620 278784 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834.pem --> /usr/share/ca-certificates/134834.pem (1338 bytes)
I1002 20:38:05.968004 278784 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem --> /usr/share/ca-certificates/1348342.pem (1708 bytes)
I1002 20:38:05.987520 278784 ssh_runner.go:195] Run: openssl version
I1002 20:38:05.994800 278784 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1348342.pem && ln -fs /usr/share/ca-certificates/1348342.pem /etc/ssl/certs/1348342.pem"
I1002 20:38:06.005274 278784 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1348342.pem
I1002 20:38:06.009732 278784 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 2 20:22 /usr/share/ca-certificates/1348342.pem
I1002 20:38:06.009793 278784 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1348342.pem
I1002 20:38:06.045435 278784 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1348342.pem /etc/ssl/certs/3ec20f2e.0"
I1002 20:38:06.055004 278784 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1002 20:38:06.064902 278784 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1002 20:38:06.069033 278784 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 2 20:16 /usr/share/ca-certificates/minikubeCA.pem
I1002 20:38:06.069113 278784 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1002 20:38:06.107166 278784 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1002 20:38:06.117714 278784 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/134834.pem && ln -fs /usr/share/ca-certificates/134834.pem /etc/ssl/certs/134834.pem"
I1002 20:38:06.127168 278784 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/134834.pem
I1002 20:38:06.131825 278784 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 2 20:22 /usr/share/ca-certificates/134834.pem
I1002 20:38:06.131917 278784 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/134834.pem
I1002 20:38:06.170816 278784 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/134834.pem /etc/ssl/certs/51391683.0"
I1002 20:38:06.180437 278784 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1002 20:38:06.184582 278784 certs.go:400] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1002 20:38:06.184639 278784 kubeadm.go:934] updating node {m03 192.168.67.4 0 v1.34.1 false true} ...
I1002 20:38:06.184766 278784 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=multinode-269236-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.67.4
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1002 20:38:06.184855 278784 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1002 20:38:06.192859 278784 binaries.go:44] Found k8s binaries, skipping transfer
I1002 20:38:06.192967 278784 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system
I1002 20:38:06.201073 278784 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (324 bytes)
I1002 20:38:06.215493 278784 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1002 20:38:06.232394 278784 ssh_runner.go:195] Run: grep 192.168.67.2 control-plane.minikube.internal$ /etc/hosts
I1002 20:38:06.236524 278784 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1002 20:38:06.247512 278784 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 20:38:06.326618 278784 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1002 20:38:06.353417 278784 host.go:66] Checking if "multinode-269236" exists ...
I1002 20:38:06.353666 278784 start.go:317] joinCluster: &{Name:multinode-269236 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true} {Name:m02 IP:192.168.67.3 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:false Worker:true} {Name:m03 IP:192.168.67.4 Port:0 KubernetesVersion:v1.34.1 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:fa
lse kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SS
HAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 20:38:06.353809 278784 ssh_runner.go:195] Run: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.34.1:$PATH" kubeadm token create --print-join-command --ttl=0"
I1002 20:38:06.353871 278784 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:38:06.373662 278784 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:38:06.523789 278784 start.go:343] trying to join worker node "m03" to cluster: &{Name:m03 IP:192.168.67.4 Port:0 KubernetesVersion:v1.34.1 ContainerRuntime: ControlPlane:false Worker:true}
I1002 20:38:06.523875 278784 ssh_runner.go:195] Run: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.34.1:$PATH" kubeadm join control-plane.minikube.internal:8443 --token z35yr7.suw5zqtkyc6bwiwj --discovery-token-ca-cert-hash sha256:19f830e57ecd67343002e647eaa09b4210d8c617f2ab1d39577e16129d93e626 --ignore-preflight-errors=all --cri-socket unix:///run/containerd/containerd.sock --node-name=multinode-269236-m03"
I1002 20:38:07.306510 278784 ssh_runner.go:195] Run: sudo /bin/bash -c "systemctl daemon-reload && systemctl enable kubelet && systemctl start kubelet"
I1002 20:38:07.503537 278784 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes multinode-269236-m03 minikube.k8s.io/updated_at=2025_10_02T20_38_07_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=193cee6aa0f134b5df421bbd88a1ddd3223481a4 minikube.k8s.io/name=multinode-269236 minikube.k8s.io/primary=false
I1002 20:38:07.570338 278784 start.go:319] duration metric: took 1.216666079s to joinCluster
I1002 20:38:07.572657 278784 out.go:203]
W1002 20:38:07.574100 278784 out.go:285] X Exiting due to GUEST_NODE_ADD: failed to add node: join node to cluster: error applying worker node "m03" label: apply node labels: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes multinode-269236-m03 minikube.k8s.io/updated_at=2025_10_02T20_38_07_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=193cee6aa0f134b5df421bbd88a1ddd3223481a4 minikube.k8s.io/name=multinode-269236 minikube.k8s.io/primary=false: Process exited with status 1
stdout:
stderr:
Error from server (NotFound): nodes "multinode-269236-m03" not found
X Exiting due to GUEST_NODE_ADD: failed to add node: join node to cluster: error applying worker node "m03" label: apply node labels: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes multinode-269236-m03 minikube.k8s.io/updated_at=2025_10_02T20_38_07_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=193cee6aa0f134b5df421bbd88a1ddd3223481a4 minikube.k8s.io/name=multinode-269236 minikube.k8s.io/primary=false: Process exited with status 1
stdout:
stderr:
Error from server (NotFound): nodes "multinode-269236-m03" not found
W1002 20:38:07.574121 278784 out.go:285] *
*
W1002 20:38:07.577755 278784 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1002 20:38:07.579411 278784 out.go:203]
** /stderr **
multinode_test.go:123: failed to add node to current cluster. args "out/minikube-linux-amd64 node add -p multinode-269236 -v=5 --alsologtostderr" : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestMultiNode/serial/AddNode]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestMultiNode/serial/AddNode]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect multinode-269236
helpers_test.go:243: (dbg) docker inspect multinode-269236:
-- stdout --
[
{
"Id": "130042a04538db69d4538c33a14553aa5ad7aaadb6f55bb55d74380abaea3a03",
"Created": "2025-10-02T20:36:24.954754964Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 272754,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-10-02T20:36:24.990539461Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:1924ef027790684c42575d5cb3baf0720024642d9b38e3c15ae6ecb285884400",
"ResolvConfPath": "/var/lib/docker/containers/130042a04538db69d4538c33a14553aa5ad7aaadb6f55bb55d74380abaea3a03/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/130042a04538db69d4538c33a14553aa5ad7aaadb6f55bb55d74380abaea3a03/hostname",
"HostsPath": "/var/lib/docker/containers/130042a04538db69d4538c33a14553aa5ad7aaadb6f55bb55d74380abaea3a03/hosts",
"LogPath": "/var/lib/docker/containers/130042a04538db69d4538c33a14553aa5ad7aaadb6f55bb55d74380abaea3a03/130042a04538db69d4538c33a14553aa5ad7aaadb6f55bb55d74380abaea3a03-json.log",
"Name": "/multinode-269236",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"multinode-269236:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "multinode-269236",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "130042a04538db69d4538c33a14553aa5ad7aaadb6f55bb55d74380abaea3a03",
"LowerDir": "/var/lib/docker/overlay2/81afa5b5c00ee862e3073fde08d0444fd1c1de713245203e43723de63ce7be06-init/diff:/var/lib/docker/overlay2/23e9879d70fa6c0a6477b7de456e5e45b1a628fded9b8ef848ad2bf9b29ea71c/diff",
"MergedDir": "/var/lib/docker/overlay2/81afa5b5c00ee862e3073fde08d0444fd1c1de713245203e43723de63ce7be06/merged",
"UpperDir": "/var/lib/docker/overlay2/81afa5b5c00ee862e3073fde08d0444fd1c1de713245203e43723de63ce7be06/diff",
"WorkDir": "/var/lib/docker/overlay2/81afa5b5c00ee862e3073fde08d0444fd1c1de713245203e43723de63ce7be06/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "multinode-269236",
"Source": "/var/lib/docker/volumes/multinode-269236/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "multinode-269236",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "multinode-269236",
"name.minikube.sigs.k8s.io": "multinode-269236",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "21cd3c44d93d83d477eaa8381ea8d622fdd7769b597937d3309780047e15014a",
"SandboxKey": "/var/run/docker/netns/21cd3c44d93d",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33029"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33030"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33033"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33031"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33032"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"multinode-269236": {
"IPAMConfig": {
"IPv4Address": "192.168.67.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:23:f7:94:b4:4d",
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "d35efc5604560c1b4e74e1f364ac1201a22c9def6564fcf8a74e1e4d295905fe",
"EndpointID": "6e9de53f5860c188319ddb8dbd4830c3f7a2d0fe31b82f6d7ae8e0f572ba1186",
"Gateway": "192.168.67.1",
"IPAddress": "192.168.67.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"multinode-269236",
"130042a04538"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p multinode-269236 -n multinode-269236
helpers_test.go:252: <<< TestMultiNode/serial/AddNode FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestMultiNode/serial/AddNode]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 logs -n 25
helpers_test.go:260: TestMultiNode/serial/AddNode logs:
-- stdout --
==> Audit <==
┌─────────┬────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ ssh │ mount-start-2-205791 ssh -- ls /minikube-host │ mount-start-2-205791 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ delete │ -p mount-start-1-188752 --alsologtostderr -v=5 │ mount-start-1-188752 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ ssh │ mount-start-2-205791 ssh -- ls /minikube-host │ mount-start-2-205791 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ stop │ -p mount-start-2-205791 │ mount-start-2-205791 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ start │ -p mount-start-2-205791 │ mount-start-2-205791 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ ssh │ mount-start-2-205791 ssh -- ls /minikube-host │ mount-start-2-205791 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ delete │ -p mount-start-2-205791 │ mount-start-2-205791 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ delete │ -p mount-start-1-188752 │ mount-start-1-188752 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ start │ -p multinode-269236 --wait=true --memory=3072 --nodes=2 -v=5 --alsologtostderr --driver=docker --container-runtime=containerd │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- rollout status deployment/busybox │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- get pods -o jsonpath='{.items[*].status.podIP}' │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- get pods -o jsonpath='{.items[*].metadata.name}' │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gdvtp -- nslookup kubernetes.io │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gnp5h -- nslookup kubernetes.io │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gdvtp -- nslookup kubernetes.default │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gnp5h -- nslookup kubernetes.default │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gdvtp -- nslookup kubernetes.default.svc.cluster.local │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gnp5h -- nslookup kubernetes.default.svc.cluster.local │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- get pods -o jsonpath='{.items[*].metadata.name}' │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gdvtp -- sh -c nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3 │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gdvtp -- sh -c ping -c 1 192.168.67.1 │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gnp5h -- sh -c nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3 │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gnp5h -- sh -c ping -c 1 192.168.67.1 │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ node │ add -p multinode-269236 -v=5 --alsologtostderr │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ │
└─────────┴────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/10/02 20:36:19
Running on machine: ubuntu-20-agent-2
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1002 20:36:19.688677 272194 out.go:360] Setting OutFile to fd 1 ...
I1002 20:36:19.688804 272194 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:36:19.688811 272194 out.go:374] Setting ErrFile to fd 2...
I1002 20:36:19.688817 272194 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:36:19.689084 272194 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:36:19.689664 272194 out.go:368] Setting JSON to false
I1002 20:36:19.690661 272194 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-2","uptime":4729,"bootTime":1759432651,"procs":198,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1041-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1002 20:36:19.690763 272194 start.go:140] virtualization: kvm guest
I1002 20:36:19.693202 272194 out.go:179] * [multinode-269236] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1002 20:36:19.694642 272194 out.go:179] - MINIKUBE_LOCATION=21682
I1002 20:36:19.694639 272194 notify.go:220] Checking for updates...
I1002 20:36:19.696299 272194 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1002 20:36:19.697789 272194 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21682-131316/kubeconfig
I1002 20:36:19.699246 272194 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21682-131316/.minikube
I1002 20:36:19.700706 272194 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1002 20:36:19.702165 272194 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1002 20:36:19.703747 272194 driver.go:421] Setting default libvirt URI to qemu:///system
I1002 20:36:19.729878 272194 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
I1002 20:36:19.730001 272194 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 20:36:19.787319 272194 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-10-02 20:36:19.776112949 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1041-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652174848 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-2 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:b98a3aace656320842a23f4a392a33f46af97866 Expected:} RuncCommit:{ID:v1.3.0-0-g4ca628d1 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.29.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.4] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v0.1.40] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1002 20:36:19.787417 272194 docker.go:318] overlay module found
I1002 20:36:19.790175 272194 out.go:179] * Using the docker driver based on user configuration
I1002 20:36:19.791613 272194 start.go:304] selected driver: docker
I1002 20:36:19.791637 272194 start.go:924] validating driver "docker" against <nil>
I1002 20:36:19.791650 272194 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1002 20:36:19.792326 272194 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 20:36:19.852741 272194 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-10-02 20:36:19.842624321 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1041-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652174848 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-2 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:b98a3aace656320842a23f4a392a33f46af97866 Expected:} RuncCommit:{ID:v1.3.0-0-g4ca628d1 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.29.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.4] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v0.1.40] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1002 20:36:19.852935 272194 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I1002 20:36:19.853145 272194 start_flags.go:1002] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1002 20:36:19.855255 272194 out.go:179] * Using Docker driver with root privileges
I1002 20:36:19.856421 272194 cni.go:84] Creating CNI manager for ""
I1002 20:36:19.856467 272194 cni.go:136] multinode detected (0 nodes found), recommending kindnet
I1002 20:36:19.856477 272194 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
I1002 20:36:19.856552 272194 start.go:348] cluster config:
{Name:multinode-269236 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR
untime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SS
HAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 20:36:19.857980 272194 out.go:179] * Starting "multinode-269236" primary control-plane node in "multinode-269236" cluster
I1002 20:36:19.859239 272194 cache.go:123] Beginning downloading kic base image for docker with containerd
I1002 20:36:19.860476 272194 out.go:179] * Pulling base image v0.0.48-1759382731-21643 ...
I1002 20:36:19.861608 272194 preload.go:183] Checking if preload exists for k8s version v1.34.1 and runtime containerd
I1002 20:36:19.861634 272194 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d in local docker daemon
I1002 20:36:19.861662 272194 preload.go:198] Found local preload: /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4
I1002 20:36:19.861673 272194 cache.go:58] Caching tarball of preloaded images
I1002 20:36:19.861790 272194 preload.go:233] Found /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
I1002 20:36:19.861805 272194 cache.go:61] Finished verifying existence of preloaded tar for v1.34.1 on containerd
I1002 20:36:19.862194 272194 profile.go:143] Saving config to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/config.json ...
I1002 20:36:19.862227 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/config.json: {Name:mk0b243db99968eea625323f928c5506453a72be Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:19.882893 272194 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d in local docker daemon, skipping pull
I1002 20:36:19.882919 272194 cache.go:147] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d exists in daemon, skipping load
I1002 20:36:19.882936 272194 cache.go:232] Successfully downloaded all kic artifacts
I1002 20:36:19.882963 272194 start.go:360] acquireMachinesLock for multinode-269236: {Name:mk3f0b42b133cfbc247d9e60c80704a6df70453f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 20:36:19.883066 272194 start.go:364] duration metric: took 86.931µs to acquireMachinesLock for "multinode-269236"
I1002 20:36:19.883090 272194 start.go:93] Provisioning new machine with config: &{Name:multinode-269236 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQ
emuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I1002 20:36:19.883160 272194 start.go:125] createHost starting for "" (driver="docker")
I1002 20:36:19.885241 272194 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
I1002 20:36:19.885445 272194 start.go:159] libmachine.API.Create for "multinode-269236" (driver="docker")
I1002 20:36:19.885470 272194 client.go:168] LocalClient.Create starting
I1002 20:36:19.885544 272194 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem
I1002 20:36:19.885572 272194 main.go:141] libmachine: Decoding PEM data...
I1002 20:36:19.885586 272194 main.go:141] libmachine: Parsing certificate...
I1002 20:36:19.885653 272194 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem
I1002 20:36:19.885673 272194 main.go:141] libmachine: Decoding PEM data...
I1002 20:36:19.885684 272194 main.go:141] libmachine: Parsing certificate...
I1002 20:36:19.886131 272194 cli_runner.go:164] Run: docker network inspect multinode-269236 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1002 20:36:19.904045 272194 cli_runner.go:211] docker network inspect multinode-269236 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1002 20:36:19.904118 272194 network_create.go:284] running [docker network inspect multinode-269236] to gather additional debugging logs...
I1002 20:36:19.904139 272194 cli_runner.go:164] Run: docker network inspect multinode-269236
W1002 20:36:19.921729 272194 cli_runner.go:211] docker network inspect multinode-269236 returned with exit code 1
I1002 20:36:19.921766 272194 network_create.go:287] error running [docker network inspect multinode-269236]: docker network inspect multinode-269236: exit status 1
stdout:
[]
stderr:
Error response from daemon: network multinode-269236 not found
I1002 20:36:19.921781 272194 network_create.go:289] output of [docker network inspect multinode-269236]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network multinode-269236 not found
** /stderr **
I1002 20:36:19.921900 272194 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1002 20:36:19.940164 272194 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-bf5fd6aece25 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:06:db:7e:8b:fe:e0} reservation:<nil>}
I1002 20:36:19.940441 272194 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-57fe2645710b IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:6a:25:56:9d:36:d4} reservation:<nil>}
I1002 20:36:19.940751 272194 network.go:206] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0016a0e10}
I1002 20:36:19.940779 272194 network_create.go:124] attempt to create docker network multinode-269236 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
I1002 20:36:19.940840 272194 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-269236 multinode-269236
I1002 20:36:20.000978 272194 network_create.go:108] docker network multinode-269236 192.168.67.0/24 created
I1002 20:36:20.001010 272194 kic.go:121] calculated static IP "192.168.67.2" for the "multinode-269236" container
I1002 20:36:20.001086 272194 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1002 20:36:20.018406 272194 cli_runner.go:164] Run: docker volume create multinode-269236 --label name.minikube.sigs.k8s.io=multinode-269236 --label created_by.minikube.sigs.k8s.io=true
I1002 20:36:20.036909 272194 oci.go:103] Successfully created a docker volume multinode-269236
I1002 20:36:20.036994 272194 cli_runner.go:164] Run: docker run --rm --name multinode-269236-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-269236 --entrypoint /usr/bin/test -v multinode-269236:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d -d /var/lib
I1002 20:36:20.442305 272194 oci.go:107] Successfully prepared a docker volume multinode-269236
I1002 20:36:20.442341 272194 preload.go:183] Checking if preload exists for k8s version v1.34.1 and runtime containerd
I1002 20:36:20.442363 272194 kic.go:194] Starting extracting preloaded images to volume ...
I1002 20:36:20.442429 272194 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-269236:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d -I lz4 -xf /preloaded.tar -C /extractDir
I1002 20:36:24.878643 272194 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-269236:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d -I lz4 -xf /preloaded.tar -C /extractDir: (4.436148519s)
I1002 20:36:24.878684 272194 kic.go:203] duration metric: took 4.436317293s to extract preloaded images to volume ...
W1002 20:36:24.878775 272194 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1002 20:36:24.878808 272194 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1002 20:36:24.878874 272194 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1002 20:36:24.935820 272194 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname multinode-269236 --name multinode-269236 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-269236 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=multinode-269236 --network multinode-269236 --ip 192.168.67.2 --volume multinode-269236:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d
I1002 20:36:25.218816 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Running}}
I1002 20:36:25.238691 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:36:25.258817 272194 cli_runner.go:164] Run: docker exec multinode-269236 stat /var/lib/dpkg/alternatives/iptables
I1002 20:36:25.308400 272194 oci.go:144] the created container "multinode-269236" has a running status.
I1002 20:36:25.308452 272194 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa...
I1002 20:36:25.466004 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa.pub -> /home/docker/.ssh/authorized_keys
I1002 20:36:25.466066 272194 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1002 20:36:25.494608 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:36:25.515059 272194 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1002 20:36:25.515085 272194 kic_runner.go:114] Args: [docker exec --privileged multinode-269236 chown docker:docker /home/docker/.ssh/authorized_keys]
I1002 20:36:25.567526 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:36:25.589393 272194 machine.go:93] provisionDockerMachine start ...
I1002 20:36:25.589488 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:25.616098 272194 main.go:141] libmachine: Using SSH client type: native
I1002 20:36:25.616447 272194 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840040] 0x842d40 <nil> [] 0s} 127.0.0.1 33029 <nil> <nil>}
I1002 20:36:25.616470 272194 main.go:141] libmachine: About to run SSH command:
hostname
I1002 20:36:25.770208 272194 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-269236
I1002 20:36:25.770237 272194 ubuntu.go:182] provisioning hostname "multinode-269236"
I1002 20:36:25.770305 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:25.790487 272194 main.go:141] libmachine: Using SSH client type: native
I1002 20:36:25.790826 272194 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840040] 0x842d40 <nil> [] 0s} 127.0.0.1 33029 <nil> <nil>}
I1002 20:36:25.790874 272194 main.go:141] libmachine: About to run SSH command:
sudo hostname multinode-269236 && echo "multinode-269236" | sudo tee /etc/hostname
I1002 20:36:25.950677 272194 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-269236
I1002 20:36:25.950759 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:25.970765 272194 main.go:141] libmachine: Using SSH client type: native
I1002 20:36:25.971024 272194 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840040] 0x842d40 <nil> [] 0s} 127.0.0.1 33029 <nil> <nil>}
I1002 20:36:25.971047 272194 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smultinode-269236' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-269236/g' /etc/hosts;
else
echo '127.0.1.1 multinode-269236' | sudo tee -a /etc/hosts;
fi
fi
I1002 20:36:26.118257 272194 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1002 20:36:26.118282 272194 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21682-131316/.minikube CaCertPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21682-131316/.minikube}
I1002 20:36:26.118325 272194 ubuntu.go:190] setting up certificates
I1002 20:36:26.118344 272194 provision.go:84] configureAuth start
I1002 20:36:26.118400 272194 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236
I1002 20:36:26.137743 272194 provision.go:143] copyHostCerts
I1002 20:36:26.137782 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem
I1002 20:36:26.137817 272194 exec_runner.go:144] found /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem, removing ...
I1002 20:36:26.137830 272194 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem
I1002 20:36:26.137928 272194 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem (1675 bytes)
I1002 20:36:26.138055 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem
I1002 20:36:26.138086 272194 exec_runner.go:144] found /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem, removing ...
I1002 20:36:26.138097 272194 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem
I1002 20:36:26.138141 272194 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem (1078 bytes)
I1002 20:36:26.138212 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem
I1002 20:36:26.138241 272194 exec_runner.go:144] found /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem, removing ...
I1002 20:36:26.138251 272194 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem
I1002 20:36:26.138297 272194 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem (1123 bytes)
I1002 20:36:26.138369 272194 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca-key.pem org=jenkins.multinode-269236 san=[127.0.0.1 192.168.67.2 localhost minikube multinode-269236]
I1002 20:36:26.502951 272194 provision.go:177] copyRemoteCerts
I1002 20:36:26.503015 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1002 20:36:26.503050 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:26.522440 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:36:26.626700 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I1002 20:36:26.626773 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1002 20:36:26.648038 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I1002 20:36:26.648116 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1002 20:36:26.667207 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem -> /etc/docker/server.pem
I1002 20:36:26.667271 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
I1002 20:36:26.686282 272194 provision.go:87] duration metric: took 567.921979ms to configureAuth
I1002 20:36:26.686309 272194 ubuntu.go:206] setting minikube options for container-runtime
I1002 20:36:26.686503 272194 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:36:26.686520 272194 machine.go:96] duration metric: took 1.097105034s to provisionDockerMachine
I1002 20:36:26.686528 272194 client.go:171] duration metric: took 6.801048282s to LocalClient.Create
I1002 20:36:26.686558 272194 start.go:167] duration metric: took 6.801112998s to libmachine.API.Create "multinode-269236"
I1002 20:36:26.686570 272194 start.go:293] postStartSetup for "multinode-269236" (driver="docker")
I1002 20:36:26.686580 272194 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1002 20:36:26.686634 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1002 20:36:26.686707 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:26.704701 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:36:26.810957 272194 ssh_runner.go:195] Run: cat /etc/os-release
I1002 20:36:26.814827 272194 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1002 20:36:26.814874 272194 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1002 20:36:26.814887 272194 filesync.go:126] Scanning /home/jenkins/minikube-integration/21682-131316/.minikube/addons for local assets ...
I1002 20:36:26.814944 272194 filesync.go:126] Scanning /home/jenkins/minikube-integration/21682-131316/.minikube/files for local assets ...
I1002 20:36:26.815015 272194 filesync.go:149] local asset: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem -> 1348342.pem in /etc/ssl/certs
I1002 20:36:26.815025 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem -> /etc/ssl/certs/1348342.pem
I1002 20:36:26.815109 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1002 20:36:26.823686 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem --> /etc/ssl/certs/1348342.pem (1708 bytes)
I1002 20:36:26.845677 272194 start.go:296] duration metric: took 159.081175ms for postStartSetup
I1002 20:36:26.846098 272194 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236
I1002 20:36:26.864450 272194 profile.go:143] Saving config to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/config.json ...
I1002 20:36:26.864778 272194 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1002 20:36:26.864842 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:26.884289 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:36:26.985324 272194 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1002 20:36:26.990178 272194 start.go:128] duration metric: took 7.106998272s to createHost
I1002 20:36:26.990209 272194 start.go:83] releasing machines lock for "multinode-269236", held for 7.107130459s
I1002 20:36:26.990295 272194 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236
I1002 20:36:27.008722 272194 ssh_runner.go:195] Run: cat /version.json
I1002 20:36:27.008768 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:27.008803 272194 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1002 20:36:27.008896 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:27.027629 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:36:27.027956 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:36:27.178941 272194 ssh_runner.go:195] Run: systemctl --version
I1002 20:36:27.185884 272194 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1002 20:36:27.191070 272194 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1002 20:36:27.191132 272194 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1002 20:36:27.218870 272194 cni.go:262] disabled [/etc/cni/net.d/10-crio-bridge.conflist.disabled, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1002 20:36:27.218898 272194 start.go:495] detecting cgroup driver to use...
I1002 20:36:27.218938 272194 detect.go:190] detected "systemd" cgroup driver on host os
I1002 20:36:27.218995 272194 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1002 20:36:27.233814 272194 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1002 20:36:27.247078 272194 docker.go:218] disabling cri-docker service (if available) ...
I1002 20:36:27.247136 272194 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1002 20:36:27.264536 272194 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1002 20:36:27.283207 272194 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1002 20:36:27.362570 272194 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1002 20:36:27.449516 272194 docker.go:234] disabling docker service ...
I1002 20:36:27.449586 272194 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1002 20:36:27.468654 272194 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1002 20:36:27.482432 272194 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1002 20:36:27.568337 272194 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1002 20:36:27.646550 272194 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1002 20:36:27.660271 272194 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1002 20:36:27.676460 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10.1"|' /etc/containerd/config.toml"
I1002 20:36:27.688175 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1002 20:36:27.698446 272194 containerd.go:146] configuring containerd to use "systemd" as cgroup driver...
I1002 20:36:27.698514 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = true|g' /etc/containerd/config.toml"
I1002 20:36:27.708336 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1002 20:36:27.718285 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1002 20:36:27.727881 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1002 20:36:27.737758 272194 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1002 20:36:27.747020 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1002 20:36:27.756763 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I1002 20:36:27.766576 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I1002 20:36:27.776518 272194 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1002 20:36:27.784870 272194 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1002 20:36:27.793243 272194 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 20:36:27.875030 272194 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1002 20:36:27.981371 272194 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I1002 20:36:27.981434 272194 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I1002 20:36:27.986030 272194 start.go:563] Will wait 60s for crictl version
I1002 20:36:27.986103 272194 ssh_runner.go:195] Run: which crictl
I1002 20:36:27.990121 272194 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1002 20:36:28.016366 272194 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: v1.7.28
RuntimeApiVersion: v1
I1002 20:36:28.016427 272194 ssh_runner.go:195] Run: containerd --version
I1002 20:36:28.040598 272194 ssh_runner.go:195] Run: containerd --version
I1002 20:36:28.068316 272194 out.go:179] * Preparing Kubernetes v1.34.1 on containerd 1.7.28 ...
I1002 20:36:28.069574 272194 cli_runner.go:164] Run: docker network inspect multinode-269236 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1002 20:36:28.088087 272194 ssh_runner.go:195] Run: grep 192.168.67.1 host.minikube.internal$ /etc/hosts
I1002 20:36:28.092618 272194 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.67.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1002 20:36:28.103888 272194 kubeadm.go:883] updating cluster {Name:multinode-269236 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirm
warePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1002 20:36:28.104009 272194 preload.go:183] Checking if preload exists for k8s version v1.34.1 and runtime containerd
I1002 20:36:28.104059 272194 ssh_runner.go:195] Run: sudo crictl images --output json
I1002 20:36:28.130141 272194 containerd.go:627] all images are preloaded for containerd runtime.
I1002 20:36:28.130166 272194 containerd.go:534] Images already preloaded, skipping extraction
I1002 20:36:28.130225 272194 ssh_runner.go:195] Run: sudo crictl images --output json
I1002 20:36:28.155836 272194 containerd.go:627] all images are preloaded for containerd runtime.
I1002 20:36:28.155901 272194 cache_images.go:85] Images are preloaded, skipping loading
I1002 20:36:28.155910 272194 kubeadm.go:934] updating node { 192.168.67.2 8443 v1.34.1 containerd true true} ...
I1002 20:36:28.156015 272194 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=multinode-269236 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.67.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1002 20:36:28.156082 272194 ssh_runner.go:195] Run: sudo crictl info
I1002 20:36:28.183402 272194 cni.go:84] Creating CNI manager for ""
I1002 20:36:28.183423 272194 cni.go:136] multinode detected (1 nodes found), recommending kindnet
I1002 20:36:28.183436 272194 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I1002 20:36:28.183456 272194 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.67.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:multinode-269236 NodeName:multinode-269236 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.67.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.67.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath
:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1002 20:36:28.183576 272194 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.67.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "multinode-269236"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.67.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1002 20:36:28.183637 272194 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1002 20:36:28.192648 272194 binaries.go:44] Found k8s binaries, skipping transfer
I1002 20:36:28.192724 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1002 20:36:28.201281 272194 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (320 bytes)
I1002 20:36:28.215423 272194 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1002 20:36:28.232375 272194 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2228 bytes)
I1002 20:36:28.246589 272194 ssh_runner.go:195] Run: grep 192.168.67.2 control-plane.minikube.internal$ /etc/hosts
I1002 20:36:28.250734 272194 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1002 20:36:28.261683 272194 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 20:36:28.346580 272194 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1002 20:36:28.370395 272194 certs.go:69] Setting up /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236 for IP: 192.168.67.2
I1002 20:36:28.370421 272194 certs.go:195] generating shared ca certs ...
I1002 20:36:28.370442 272194 certs.go:227] acquiring lock for ca certs: {Name:mkf552d5738eef3436c5e81c3d27f053587b3fba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:28.370600 272194 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.key
I1002 20:36:28.370655 272194 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.key
I1002 20:36:28.370668 272194 certs.go:257] generating profile certs ...
I1002 20:36:28.370741 272194 certs.go:364] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key
I1002 20:36:28.370769 272194 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt with IP's: []
I1002 20:36:29.030807 272194 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt ...
I1002 20:36:29.030851 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt: {Name:mkaf323a07b6c38c38f39b4547eee07fb4fdbcfc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:29.031044 272194 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key ...
I1002 20:36:29.031058 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key: {Name:mk6d835bb611efff1089fda23628090b28a08970 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:29.031137 272194 certs.go:364] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.key.69c7d742
I1002 20:36:29.031152 272194 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.crt.69c7d742 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.67.2]
I1002 20:36:29.352525 272194 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.crt.69c7d742 ...
I1002 20:36:29.352558 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.crt.69c7d742: {Name:mkd4417ee07d65d2b9e956ad571850809d633a4b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:29.352735 272194 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.key.69c7d742 ...
I1002 20:36:29.352749 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.key.69c7d742: {Name:mkabe3258f3b31208ed4f9dedbd87b2bb24a50f3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:29.352822 272194 certs.go:382] copying /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.crt.69c7d742 -> /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.crt
I1002 20:36:29.352944 272194 certs.go:386] copying /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.key.69c7d742 -> /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.key
I1002 20:36:29.353014 272194 certs.go:364] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.key
I1002 20:36:29.353031 272194 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.crt with IP's: []
I1002 20:36:29.536089 272194 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.crt ...
I1002 20:36:29.536124 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.crt: {Name:mkfbebf463d2c179318846f1d68001f68c58505e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:29.536295 272194 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.key ...
I1002 20:36:29.536308 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.key: {Name:mkad362337bf21ee099fb88e0ba4e78425ca827c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:29.536383 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I1002 20:36:29.536401 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I1002 20:36:29.536411 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I1002 20:36:29.536424 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I1002 20:36:29.536434 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I1002 20:36:29.536447 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I1002 20:36:29.536457 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I1002 20:36:29.536469 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I1002 20:36:29.536523 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834.pem (1338 bytes)
W1002 20:36:29.536555 272194 certs.go:480] ignoring /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834_empty.pem, impossibly tiny 0 bytes
I1002 20:36:29.536564 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca-key.pem (1675 bytes)
I1002 20:36:29.536588 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem (1078 bytes)
I1002 20:36:29.536610 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem (1123 bytes)
I1002 20:36:29.536630 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem (1675 bytes)
I1002 20:36:29.536668 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem (1708 bytes)
I1002 20:36:29.536699 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I1002 20:36:29.536713 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834.pem -> /usr/share/ca-certificates/134834.pem
I1002 20:36:29.536725 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem -> /usr/share/ca-certificates/1348342.pem
I1002 20:36:29.537304 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1002 20:36:29.557817 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1002 20:36:29.577508 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1002 20:36:29.596424 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1002 20:36:29.614650 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I1002 20:36:29.633902 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1002 20:36:29.653472 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1002 20:36:29.673094 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1002 20:36:29.692277 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1002 20:36:29.714360 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834.pem --> /usr/share/ca-certificates/134834.pem (1338 bytes)
I1002 20:36:29.732949 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem --> /usr/share/ca-certificates/1348342.pem (1708 bytes)
I1002 20:36:29.752047 272194 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1002 20:36:29.765954 272194 ssh_runner.go:195] Run: openssl version
I1002 20:36:29.772620 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1002 20:36:29.782321 272194 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1002 20:36:29.786545 272194 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 2 20:16 /usr/share/ca-certificates/minikubeCA.pem
I1002 20:36:29.786610 272194 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1002 20:36:29.820952 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1002 20:36:29.830445 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/134834.pem && ln -fs /usr/share/ca-certificates/134834.pem /etc/ssl/certs/134834.pem"
I1002 20:36:29.839903 272194 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/134834.pem
I1002 20:36:29.844653 272194 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 2 20:22 /usr/share/ca-certificates/134834.pem
I1002 20:36:29.844732 272194 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/134834.pem
I1002 20:36:29.883347 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/134834.pem /etc/ssl/certs/51391683.0"
I1002 20:36:29.893017 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1348342.pem && ln -fs /usr/share/ca-certificates/1348342.pem /etc/ssl/certs/1348342.pem"
I1002 20:36:29.902805 272194 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1348342.pem
I1002 20:36:29.906874 272194 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 2 20:22 /usr/share/ca-certificates/1348342.pem
I1002 20:36:29.906957 272194 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1348342.pem
I1002 20:36:29.941313 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1348342.pem /etc/ssl/certs/3ec20f2e.0"
I1002 20:36:29.950792 272194 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1002 20:36:29.954996 272194 certs.go:400] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1002 20:36:29.955061 272194 kubeadm.go:400] StartCluster: {Name:multinode-269236 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServe
rNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwar
ePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 20:36:29.955136 272194 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I1002 20:36:29.955186 272194 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1002 20:36:29.984161 272194 cri.go:89] found id: ""
I1002 20:36:29.984250 272194 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1002 20:36:29.992960 272194 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1002 20:36:30.001936 272194 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I1002 20:36:30.002011 272194 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1002 20:36:30.010718 272194 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1002 20:36:30.010746 272194 kubeadm.go:157] found existing configuration files:
I1002 20:36:30.010799 272194 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1002 20:36:30.019299 272194 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1002 20:36:30.019363 272194 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1002 20:36:30.028354 272194 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1002 20:36:30.036971 272194 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1002 20:36:30.037079 272194 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1002 20:36:30.045598 272194 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1002 20:36:30.054106 272194 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1002 20:36:30.054160 272194 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1002 20:36:30.062217 272194 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1002 20:36:30.070629 272194 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1002 20:36:30.070691 272194 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1002 20:36:30.078764 272194 ssh_runner.go:286] Start: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.34.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1002 20:36:30.120311 272194 kubeadm.go:318] [init] Using Kubernetes version: v1.34.1
I1002 20:36:30.120383 272194 kubeadm.go:318] [preflight] Running pre-flight checks
I1002 20:36:30.142371 272194 kubeadm.go:318] [preflight] The system verification failed. Printing the output from the verification:
I1002 20:36:30.142453 272194 kubeadm.go:318] [0;37mKERNEL_VERSION[0m: [0;32m6.8.0-1041-gcp[0m
I1002 20:36:30.142503 272194 kubeadm.go:318] [0;37mOS[0m: [0;32mLinux[0m
I1002 20:36:30.142573 272194 kubeadm.go:318] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1002 20:36:30.142623 272194 kubeadm.go:318] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1002 20:36:30.142692 272194 kubeadm.go:318] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1002 20:36:30.142742 272194 kubeadm.go:318] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1002 20:36:30.142802 272194 kubeadm.go:318] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1002 20:36:30.142916 272194 kubeadm.go:318] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1002 20:36:30.143001 272194 kubeadm.go:318] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1002 20:36:30.143067 272194 kubeadm.go:318] [0;37mCGROUPS_IO[0m: [0;32menabled[0m
I1002 20:36:30.202151 272194 kubeadm.go:318] [preflight] Pulling images required for setting up a Kubernetes cluster
I1002 20:36:30.202276 272194 kubeadm.go:318] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1002 20:36:30.202409 272194 kubeadm.go:318] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I1002 20:36:30.208052 272194 kubeadm.go:318] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1002 20:36:30.210152 272194 out.go:252] - Generating certificates and keys ...
I1002 20:36:30.210250 272194 kubeadm.go:318] [certs] Using existing ca certificate authority
I1002 20:36:30.210324 272194 kubeadm.go:318] [certs] Using existing apiserver certificate and key on disk
I1002 20:36:30.730518 272194 kubeadm.go:318] [certs] Generating "apiserver-kubelet-client" certificate and key
I1002 20:36:30.795059 272194 kubeadm.go:318] [certs] Generating "front-proxy-ca" certificate and key
I1002 20:36:31.209631 272194 kubeadm.go:318] [certs] Generating "front-proxy-client" certificate and key
I1002 20:36:31.263228 272194 kubeadm.go:318] [certs] Generating "etcd/ca" certificate and key
I1002 20:36:31.328915 272194 kubeadm.go:318] [certs] Generating "etcd/server" certificate and key
I1002 20:36:31.329098 272194 kubeadm.go:318] [certs] etcd/server serving cert is signed for DNS names [localhost multinode-269236] and IPs [192.168.67.2 127.0.0.1 ::1]
I1002 20:36:31.864409 272194 kubeadm.go:318] [certs] Generating "etcd/peer" certificate and key
I1002 20:36:31.864607 272194 kubeadm.go:318] [certs] etcd/peer serving cert is signed for DNS names [localhost multinode-269236] and IPs [192.168.67.2 127.0.0.1 ::1]
I1002 20:36:32.011656 272194 kubeadm.go:318] [certs] Generating "etcd/healthcheck-client" certificate and key
I1002 20:36:32.359696 272194 kubeadm.go:318] [certs] Generating "apiserver-etcd-client" certificate and key
I1002 20:36:32.471180 272194 kubeadm.go:318] [certs] Generating "sa" key and public key
I1002 20:36:32.471344 272194 kubeadm.go:318] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1002 20:36:32.563787 272194 kubeadm.go:318] [kubeconfig] Writing "admin.conf" kubeconfig file
I1002 20:36:32.685668 272194 kubeadm.go:318] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I1002 20:36:32.960576 272194 kubeadm.go:318] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1002 20:36:33.146751 272194 kubeadm.go:318] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1002 20:36:34.062016 272194 kubeadm.go:318] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1002 20:36:34.062522 272194 kubeadm.go:318] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1002 20:36:34.066817 272194 kubeadm.go:318] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1002 20:36:34.068414 272194 out.go:252] - Booting up control plane ...
I1002 20:36:34.068563 272194 kubeadm.go:318] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1002 20:36:34.068689 272194 kubeadm.go:318] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1002 20:36:34.069435 272194 kubeadm.go:318] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1002 20:36:34.086404 272194 kubeadm.go:318] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1002 20:36:34.086550 272194 kubeadm.go:318] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
I1002 20:36:34.093638 272194 kubeadm.go:318] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
I1002 20:36:34.093814 272194 kubeadm.go:318] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1002 20:36:34.093917 272194 kubeadm.go:318] [kubelet-start] Starting the kubelet
I1002 20:36:34.197397 272194 kubeadm.go:318] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I1002 20:36:34.197563 272194 kubeadm.go:318] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I1002 20:36:34.699072 272194 kubeadm.go:318] [kubelet-check] The kubelet is healthy after 501.903941ms
I1002 20:36:34.701926 272194 kubeadm.go:318] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
I1002 20:36:34.702047 272194 kubeadm.go:318] [control-plane-check] Checking kube-apiserver at https://192.168.67.2:8443/livez
I1002 20:36:34.702172 272194 kubeadm.go:318] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
I1002 20:36:34.702287 272194 kubeadm.go:318] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
I1002 20:36:36.976036 272194 kubeadm.go:318] [control-plane-check] kube-scheduler is healthy after 2.274075116s
I1002 20:36:37.492250 272194 kubeadm.go:318] [control-plane-check] kube-controller-manager is healthy after 2.790162567s
I1002 20:36:38.704090 272194 kubeadm.go:318] [control-plane-check] kube-apiserver is healthy after 4.002082651s
I1002 20:36:38.715427 272194 kubeadm.go:318] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1002 20:36:38.726280 272194 kubeadm.go:318] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1002 20:36:38.739205 272194 kubeadm.go:318] [upload-certs] Skipping phase. Please see --upload-certs
I1002 20:36:38.739530 272194 kubeadm.go:318] [mark-control-plane] Marking the node multinode-269236 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1002 20:36:38.749183 272194 kubeadm.go:318] [bootstrap-token] Using token: ybvxvk.bdsd7yei0cagy4de
I1002 20:36:38.750712 272194 out.go:252] - Configuring RBAC rules ...
I1002 20:36:38.750883 272194 kubeadm.go:318] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1002 20:36:38.754668 272194 kubeadm.go:318] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1002 20:36:38.761044 272194 kubeadm.go:318] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1002 20:36:38.765035 272194 kubeadm.go:318] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1002 20:36:38.768381 272194 kubeadm.go:318] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1002 20:36:38.771811 272194 kubeadm.go:318] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1002 20:36:39.109940 272194 kubeadm.go:318] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1002 20:36:39.529008 272194 kubeadm.go:318] [addons] Applied essential addon: CoreDNS
I1002 20:36:40.110483 272194 kubeadm.go:318] [addons] Applied essential addon: kube-proxy
I1002 20:36:40.111303 272194 kubeadm.go:318]
I1002 20:36:40.111392 272194 kubeadm.go:318] Your Kubernetes control-plane has initialized successfully!
I1002 20:36:40.111408 272194 kubeadm.go:318]
I1002 20:36:40.111480 272194 kubeadm.go:318] To start using your cluster, you need to run the following as a regular user:
I1002 20:36:40.111486 272194 kubeadm.go:318]
I1002 20:36:40.111512 272194 kubeadm.go:318] mkdir -p $HOME/.kube
I1002 20:36:40.111567 272194 kubeadm.go:318] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1002 20:36:40.111641 272194 kubeadm.go:318] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1002 20:36:40.111648 272194 kubeadm.go:318]
I1002 20:36:40.111731 272194 kubeadm.go:318] Alternatively, if you are the root user, you can run:
I1002 20:36:40.111750 272194 kubeadm.go:318]
I1002 20:36:40.111818 272194 kubeadm.go:318] export KUBECONFIG=/etc/kubernetes/admin.conf
I1002 20:36:40.111827 272194 kubeadm.go:318]
I1002 20:36:40.111928 272194 kubeadm.go:318] You should now deploy a pod network to the cluster.
I1002 20:36:40.112049 272194 kubeadm.go:318] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1002 20:36:40.112143 272194 kubeadm.go:318] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1002 20:36:40.112151 272194 kubeadm.go:318]
I1002 20:36:40.112256 272194 kubeadm.go:318] You can now join any number of control-plane nodes by copying certificate authorities
I1002 20:36:40.112349 272194 kubeadm.go:318] and service account keys on each node and then running the following as root:
I1002 20:36:40.112370 272194 kubeadm.go:318]
I1002 20:36:40.112470 272194 kubeadm.go:318] kubeadm join control-plane.minikube.internal:8443 --token ybvxvk.bdsd7yei0cagy4de \
I1002 20:36:40.112595 272194 kubeadm.go:318] --discovery-token-ca-cert-hash sha256:19f830e57ecd67343002e647eaa09b4210d8c617f2ab1d39577e16129d93e626 \
I1002 20:36:40.112640 272194 kubeadm.go:318] --control-plane
I1002 20:36:40.112648 272194 kubeadm.go:318]
I1002 20:36:40.112782 272194 kubeadm.go:318] Then you can join any number of worker nodes by running the following on each as root:
I1002 20:36:40.112793 272194 kubeadm.go:318]
I1002 20:36:40.112917 272194 kubeadm.go:318] kubeadm join control-plane.minikube.internal:8443 --token ybvxvk.bdsd7yei0cagy4de \
I1002 20:36:40.113067 272194 kubeadm.go:318] --discovery-token-ca-cert-hash sha256:19f830e57ecd67343002e647eaa09b4210d8c617f2ab1d39577e16129d93e626
I1002 20:36:40.115296 272194 kubeadm.go:318] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1041-gcp\n", err: exit status 1
I1002 20:36:40.115398 272194 kubeadm.go:318] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1002 20:36:40.115410 272194 cni.go:84] Creating CNI manager for ""
I1002 20:36:40.115416 272194 cni.go:136] multinode detected (1 nodes found), recommending kindnet
I1002 20:36:40.117571 272194 out.go:179] * Configuring CNI (Container Networking Interface) ...
I1002 20:36:40.118796 272194 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I1002 20:36:40.123471 272194 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.1/kubectl ...
I1002 20:36:40.123497 272194 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I1002 20:36:40.136782 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I1002 20:36:40.353581 272194 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1002 20:36:40.353696 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:40.353695 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes multinode-269236 minikube.k8s.io/updated_at=2025_10_02T20_36_40_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=193cee6aa0f134b5df421bbd88a1ddd3223481a4 minikube.k8s.io/name=multinode-269236 minikube.k8s.io/primary=true
I1002 20:36:40.363741 272194 ops.go:34] apiserver oom_adj: -16
I1002 20:36:40.435635 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:40.935926 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:41.436675 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:41.935931 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:42.435891 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:42.935888 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:43.436256 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:43.936329 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:44.435892 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:44.513355 272194 kubeadm.go:1113] duration metric: took 4.159767647s to wait for elevateKubeSystemPrivileges
I1002 20:36:44.513401 272194 kubeadm.go:402] duration metric: took 14.55834432s to StartCluster
I1002 20:36:44.513426 272194 settings.go:142] acquiring lock: {Name:mke1f0ca63c2d2618dadf3c7cba97650e8fb155d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:44.513512 272194 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21682-131316/kubeconfig
I1002 20:36:44.514393 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/kubeconfig: {Name:mkd22c02ac1b9def20da9dd625743bf2c9dc45c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:44.514693 272194 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1002 20:36:44.514698 272194 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I1002 20:36:44.514772 272194 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1002 20:36:44.514893 272194 addons.go:69] Setting storage-provisioner=true in profile "multinode-269236"
I1002 20:36:44.514916 272194 addons.go:238] Setting addon storage-provisioner=true in "multinode-269236"
I1002 20:36:44.514948 272194 host.go:66] Checking if "multinode-269236" exists ...
I1002 20:36:44.514936 272194 addons.go:69] Setting default-storageclass=true in profile "multinode-269236"
I1002 20:36:44.514983 272194 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "multinode-269236"
I1002 20:36:44.515002 272194 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:36:44.515318 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:36:44.515448 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:36:44.516018 272194 out.go:179] * Verifying Kubernetes components...
I1002 20:36:44.517358 272194 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 20:36:44.539759 272194 kapi.go:59] client config for multinode-269236: &rest.Config{Host:"https://192.168.67.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt", KeyFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key", CAFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Ne
xtProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2819b80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1002 20:36:44.540994 272194 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
I1002 20:36:44.541022 272194 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
I1002 20:36:44.541030 272194 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
I1002 20:36:44.541035 272194 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
I1002 20:36:44.541040 272194 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
I1002 20:36:44.541060 272194 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache"
I1002 20:36:44.541488 272194 addons.go:238] Setting addon default-storageclass=true in "multinode-269236"
I1002 20:36:44.541529 272194 host.go:66] Checking if "multinode-269236" exists ...
I1002 20:36:44.542040 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:36:44.543065 272194 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1002 20:36:44.544380 272194 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1002 20:36:44.544405 272194 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1002 20:36:44.544473 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:44.571528 272194 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
I1002 20:36:44.571552 272194 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1002 20:36:44.571611 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:44.578834 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:36:44.594272 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:36:44.627875 272194 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.67.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I1002 20:36:44.674091 272194 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1002 20:36:44.701995 272194 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1002 20:36:44.736605 272194 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1002 20:36:44.827818 272194 start.go:976] {"host.minikube.internal": 192.168.67.1} host record injected into CoreDNS's ConfigMap
I1002 20:36:44.828395 272194 kapi.go:59] client config for multinode-269236: &rest.Config{Host:"https://192.168.67.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt", KeyFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key", CAFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Ne
xtProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2819b80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1002 20:36:44.828617 272194 kapi.go:59] client config for multinode-269236: &rest.Config{Host:"https://192.168.67.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt", KeyFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key", CAFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Ne
xtProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2819b80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1002 20:36:44.829035 272194 node_ready.go:35] waiting up to 6m0s for node "multinode-269236" to be "Ready" ...
I1002 20:36:45.056387 272194 out.go:179] * Enabled addons: storage-provisioner, default-storageclass
I1002 20:36:45.057464 272194 addons.go:514] duration metric: took 542.694128ms for enable addons: enabled=[storage-provisioner default-storageclass]
I1002 20:36:45.340195 272194 kapi.go:214] "coredns" deployment in "kube-system" namespace and "multinode-269236" context rescaled to 1 replicas
W1002 20:36:46.832645 272194 node_ready.go:57] node "multinode-269236" has "Ready":"False" status (will retry)
W1002 20:36:49.332587 272194 node_ready.go:57] node "multinode-269236" has "Ready":"False" status (will retry)
W1002 20:36:51.832210 272194 node_ready.go:57] node "multinode-269236" has "Ready":"False" status (will retry)
W1002 20:36:53.833132 272194 node_ready.go:57] node "multinode-269236" has "Ready":"False" status (will retry)
I1002 20:36:55.832884 272194 node_ready.go:49] node "multinode-269236" is "Ready"
I1002 20:36:55.832913 272194 node_ready.go:38] duration metric: took 11.003806024s for node "multinode-269236" to be "Ready" ...
I1002 20:36:55.832935 272194 api_server.go:52] waiting for apiserver process to appear ...
I1002 20:36:55.832984 272194 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1002 20:36:55.845570 272194 api_server.go:72] duration metric: took 11.330837553s to wait for apiserver process to appear ...
I1002 20:36:55.845602 272194 api_server.go:88] waiting for apiserver healthz status ...
I1002 20:36:55.845629 272194 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
I1002 20:36:55.851015 272194 api_server.go:279] https://192.168.67.2:8443/healthz returned 200:
ok
I1002 20:36:55.851971 272194 api_server.go:141] control plane version: v1.34.1
I1002 20:36:55.851996 272194 api_server.go:131] duration metric: took 6.387081ms to wait for apiserver health ...
I1002 20:36:55.852005 272194 system_pods.go:43] waiting for kube-system pods to appear ...
I1002 20:36:55.855076 272194 system_pods.go:59] 8 kube-system pods found
I1002 20:36:55.855107 272194 system_pods.go:61] "coredns-66bc5c9577-xvcxn" [17848551-b9d2-4174-98bd-cd9bdb8f86ff] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1002 20:36:55.855115 272194 system_pods.go:61] "etcd-multinode-269236" [2ce9f1c0-bfb9-48b5-bb8d-05dafa2e8ba7] Running
I1002 20:36:55.855123 272194 system_pods.go:61] "kindnet-cl6sd" [51358b09-1a79-4e64-a9cd-7443684e1d86] Running
I1002 20:36:55.855126 272194 system_pods.go:61] "kube-apiserver-multinode-269236" [6b9d8533-8d0f-4f18-a9eb-1f6bcc3d4cb5] Running
I1002 20:36:55.855131 272194 system_pods.go:61] "kube-controller-manager-multinode-269236" [596362ca-cc79-4ae9-902d-0d19724b62f7] Running
I1002 20:36:55.855134 272194 system_pods.go:61] "kube-proxy-l9xd2" [a483457a-ffba-4887-9245-9655e230e47f] Running
I1002 20:36:55.855138 272194 system_pods.go:61] "kube-scheduler-multinode-269236" [7437218e-ca9c-4ac3-9e2c-055663e26bfb] Running
I1002 20:36:55.855143 272194 system_pods.go:61] "storage-provisioner" [71f400c9-ce64-40d9-a406-14278dfccf89] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1002 20:36:55.855152 272194 system_pods.go:74] duration metric: took 3.141872ms to wait for pod list to return data ...
I1002 20:36:55.855160 272194 default_sa.go:34] waiting for default service account to be created ...
I1002 20:36:55.857543 272194 default_sa.go:45] found service account: "default"
I1002 20:36:55.857563 272194 default_sa.go:55] duration metric: took 2.396372ms for default service account to be created ...
I1002 20:36:55.857573 272194 system_pods.go:116] waiting for k8s-apps to be running ...
I1002 20:36:55.860067 272194 system_pods.go:86] 8 kube-system pods found
I1002 20:36:55.860093 272194 system_pods.go:89] "coredns-66bc5c9577-xvcxn" [17848551-b9d2-4174-98bd-cd9bdb8f86ff] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1002 20:36:55.860098 272194 system_pods.go:89] "etcd-multinode-269236" [2ce9f1c0-bfb9-48b5-bb8d-05dafa2e8ba7] Running
I1002 20:36:55.860104 272194 system_pods.go:89] "kindnet-cl6sd" [51358b09-1a79-4e64-a9cd-7443684e1d86] Running
I1002 20:36:55.860110 272194 system_pods.go:89] "kube-apiserver-multinode-269236" [6b9d8533-8d0f-4f18-a9eb-1f6bcc3d4cb5] Running
I1002 20:36:55.860114 272194 system_pods.go:89] "kube-controller-manager-multinode-269236" [596362ca-cc79-4ae9-902d-0d19724b62f7] Running
I1002 20:36:55.860117 272194 system_pods.go:89] "kube-proxy-l9xd2" [a483457a-ffba-4887-9245-9655e230e47f] Running
I1002 20:36:55.860121 272194 system_pods.go:89] "kube-scheduler-multinode-269236" [7437218e-ca9c-4ac3-9e2c-055663e26bfb] Running
I1002 20:36:55.860126 272194 system_pods.go:89] "storage-provisioner" [71f400c9-ce64-40d9-a406-14278dfccf89] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1002 20:36:55.860161 272194 retry.go:31] will retry after 204.191722ms: missing components: kube-dns
I1002 20:36:56.069524 272194 system_pods.go:86] 8 kube-system pods found
I1002 20:36:56.069564 272194 system_pods.go:89] "coredns-66bc5c9577-xvcxn" [17848551-b9d2-4174-98bd-cd9bdb8f86ff] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1002 20:36:56.069572 272194 system_pods.go:89] "etcd-multinode-269236" [2ce9f1c0-bfb9-48b5-bb8d-05dafa2e8ba7] Running
I1002 20:36:56.069581 272194 system_pods.go:89] "kindnet-cl6sd" [51358b09-1a79-4e64-a9cd-7443684e1d86] Running
I1002 20:36:56.069586 272194 system_pods.go:89] "kube-apiserver-multinode-269236" [6b9d8533-8d0f-4f18-a9eb-1f6bcc3d4cb5] Running
I1002 20:36:56.069592 272194 system_pods.go:89] "kube-controller-manager-multinode-269236" [596362ca-cc79-4ae9-902d-0d19724b62f7] Running
I1002 20:36:56.069597 272194 system_pods.go:89] "kube-proxy-l9xd2" [a483457a-ffba-4887-9245-9655e230e47f] Running
I1002 20:36:56.069602 272194 system_pods.go:89] "kube-scheduler-multinode-269236" [7437218e-ca9c-4ac3-9e2c-055663e26bfb] Running
I1002 20:36:56.069610 272194 system_pods.go:89] "storage-provisioner" [71f400c9-ce64-40d9-a406-14278dfccf89] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1002 20:36:56.069630 272194 retry.go:31] will retry after 289.097595ms: missing components: kube-dns
I1002 20:36:56.362519 272194 system_pods.go:86] 8 kube-system pods found
I1002 20:36:56.362552 272194 system_pods.go:89] "coredns-66bc5c9577-xvcxn" [17848551-b9d2-4174-98bd-cd9bdb8f86ff] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1002 20:36:56.362557 272194 system_pods.go:89] "etcd-multinode-269236" [2ce9f1c0-bfb9-48b5-bb8d-05dafa2e8ba7] Running
I1002 20:36:56.362565 272194 system_pods.go:89] "kindnet-cl6sd" [51358b09-1a79-4e64-a9cd-7443684e1d86] Running
I1002 20:36:56.362569 272194 system_pods.go:89] "kube-apiserver-multinode-269236" [6b9d8533-8d0f-4f18-a9eb-1f6bcc3d4cb5] Running
I1002 20:36:56.362573 272194 system_pods.go:89] "kube-controller-manager-multinode-269236" [596362ca-cc79-4ae9-902d-0d19724b62f7] Running
I1002 20:36:56.362576 272194 system_pods.go:89] "kube-proxy-l9xd2" [a483457a-ffba-4887-9245-9655e230e47f] Running
I1002 20:36:56.362579 272194 system_pods.go:89] "kube-scheduler-multinode-269236" [7437218e-ca9c-4ac3-9e2c-055663e26bfb] Running
I1002 20:36:56.362584 272194 system_pods.go:89] "storage-provisioner" [71f400c9-ce64-40d9-a406-14278dfccf89] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1002 20:36:56.362605 272194 retry.go:31] will retry after 399.671953ms: missing components: kube-dns
I1002 20:36:56.766535 272194 system_pods.go:86] 8 kube-system pods found
I1002 20:36:56.766563 272194 system_pods.go:89] "coredns-66bc5c9577-xvcxn" [17848551-b9d2-4174-98bd-cd9bdb8f86ff] Running
I1002 20:36:56.766569 272194 system_pods.go:89] "etcd-multinode-269236" [2ce9f1c0-bfb9-48b5-bb8d-05dafa2e8ba7] Running
I1002 20:36:56.766572 272194 system_pods.go:89] "kindnet-cl6sd" [51358b09-1a79-4e64-a9cd-7443684e1d86] Running
I1002 20:36:56.766576 272194 system_pods.go:89] "kube-apiserver-multinode-269236" [6b9d8533-8d0f-4f18-a9eb-1f6bcc3d4cb5] Running
I1002 20:36:56.766580 272194 system_pods.go:89] "kube-controller-manager-multinode-269236" [596362ca-cc79-4ae9-902d-0d19724b62f7] Running
I1002 20:36:56.766583 272194 system_pods.go:89] "kube-proxy-l9xd2" [a483457a-ffba-4887-9245-9655e230e47f] Running
I1002 20:36:56.766586 272194 system_pods.go:89] "kube-scheduler-multinode-269236" [7437218e-ca9c-4ac3-9e2c-055663e26bfb] Running
I1002 20:36:56.766589 272194 system_pods.go:89] "storage-provisioner" [71f400c9-ce64-40d9-a406-14278dfccf89] Running
I1002 20:36:56.766598 272194 system_pods.go:126] duration metric: took 909.01809ms to wait for k8s-apps to be running ...
I1002 20:36:56.766608 272194 system_svc.go:44] waiting for kubelet service to be running ....
I1002 20:36:56.766669 272194 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1002 20:36:56.779920 272194 system_svc.go:56] duration metric: took 13.29337ms WaitForService to wait for kubelet
I1002 20:36:56.779947 272194 kubeadm.go:586] duration metric: took 12.265222484s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1002 20:36:56.779969 272194 node_conditions.go:102] verifying NodePressure condition ...
I1002 20:36:56.782793 272194 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1002 20:36:56.782822 272194 node_conditions.go:123] node cpu capacity is 8
I1002 20:36:56.782862 272194 node_conditions.go:105] duration metric: took 2.886494ms to run NodePressure ...
I1002 20:36:56.782879 272194 start.go:241] waiting for startup goroutines ...
I1002 20:36:56.782888 272194 start.go:246] waiting for cluster config update ...
I1002 20:36:56.782902 272194 start.go:255] writing updated cluster config ...
I1002 20:36:56.785176 272194 out.go:203]
I1002 20:36:56.786767 272194 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:36:56.786888 272194 profile.go:143] Saving config to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/config.json ...
I1002 20:36:56.788387 272194 out.go:179] * Starting "multinode-269236-m02" worker node in "multinode-269236" cluster
I1002 20:36:56.789928 272194 cache.go:123] Beginning downloading kic base image for docker with containerd
I1002 20:36:56.791175 272194 out.go:179] * Pulling base image v0.0.48-1759382731-21643 ...
I1002 20:36:56.792259 272194 preload.go:183] Checking if preload exists for k8s version v1.34.1 and runtime containerd
I1002 20:36:56.792286 272194 cache.go:58] Caching tarball of preloaded images
I1002 20:36:56.792354 272194 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d in local docker daemon
I1002 20:36:56.792384 272194 preload.go:233] Found /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
I1002 20:36:56.792395 272194 cache.go:61] Finished verifying existence of preloaded tar for v1.34.1 on containerd
I1002 20:36:56.792469 272194 profile.go:143] Saving config to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/config.json ...
I1002 20:36:56.813715 272194 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d in local docker daemon, skipping pull
I1002 20:36:56.813735 272194 cache.go:147] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d exists in daemon, skipping load
I1002 20:36:56.813750 272194 cache.go:232] Successfully downloaded all kic artifacts
I1002 20:36:56.813776 272194 start.go:360] acquireMachinesLock for multinode-269236-m02: {Name:mkb9f2ec51b473505117c59b8e8aff8882c03812 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 20:36:56.813906 272194 start.go:364] duration metric: took 113.953µs to acquireMachinesLock for "multinode-269236-m02"
I1002 20:36:56.813937 272194 start.go:93] Provisioning new machine with config: &{Name:multinode-269236 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:false Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker Mount
IP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:false Worker:true}
I1002 20:36:56.814002 272194 start.go:125] createHost starting for "m02" (driver="docker")
I1002 20:36:56.816588 272194 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
I1002 20:36:56.816684 272194 start.go:159] libmachine.API.Create for "multinode-269236" (driver="docker")
I1002 20:36:56.816710 272194 client.go:168] LocalClient.Create starting
I1002 20:36:56.816775 272194 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem
I1002 20:36:56.816804 272194 main.go:141] libmachine: Decoding PEM data...
I1002 20:36:56.816820 272194 main.go:141] libmachine: Parsing certificate...
I1002 20:36:56.816901 272194 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem
I1002 20:36:56.816924 272194 main.go:141] libmachine: Decoding PEM data...
I1002 20:36:56.816936 272194 main.go:141] libmachine: Parsing certificate...
I1002 20:36:56.817123 272194 cli_runner.go:164] Run: docker network inspect multinode-269236 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1002 20:36:56.835120 272194 network_create.go:77] Found existing network {name:multinode-269236 subnet:0xc0018d3d40 gateway:[0 0 0 0 0 0 0 0 0 0 255 255 192 168 67 1] mtu:1500}
I1002 20:36:56.835163 272194 kic.go:121] calculated static IP "192.168.67.3" for the "multinode-269236-m02" container
I1002 20:36:56.835223 272194 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1002 20:36:56.852300 272194 cli_runner.go:164] Run: docker volume create multinode-269236-m02 --label name.minikube.sigs.k8s.io=multinode-269236-m02 --label created_by.minikube.sigs.k8s.io=true
I1002 20:36:56.872106 272194 oci.go:103] Successfully created a docker volume multinode-269236-m02
I1002 20:36:56.872196 272194 cli_runner.go:164] Run: docker run --rm --name multinode-269236-m02-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-269236-m02 --entrypoint /usr/bin/test -v multinode-269236-m02:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d -d /var/lib
I1002 20:36:57.254673 272194 oci.go:107] Successfully prepared a docker volume multinode-269236-m02
I1002 20:36:57.254717 272194 preload.go:183] Checking if preload exists for k8s version v1.34.1 and runtime containerd
I1002 20:36:57.254739 272194 kic.go:194] Starting extracting preloaded images to volume ...
I1002 20:36:57.254792 272194 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-269236-m02:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d -I lz4 -xf /preloaded.tar -C /extractDir
I1002 20:37:01.662098 272194 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-269236-m02:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d -I lz4 -xf /preloaded.tar -C /extractDir: (4.407262446s)
I1002 20:37:01.662134 272194 kic.go:203] duration metric: took 4.407391414s to extract preloaded images to volume ...
W1002 20:37:01.662226 272194 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1002 20:37:01.662255 272194 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1002 20:37:01.662293 272194 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1002 20:37:01.715904 272194 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname multinode-269236-m02 --name multinode-269236-m02 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-269236-m02 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=multinode-269236-m02 --network multinode-269236 --ip 192.168.67.3 --volume multinode-269236-m02:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d
I1002 20:37:02.005994 272194 cli_runner.go:164] Run: docker container inspect multinode-269236-m02 --format={{.State.Running}}
I1002 20:37:02.026895 272194 cli_runner.go:164] Run: docker container inspect multinode-269236-m02 --format={{.State.Status}}
I1002 20:37:02.046706 272194 cli_runner.go:164] Run: docker exec multinode-269236-m02 stat /var/lib/dpkg/alternatives/iptables
I1002 20:37:02.092662 272194 oci.go:144] the created container "multinode-269236-m02" has a running status.
I1002 20:37:02.092695 272194 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa...
I1002 20:37:02.408608 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa.pub -> /home/docker/.ssh/authorized_keys
I1002 20:37:02.408702 272194 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1002 20:37:02.439192 272194 cli_runner.go:164] Run: docker container inspect multinode-269236-m02 --format={{.State.Status}}
I1002 20:37:02.458766 272194 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1002 20:37:02.458794 272194 kic_runner.go:114] Args: [docker exec --privileged multinode-269236-m02 chown docker:docker /home/docker/.ssh/authorized_keys]
I1002 20:37:02.505382 272194 cli_runner.go:164] Run: docker container inspect multinode-269236-m02 --format={{.State.Status}}
I1002 20:37:02.526292 272194 machine.go:93] provisionDockerMachine start ...
I1002 20:37:02.526380 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:02.548060 272194 main.go:141] libmachine: Using SSH client type: native
I1002 20:37:02.548303 272194 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840040] 0x842d40 <nil> [] 0s} 127.0.0.1 33034 <nil> <nil>}
I1002 20:37:02.548318 272194 main.go:141] libmachine: About to run SSH command:
hostname
I1002 20:37:02.696382 272194 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-269236-m02
I1002 20:37:02.696421 272194 ubuntu.go:182] provisioning hostname "multinode-269236-m02"
I1002 20:37:02.696496 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:02.716294 272194 main.go:141] libmachine: Using SSH client type: native
I1002 20:37:02.716504 272194 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840040] 0x842d40 <nil> [] 0s} 127.0.0.1 33034 <nil> <nil>}
I1002 20:37:02.716517 272194 main.go:141] libmachine: About to run SSH command:
sudo hostname multinode-269236-m02 && echo "multinode-269236-m02" | sudo tee /etc/hostname
I1002 20:37:02.874557 272194 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-269236-m02
I1002 20:37:02.874639 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:02.893427 272194 main.go:141] libmachine: Using SSH client type: native
I1002 20:37:02.893669 272194 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840040] 0x842d40 <nil> [] 0s} 127.0.0.1 33034 <nil> <nil>}
I1002 20:37:02.893691 272194 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smultinode-269236-m02' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-269236-m02/g' /etc/hosts;
else
echo '127.0.1.1 multinode-269236-m02' | sudo tee -a /etc/hosts;
fi
fi
I1002 20:37:03.041026 272194 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1002 20:37:03.041065 272194 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21682-131316/.minikube CaCertPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21682-131316/.minikube}
I1002 20:37:03.041083 272194 ubuntu.go:190] setting up certificates
I1002 20:37:03.041113 272194 provision.go:84] configureAuth start
I1002 20:37:03.041185 272194 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236-m02
I1002 20:37:03.059208 272194 provision.go:143] copyHostCerts
I1002 20:37:03.059247 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem
I1002 20:37:03.059278 272194 exec_runner.go:144] found /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem, removing ...
I1002 20:37:03.059288 272194 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem
I1002 20:37:03.059361 272194 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem (1078 bytes)
I1002 20:37:03.059439 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem
I1002 20:37:03.059460 272194 exec_runner.go:144] found /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem, removing ...
I1002 20:37:03.059466 272194 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem
I1002 20:37:03.059493 272194 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem (1123 bytes)
I1002 20:37:03.059538 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem
I1002 20:37:03.059554 272194 exec_runner.go:144] found /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem, removing ...
I1002 20:37:03.059560 272194 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem
I1002 20:37:03.059582 272194 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem (1675 bytes)
I1002 20:37:03.059635 272194 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca-key.pem org=jenkins.multinode-269236-m02 san=[127.0.0.1 192.168.67.3 localhost minikube multinode-269236-m02]
I1002 20:37:03.185075 272194 provision.go:177] copyRemoteCerts
I1002 20:37:03.185150 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1002 20:37:03.185187 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:03.205082 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33034 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa Username:docker}
I1002 20:37:03.310046 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I1002 20:37:03.310132 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1002 20:37:03.331051 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem -> /etc/docker/server.pem
I1002 20:37:03.331107 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem --> /etc/docker/server.pem (1229 bytes)
I1002 20:37:03.349833 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I1002 20:37:03.349908 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1002 20:37:03.368618 272194 provision.go:87] duration metric: took 327.483229ms to configureAuth
I1002 20:37:03.368649 272194 ubuntu.go:206] setting minikube options for container-runtime
I1002 20:37:03.368836 272194 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:37:03.368875 272194 machine.go:96] duration metric: took 842.558721ms to provisionDockerMachine
I1002 20:37:03.368886 272194 client.go:171] duration metric: took 6.552164526s to LocalClient.Create
I1002 20:37:03.368915 272194 start.go:167] duration metric: took 6.552229267s to libmachine.API.Create "multinode-269236"
I1002 20:37:03.368929 272194 start.go:293] postStartSetup for "multinode-269236-m02" (driver="docker")
I1002 20:37:03.368951 272194 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1002 20:37:03.369015 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1002 20:37:03.369071 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:03.387606 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33034 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa Username:docker}
I1002 20:37:03.494445 272194 ssh_runner.go:195] Run: cat /etc/os-release
I1002 20:37:03.498589 272194 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1002 20:37:03.498616 272194 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1002 20:37:03.498628 272194 filesync.go:126] Scanning /home/jenkins/minikube-integration/21682-131316/.minikube/addons for local assets ...
I1002 20:37:03.498685 272194 filesync.go:126] Scanning /home/jenkins/minikube-integration/21682-131316/.minikube/files for local assets ...
I1002 20:37:03.498750 272194 filesync.go:149] local asset: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem -> 1348342.pem in /etc/ssl/certs
I1002 20:37:03.498760 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem -> /etc/ssl/certs/1348342.pem
I1002 20:37:03.498840 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1002 20:37:03.507655 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem --> /etc/ssl/certs/1348342.pem (1708 bytes)
I1002 20:37:03.530326 272194 start.go:296] duration metric: took 161.382401ms for postStartSetup
I1002 20:37:03.530717 272194 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236-m02
I1002 20:37:03.548971 272194 profile.go:143] Saving config to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/config.json ...
I1002 20:37:03.549258 272194 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1002 20:37:03.549302 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:03.567633 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33034 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa Username:docker}
I1002 20:37:03.668386 272194 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1002 20:37:03.673614 272194 start.go:128] duration metric: took 6.859591671s to createHost
I1002 20:37:03.673647 272194 start.go:83] releasing machines lock for "multinode-269236-m02", held for 6.859724336s
I1002 20:37:03.673727 272194 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236-m02
I1002 20:37:03.695212 272194 out.go:179] * Found network options:
I1002 20:37:03.696597 272194 out.go:179] - NO_PROXY=192.168.67.2
W1002 20:37:03.697796 272194 proxy.go:120] fail to check proxy env: Error ip not in block
W1002 20:37:03.697884 272194 proxy.go:120] fail to check proxy env: Error ip not in block
I1002 20:37:03.697980 272194 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1002 20:37:03.698033 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:03.698068 272194 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1002 20:37:03.698142 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:03.717602 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33034 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa Username:docker}
I1002 20:37:03.717895 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33034 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa Username:docker}
W1002 20:37:03.871862 272194 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1002 20:37:03.871953 272194 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1002 20:37:03.899103 272194 cni.go:262] disabled [/etc/cni/net.d/10-crio-bridge.conflist.disabled, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1002 20:37:03.899144 272194 start.go:495] detecting cgroup driver to use...
I1002 20:37:03.899187 272194 detect.go:190] detected "systemd" cgroup driver on host os
I1002 20:37:03.899243 272194 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1002 20:37:03.914975 272194 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1002 20:37:03.928658 272194 docker.go:218] disabling cri-docker service (if available) ...
I1002 20:37:03.928750 272194 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1002 20:37:03.946470 272194 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1002 20:37:03.965477 272194 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1002 20:37:04.051650 272194 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1002 20:37:04.141110 272194 docker.go:234] disabling docker service ...
I1002 20:37:04.141191 272194 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1002 20:37:04.160950 272194 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1002 20:37:04.175512 272194 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1002 20:37:04.260001 272194 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1002 20:37:04.343927 272194 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1002 20:37:04.358127 272194 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1002 20:37:04.373538 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10.1"|' /etc/containerd/config.toml"
I1002 20:37:04.385172 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1002 20:37:04.394986 272194 containerd.go:146] configuring containerd to use "systemd" as cgroup driver...
I1002 20:37:04.395063 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = true|g' /etc/containerd/config.toml"
I1002 20:37:04.405174 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1002 20:37:04.414655 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1002 20:37:04.424387 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1002 20:37:04.434664 272194 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1002 20:37:04.444054 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1002 20:37:04.453942 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I1002 20:37:04.464335 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I1002 20:37:04.474185 272194 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1002 20:37:04.482464 272194 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1002 20:37:04.491485 272194 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 20:37:04.567076 272194 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1002 20:37:04.674685 272194 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I1002 20:37:04.674767 272194 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I1002 20:37:04.678953 272194 start.go:563] Will wait 60s for crictl version
I1002 20:37:04.679026 272194 ssh_runner.go:195] Run: which crictl
I1002 20:37:04.682898 272194 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1002 20:37:04.709141 272194 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: v1.7.28
RuntimeApiVersion: v1
I1002 20:37:04.709225 272194 ssh_runner.go:195] Run: containerd --version
I1002 20:37:04.734439 272194 ssh_runner.go:195] Run: containerd --version
I1002 20:37:04.760911 272194 out.go:179] * Preparing Kubernetes v1.34.1 on containerd 1.7.28 ...
I1002 20:37:04.762567 272194 out.go:179] - env NO_PROXY=192.168.67.2
I1002 20:37:04.763961 272194 cli_runner.go:164] Run: docker network inspect multinode-269236 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1002 20:37:04.781657 272194 ssh_runner.go:195] Run: grep 192.168.67.1 host.minikube.internal$ /etc/hosts
I1002 20:37:04.785913 272194 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.67.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1002 20:37:04.796677 272194 mustload.go:65] Loading cluster: multinode-269236
I1002 20:37:04.796921 272194 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:37:04.797132 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:37:04.816313 272194 host.go:66] Checking if "multinode-269236" exists ...
I1002 20:37:04.816543 272194 certs.go:69] Setting up /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236 for IP: 192.168.67.3
I1002 20:37:04.816552 272194 certs.go:195] generating shared ca certs ...
I1002 20:37:04.816566 272194 certs.go:227] acquiring lock for ca certs: {Name:mkf552d5738eef3436c5e81c3d27f053587b3fba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:37:04.816677 272194 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.key
I1002 20:37:04.816715 272194 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.key
I1002 20:37:04.816729 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I1002 20:37:04.816743 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I1002 20:37:04.816755 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I1002 20:37:04.816771 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I1002 20:37:04.816819 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834.pem (1338 bytes)
W1002 20:37:04.816880 272194 certs.go:480] ignoring /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834_empty.pem, impossibly tiny 0 bytes
I1002 20:37:04.816895 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca-key.pem (1675 bytes)
I1002 20:37:04.816920 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem (1078 bytes)
I1002 20:37:04.816944 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem (1123 bytes)
I1002 20:37:04.816964 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem (1675 bytes)
I1002 20:37:04.817001 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem (1708 bytes)
I1002 20:37:04.817029 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I1002 20:37:04.817046 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834.pem -> /usr/share/ca-certificates/134834.pem
I1002 20:37:04.817055 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem -> /usr/share/ca-certificates/1348342.pem
I1002 20:37:04.817075 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1002 20:37:04.836673 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1002 20:37:04.856152 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1002 20:37:04.875190 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1002 20:37:04.894577 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1002 20:37:04.916836 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834.pem --> /usr/share/ca-certificates/134834.pem (1338 bytes)
I1002 20:37:04.935661 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem --> /usr/share/ca-certificates/1348342.pem (1708 bytes)
I1002 20:37:04.954806 272194 ssh_runner.go:195] Run: openssl version
I1002 20:37:04.961052 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1002 20:37:04.970873 272194 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1002 20:37:04.975095 272194 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 2 20:16 /usr/share/ca-certificates/minikubeCA.pem
I1002 20:37:04.975164 272194 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1002 20:37:05.010397 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1002 20:37:05.020057 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/134834.pem && ln -fs /usr/share/ca-certificates/134834.pem /etc/ssl/certs/134834.pem"
I1002 20:37:05.029403 272194 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/134834.pem
I1002 20:37:05.033731 272194 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 2 20:22 /usr/share/ca-certificates/134834.pem
I1002 20:37:05.033791 272194 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/134834.pem
I1002 20:37:05.068727 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/134834.pem /etc/ssl/certs/51391683.0"
I1002 20:37:05.078201 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1348342.pem && ln -fs /usr/share/ca-certificates/1348342.pem /etc/ssl/certs/1348342.pem"
I1002 20:37:05.088014 272194 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1348342.pem
I1002 20:37:05.092079 272194 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 2 20:22 /usr/share/ca-certificates/1348342.pem
I1002 20:37:05.092133 272194 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1348342.pem
I1002 20:37:05.127081 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1348342.pem /etc/ssl/certs/3ec20f2e.0"
I1002 20:37:05.136690 272194 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1002 20:37:05.140924 272194 certs.go:400] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1002 20:37:05.140979 272194 kubeadm.go:934] updating node {m02 192.168.67.3 8443 v1.34.1 containerd false true} ...
I1002 20:37:05.141079 272194 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=multinode-269236-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.67.3
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1002 20:37:05.141151 272194 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1002 20:37:05.149778 272194 binaries.go:44] Found k8s binaries, skipping transfer
I1002 20:37:05.149926 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system
I1002 20:37:05.158738 272194 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (324 bytes)
I1002 20:37:05.173559 272194 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1002 20:37:05.190764 272194 ssh_runner.go:195] Run: grep 192.168.67.2 control-plane.minikube.internal$ /etc/hosts
I1002 20:37:05.194791 272194 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1002 20:37:05.205730 272194 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 20:37:05.293043 272194 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1002 20:37:05.326437 272194 host.go:66] Checking if "multinode-269236" exists ...
I1002 20:37:05.326745 272194 start.go:317] joinCluster: &{Name:multinode-269236 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true} {Name:m02 IP:192.168.67.3 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:false Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSi
ze:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 20:37:05.326917 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.34.1:$PATH" kubeadm token create --print-join-command --ttl=0"
I1002 20:37:05.326965 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:37:05.347171 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:37:05.499969 272194 start.go:343] trying to join worker node "m02" to cluster: &{Name:m02 IP:192.168.67.3 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:false Worker:true}
I1002 20:37:05.500058 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.34.1:$PATH" kubeadm join control-plane.minikube.internal:8443 --token r8kdl7.22eg59ezgk1lyka2 --discovery-token-ca-cert-hash sha256:19f830e57ecd67343002e647eaa09b4210d8c617f2ab1d39577e16129d93e626 --ignore-preflight-errors=all --cri-socket unix:///run/containerd/containerd.sock --node-name=multinode-269236-m02"
I1002 20:37:06.272049 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "systemctl daemon-reload && systemctl enable kubelet && systemctl start kubelet"
I1002 20:37:06.465092 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes multinode-269236-m02 minikube.k8s.io/updated_at=2025_10_02T20_37_06_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=193cee6aa0f134b5df421bbd88a1ddd3223481a4 minikube.k8s.io/name=multinode-269236 minikube.k8s.io/primary=false
I1002 20:37:06.540432 272194 start.go:319] duration metric: took 1.21368218s to joinCluster
I1002 20:37:06.540513 272194 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.67.3 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:false Worker:true}
I1002 20:37:06.540768 272194 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:37:06.542692 272194 out.go:179] * Verifying Kubernetes components...
I1002 20:37:06.544131 272194 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 20:37:06.634382 272194 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1002 20:37:06.649452 272194 kapi.go:59] client config for multinode-269236: &rest.Config{Host:"https://192.168.67.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt", KeyFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key", CAFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Ne
xtProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2819b80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1002 20:37:06.649746 272194 node_ready.go:35] waiting up to 6m0s for node "multinode-269236-m02" to be "Ready" ...
W1002 20:37:08.653514 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:11.153063 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:13.153533 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:15.652925 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:18.152927 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:20.153432 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:22.153715 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:24.653182 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:27.153382 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:29.153455 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:31.652643 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:33.653199 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:36.152943 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:38.653250 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:41.153768 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:43.652777 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:45.652982 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:48.152769 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
I1002 20:37:48.653138 272194 node_ready.go:49] node "multinode-269236-m02" is "Ready"
I1002 20:37:48.653183 272194 node_ready.go:38] duration metric: took 42.003404514s for node "multinode-269236-m02" to be "Ready" ...
I1002 20:37:48.653206 272194 system_svc.go:44] waiting for kubelet service to be running ....
I1002 20:37:48.653264 272194 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1002 20:37:48.666423 272194 system_svc.go:56] duration metric: took 13.205017ms WaitForService to wait for kubelet
I1002 20:37:48.666451 272194 kubeadm.go:586] duration metric: took 42.125905325s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1002 20:37:48.666479 272194 node_conditions.go:102] verifying NodePressure condition ...
I1002 20:37:48.669083 272194 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1002 20:37:48.669112 272194 node_conditions.go:123] node cpu capacity is 8
I1002 20:37:48.669127 272194 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1002 20:37:48.669133 272194 node_conditions.go:123] node cpu capacity is 8
I1002 20:37:48.669140 272194 node_conditions.go:105] duration metric: took 2.655023ms to run NodePressure ...
I1002 20:37:48.669154 272194 start.go:241] waiting for startup goroutines ...
I1002 20:37:48.669201 272194 start.go:255] writing updated cluster config ...
I1002 20:37:48.669566 272194 ssh_runner.go:195] Run: rm -f paused
I1002 20:37:48.673478 272194 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1002 20:37:48.674002 272194 kapi.go:59] client config for multinode-269236: &rest.Config{Host:"https://192.168.67.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt", KeyFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key", CAFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Ne
xtProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2819b80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1002 20:37:48.677569 272194 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-xvcxn" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:48.682164 272194 pod_ready.go:94] pod "coredns-66bc5c9577-xvcxn" is "Ready"
I1002 20:37:48.682184 272194 pod_ready.go:86] duration metric: took 4.595161ms for pod "coredns-66bc5c9577-xvcxn" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:48.684286 272194 pod_ready.go:83] waiting for pod "etcd-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:48.688334 272194 pod_ready.go:94] pod "etcd-multinode-269236" is "Ready"
I1002 20:37:48.688362 272194 pod_ready.go:86] duration metric: took 4.053116ms for pod "etcd-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:48.690438 272194 pod_ready.go:83] waiting for pod "kube-apiserver-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:48.694501 272194 pod_ready.go:94] pod "kube-apiserver-multinode-269236" is "Ready"
I1002 20:37:48.694524 272194 pod_ready.go:86] duration metric: took 4.060175ms for pod "kube-apiserver-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:48.696614 272194 pod_ready.go:83] waiting for pod "kube-controller-manager-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:48.875047 272194 request.go:683] "Waited before sending request" delay="178.303494ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-multinode-269236"
I1002 20:37:49.075324 272194 request.go:683] "Waited before sending request" delay="197.304499ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/nodes/multinode-269236"
I1002 20:37:49.077995 272194 pod_ready.go:94] pod "kube-controller-manager-multinode-269236" is "Ready"
I1002 20:37:49.078111 272194 pod_ready.go:86] duration metric: took 381.460684ms for pod "kube-controller-manager-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:49.274611 272194 request.go:683] "Waited before sending request" delay="196.334038ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/namespaces/kube-system/pods?labelSelector=k8s-app%3Dkube-proxy"
I1002 20:37:49.277918 272194 pod_ready.go:83] waiting for pod "kube-proxy-kfmt6" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:49.475447 272194 request.go:683] "Waited before sending request" delay="197.406714ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/namespaces/kube-system/pods/kube-proxy-kfmt6"
I1002 20:37:49.674695 272194 request.go:683] "Waited before sending request" delay="196.311501ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/nodes/multinode-269236-m02"
I1002 20:37:49.677680 272194 pod_ready.go:94] pod "kube-proxy-kfmt6" is "Ready"
I1002 20:37:49.677709 272194 pod_ready.go:86] duration metric: took 399.766536ms for pod "kube-proxy-kfmt6" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:49.677717 272194 pod_ready.go:83] waiting for pod "kube-proxy-l9xd2" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:49.875457 272194 request.go:683] "Waited before sending request" delay="197.636489ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/namespaces/kube-system/pods/kube-proxy-l9xd2"
I1002 20:37:50.074811 272194 request.go:683] "Waited before sending request" delay="196.390267ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/nodes/multinode-269236"
I1002 20:37:50.077912 272194 pod_ready.go:94] pod "kube-proxy-l9xd2" is "Ready"
I1002 20:37:50.077943 272194 pod_ready.go:86] duration metric: took 400.219176ms for pod "kube-proxy-l9xd2" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:50.275450 272194 request.go:683] "Waited before sending request" delay="197.374951ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Dkube-scheduler"
I1002 20:37:50.278247 272194 pod_ready.go:83] waiting for pod "kube-scheduler-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:50.474651 272194 request.go:683] "Waited before sending request" delay="196.283204ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-269236"
I1002 20:37:50.674688 272194 request.go:683] "Waited before sending request" delay="197.299723ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/nodes/multinode-269236"
I1002 20:37:50.677486 272194 pod_ready.go:94] pod "kube-scheduler-multinode-269236" is "Ready"
I1002 20:37:50.677517 272194 pod_ready.go:86] duration metric: took 399.245564ms for pod "kube-scheduler-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:50.677533 272194 pod_ready.go:40] duration metric: took 2.004018523s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1002 20:37:50.723919 272194 start.go:623] kubectl: 1.34.1, cluster: 1.34.1 (minor skew: 0)
I1002 20:37:50.725983 272194 out.go:179] * Done! kubectl is now configured to use "multinode-269236" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
6396f60f21d6a 8c811b4aec35f 14 seconds ago Running busybox 0 196afa8ff63b4 busybox-7b57f96db7-gdvtp default
6d15f1c224a06 52546a367cc9e About a minute ago Running coredns 0 daf857d133691 coredns-66bc5c9577-xvcxn kube-system
924ab5d6383aa 6e38f40d628db About a minute ago Running storage-provisioner 0 e958230a98539 storage-provisioner kube-system
c8120c5b18a23 409467f978b4a About a minute ago Running kindnet-cni 0 8bbf2a95da2f4 kindnet-cl6sd kube-system
a557b614982f1 fc25172553d79 About a minute ago Running kube-proxy 0 366296b46ee0c kube-proxy-l9xd2 kube-system
666830b41c276 c80c8dbafe7dd About a minute ago Running kube-controller-manager 0 589dca4df67a1 kube-controller-manager-multinode-269236 kube-system
658eae82e7e3c c3994bc696102 About a minute ago Running kube-apiserver 0 162c2f825d6c2 kube-apiserver-multinode-269236 kube-system
0381a561c5e33 5f1f5298c888d About a minute ago Running etcd 0 8e29d0b79677c etcd-multinode-269236 kube-system
20ee80acc3711 7dd6aaa1717ab About a minute ago Running kube-scheduler 0 07027ef7aeb58 kube-scheduler-multinode-269236 kube-system
==> containerd <==
Oct 02 20:36:55 multinode-269236 containerd[666]: time="2025-10-02T20:36:55.888097619Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:71f400c9-ce64-40d9-a406-14278dfccf89,Namespace:kube-system,Attempt:0,}"
Oct 02 20:36:55 multinode-269236 containerd[666]: time="2025-10-02T20:36:55.890507798Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-66bc5c9577-xvcxn,Uid:17848551-b9d2-4174-98bd-cd9bdb8f86ff,Namespace:kube-system,Attempt:0,}"
Oct 02 20:36:55 multinode-269236 containerd[666]: time="2025-10-02T20:36:55.976834259Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:71f400c9-ce64-40d9-a406-14278dfccf89,Namespace:kube-system,Attempt:0,} returns sandbox id \"e958230a98539de196811cff98497c0c6a56bfd590c04f8daea7f043b5d07ed5\""
Oct 02 20:36:55 multinode-269236 containerd[666]: time="2025-10-02T20:36:55.983063781Z" level=info msg="CreateContainer within sandbox \"e958230a98539de196811cff98497c0c6a56bfd590c04f8daea7f043b5d07ed5\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"
Oct 02 20:36:55 multinode-269236 containerd[666]: time="2025-10-02T20:36:55.996114210Z" level=info msg="CreateContainer within sandbox \"e958230a98539de196811cff98497c0c6a56bfd590c04f8daea7f043b5d07ed5\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"924ab5d6383aaa0390ff7a6fadb5f8e8737062b74e270d36daab8e72aa7691c5\""
Oct 02 20:36:55 multinode-269236 containerd[666]: time="2025-10-02T20:36:55.996837332Z" level=info msg="StartContainer for \"924ab5d6383aaa0390ff7a6fadb5f8e8737062b74e270d36daab8e72aa7691c5\""
Oct 02 20:36:55 multinode-269236 containerd[666]: time="2025-10-02T20:36:55.999883734Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-66bc5c9577-xvcxn,Uid:17848551-b9d2-4174-98bd-cd9bdb8f86ff,Namespace:kube-system,Attempt:0,} returns sandbox id \"daf857d13369108b70e4310f5990bd62d1a799514cb5584257a33f93a13be77b\""
Oct 02 20:36:56 multinode-269236 containerd[666]: time="2025-10-02T20:36:56.005078206Z" level=info msg="CreateContainer within sandbox \"daf857d13369108b70e4310f5990bd62d1a799514cb5584257a33f93a13be77b\" for container &ContainerMetadata{Name:coredns,Attempt:0,}"
Oct 02 20:36:56 multinode-269236 containerd[666]: time="2025-10-02T20:36:56.016599256Z" level=info msg="CreateContainer within sandbox \"daf857d13369108b70e4310f5990bd62d1a799514cb5584257a33f93a13be77b\" for &ContainerMetadata{Name:coredns,Attempt:0,} returns container id \"6d15f1c224a06287d21f8484c36dcb653d5e3de372920e7b903f59fa9d899edb\""
Oct 02 20:36:56 multinode-269236 containerd[666]: time="2025-10-02T20:36:56.017256981Z" level=info msg="StartContainer for \"6d15f1c224a06287d21f8484c36dcb653d5e3de372920e7b903f59fa9d899edb\""
Oct 02 20:36:56 multinode-269236 containerd[666]: time="2025-10-02T20:36:56.054290258Z" level=info msg="StartContainer for \"924ab5d6383aaa0390ff7a6fadb5f8e8737062b74e270d36daab8e72aa7691c5\" returns successfully"
Oct 02 20:36:56 multinode-269236 containerd[666]: time="2025-10-02T20:36:56.085032181Z" level=info msg="StartContainer for \"6d15f1c224a06287d21f8484c36dcb653d5e3de372920e7b903f59fa9d899edb\" returns successfully"
Oct 02 20:37:51 multinode-269236 containerd[666]: time="2025-10-02T20:37:51.741873374Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:busybox-7b57f96db7-gdvtp,Uid:fc393bf7-9718-4290-bc59-ef8cdcec2732,Namespace:default,Attempt:0,}"
Oct 02 20:37:51 multinode-269236 containerd[666]: time="2025-10-02T20:37:51.843772768Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:busybox-7b57f96db7-gdvtp,Uid:fc393bf7-9718-4290-bc59-ef8cdcec2732,Namespace:default,Attempt:0,} returns sandbox id \"196afa8ff63b47bd1b64a3d8b9170cda4d956852abcf33d357f8bd69a49d392d\""
Oct 02 20:37:51 multinode-269236 containerd[666]: time="2025-10-02T20:37:51.846301708Z" level=info msg="PullImage \"gcr.io/k8s-minikube/busybox:1.28\""
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.721570228Z" level=info msg="ImageCreate event name:\"gcr.io/k8s-minikube/busybox:1.28\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.723489176Z" level=info msg="stop pulling image gcr.io/k8s-minikube/busybox:1.28: active requests=0, bytes read=727667"
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.724252006Z" level=info msg="ImageCreate event name:\"sha256:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.725994946Z" level=info msg="ImageCreate event name:\"gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.726507687Z" level=info msg="Pulled image \"gcr.io/k8s-minikube/busybox:1.28\" with image id \"sha256:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a\", repo tag \"gcr.io/k8s-minikube/busybox:1.28\", repo digest \"gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12\", size \"725911\" in 1.88016213s"
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.726543646Z" level=info msg="PullImage \"gcr.io/k8s-minikube/busybox:1.28\" returns image reference \"sha256:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a\""
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.731326209Z" level=info msg="CreateContainer within sandbox \"196afa8ff63b47bd1b64a3d8b9170cda4d956852abcf33d357f8bd69a49d392d\" for container &ContainerMetadata{Name:busybox,Attempt:0,}"
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.740777198Z" level=info msg="CreateContainer within sandbox \"196afa8ff63b47bd1b64a3d8b9170cda4d956852abcf33d357f8bd69a49d392d\" for &ContainerMetadata{Name:busybox,Attempt:0,} returns container id \"6396f60f21d6a4da9130987288da9e08ddc5783f831a13f955dc0f54c01715d8\""
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.741429157Z" level=info msg="StartContainer for \"6396f60f21d6a4da9130987288da9e08ddc5783f831a13f955dc0f54c01715d8\""
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.808076438Z" level=info msg="StartContainer for \"6396f60f21d6a4da9130987288da9e08ddc5783f831a13f955dc0f54c01715d8\" returns successfully"
==> coredns [6d15f1c224a06287d21f8484c36dcb653d5e3de372920e7b903f59fa9d899edb] <==
[INFO] 10.244.0.3:37539 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000113174s
[INFO] 10.244.1.2:35091 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000179637s
[INFO] 10.244.1.2:36611 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000171494s
[INFO] 10.244.1.2:36132 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000130423s
[INFO] 10.244.1.2:41104 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00008954s
[INFO] 10.244.1.2:40002 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000066235s
[INFO] 10.244.1.2:36880 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000140014s
[INFO] 10.244.1.2:49624 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000147513s
[INFO] 10.244.1.2:57768 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00007537s
[INFO] 10.244.0.3:50452 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000161601s
[INFO] 10.244.0.3:50446 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000215003s
[INFO] 10.244.0.3:32806 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000168783s
[INFO] 10.244.0.3:52580 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000080646s
[INFO] 10.244.1.2:36587 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000167276s
[INFO] 10.244.1.2:52916 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000169416s
[INFO] 10.244.1.2:49809 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000234769s
[INFO] 10.244.1.2:42835 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000099958s
[INFO] 10.244.0.3:44728 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000148953s
[INFO] 10.244.0.3:58315 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000120128s
[INFO] 10.244.0.3:34957 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.00009717s
[INFO] 10.244.0.3:34384 - 5 "PTR IN 1.67.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000147133s
[INFO] 10.244.1.2:33298 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000182913s
[INFO] 10.244.1.2:46091 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000113894s
[INFO] 10.244.1.2:59526 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000109444s
[INFO] 10.244.1.2:48716 - 5 "PTR IN 1.67.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000082952s
==> describe nodes <==
Name: multinode-269236
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-269236
kubernetes.io/os=linux
minikube.k8s.io/commit=193cee6aa0f134b5df421bbd88a1ddd3223481a4
minikube.k8s.io/name=multinode-269236
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_10_02T20_36_40_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 02 Oct 2025 20:36:36 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: multinode-269236
AcquireTime: <unset>
RenewTime: Thu, 02 Oct 2025 20:38:01 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 02 Oct 2025 20:36:55 +0000 Thu, 02 Oct 2025 20:36:36 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 02 Oct 2025 20:36:55 +0000 Thu, 02 Oct 2025 20:36:36 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 02 Oct 2025 20:36:55 +0000 Thu, 02 Oct 2025 20:36:36 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 02 Oct 2025 20:36:55 +0000 Thu, 02 Oct 2025 20:36:55 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.67.2
Hostname: multinode-269236
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863452Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863452Ki
pods: 110
System Info:
Machine ID: 799e9b934aec4d26b4ea01f5e06a0cb6
System UUID: d92e25b4-a3c1-44ef-ab82-b736d3f12369
Boot ID: f7e88a84-8870-4a38-a6c2-e18741e6e9d3
Kernel Version: 6.8.0-1041-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: containerd://1.7.28
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-7b57f96db7-gdvtp 0 (0%) 0 (0%) 0 (0%) 0 (0%) 17s
kube-system coredns-66bc5c9577-xvcxn 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 84s
kube-system etcd-multinode-269236 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 89s
kube-system kindnet-cl6sd 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 84s
kube-system kube-apiserver-multinode-269236 250m (3%) 0 (0%) 0 (0%) 0 (0%) 89s
kube-system kube-controller-manager-multinode-269236 200m (2%) 0 (0%) 0 (0%) 0 (0%) 89s
kube-system kube-proxy-l9xd2 0 (0%) 0 (0%) 0 (0%) 0 (0%) 84s
kube-system kube-scheduler-multinode-269236 100m (1%) 0 (0%) 0 (0%) 0 (0%) 89s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 83s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 83s kube-proxy
Normal Starting 89s kubelet Starting kubelet.
Normal NodeAllocatableEnforced 89s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 89s kubelet Node multinode-269236 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 89s kubelet Node multinode-269236 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 89s kubelet Node multinode-269236 status is now: NodeHasSufficientPID
Normal RegisteredNode 85s node-controller Node multinode-269236 event: Registered Node multinode-269236 in Controller
Normal NodeReady 73s kubelet Node multinode-269236 status is now: NodeReady
Name: multinode-269236-m02
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-269236-m02
kubernetes.io/os=linux
minikube.k8s.io/commit=193cee6aa0f134b5df421bbd88a1ddd3223481a4
minikube.k8s.io/name=multinode-269236
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2025_10_02T20_37_06_0700
minikube.k8s.io/version=v1.37.0
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 02 Oct 2025 20:37:06 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: multinode-269236-m02
AcquireTime: <unset>
RenewTime: Thu, 02 Oct 2025 20:38:07 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:37:06 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:37:06 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:37:06 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:37:48 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.67.3
Hostname: multinode-269236-m02
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863452Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863452Ki
pods: 110
System Info:
Machine ID: 3c0b6853b4834a24ac1ce03475aeceab
System UUID: 3dc3ee28-c84f-4d07-9abf-b7492ad449a3
Boot ID: f7e88a84-8870-4a38-a6c2-e18741e6e9d3
Kernel Version: 6.8.0-1041-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: containerd://1.7.28
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.1.0/24
PodCIDRs: 10.244.1.0/24
Non-terminated Pods: (3 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-7b57f96db7-gnp5h 0 (0%) 0 (0%) 0 (0%) 0 (0%) 17s
kube-system kindnet-8l5tn 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 62s
kube-system kube-proxy-kfmt6 0 (0%) 0 (0%) 0 (0%) 0 (0%) 62s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (1%) 100m (1%)
memory 50Mi (0%) 50Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 60s kube-proxy
Normal NodeHasSufficientMemory 62s (x3 over 62s) kubelet Node multinode-269236-m02 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 62s (x3 over 62s) kubelet Node multinode-269236-m02 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 62s (x3 over 62s) kubelet Node multinode-269236-m02 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 62s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 60s node-controller Node multinode-269236-m02 event: Registered Node multinode-269236-m02 in Controller
Normal NodeReady 20s kubelet Node multinode-269236-m02 status is now: NodeReady
Name: multinode-269236-m03
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-269236-m03
kubernetes.io/os=linux
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 02 Oct 2025 20:38:07 +0000
Taints: node.kubernetes.io/not-ready:NoExecute
node.kubernetes.io/not-ready:NoSchedule
Unschedulable: false
Lease: Failed to get lease: leases.coordination.k8s.io "multinode-269236-m03" not found
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:38:07 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:38:07 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:38:07 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready False Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:38:07 +0000 KubeletNotReady [container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized, CSINode is not yet initialized]
Addresses:
InternalIP: 192.168.67.4
Hostname: multinode-269236-m03
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863452Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863452Ki
pods: 110
System Info:
Machine ID: ee0d188506574878b4f34d0752128355
System UUID: c053c45d-c63b-4b01-be39-74bc97b5aa89
Boot ID: f7e88a84-8870-4a38-a6c2-e18741e6e9d3
Kernel Version: 6.8.0-1041-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: containerd://1.7.28
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.2.0/24
PodCIDRs: 10.244.2.0/24
Non-terminated Pods: (2 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system kindnet-ch4bx 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 1s
kube-system kube-proxy-hwwrq 0 (0%) 0 (0%) 0 (0%) 0 (0%) 1s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (1%) 100m (1%)
memory 50Mi (0%) 50Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 1s (x3 over 1s) kubelet Node multinode-269236-m03 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 1s (x3 over 1s) kubelet Node multinode-269236-m03 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 1s (x3 over 1s) kubelet Node multinode-269236-m03 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 1s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 0s node-controller Node multinode-269236-m03 event: Registered Node multinode-269236-m03 in Controller
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 0e d3 32 fb 39 1d 08 06
[Oct 2 20:05] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000010] ll header: 00000000: ff ff ff ff ff ff a2 2f 04 c3 10 a5 08 06
[ +0.840382] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff ce b9 ee d2 9f fc 08 06
[ +0.040405] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 8a b8 47 01 75 cc 08 06
[ +4.475907] IPv4: martian source 10.244.0.1 from 10.244.0.5, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff 76 3e b5 43 48 61 08 06
[ +31.475518] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 7e 86 e5 88 af a8 08 06
[ +1.070870] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000010] ll header: 00000000: ff ff ff ff ff ff 5e 08 fe e7 a5 fd 08 06
[ +0.038925] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 42 67 d2 88 24 fd 08 06
[ +6.407336] IPv4: martian source 10.244.0.1 from 10.244.0.5, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 9a 23 a1 2a 3e 5c 08 06
[Oct 2 20:06] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 66 b9 ba 13 eb d5 08 06
[ +1.238739] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff ae 03 dc c0 5f 73 08 06
[ +0.037592] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 22 75 f5 ad 12 6d 08 06
[ +6.200456] IPv4: martian source 10.244.0.1 from 10.244.0.5, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 22 27 a4 60 11 6b 08 06
==> etcd [0381a561c5e33e07c56cbe9ff0c579f4575441a89cbf109fd541377aed8ba28e] <==
{"level":"warn","ts":"2025-10-02T20:36:36.052109Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54162","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.058811Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54170","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.073723Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54178","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.079238Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54198","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.085633Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54206","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.092104Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54230","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.098956Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54244","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.105280Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54264","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.111508Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54282","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.118871Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54304","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.126978Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54340","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.133482Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54352","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.139900Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54372","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.146979Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54392","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.154103Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54410","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.160880Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54420","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.169185Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54432","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.175818Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54452","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.183507Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54472","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.190911Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54484","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.206226Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54498","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.216704Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54516","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.223429Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54548","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.230756Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54574","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.283021Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54600","server-name":"","error":"EOF"}
==> kernel <==
20:38:08 up 1:20, 0 user, load average: 0.97, 1.47, 1.66
Linux multinode-269236 6.8.0-1041-gcp #43~22.04.1-Ubuntu SMP Wed Sep 24 23:11:19 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [c8120c5b18a2319c0b0ee8e61910a9beb89732853ea37a1a75d286a4b53d8c10] <==
I1002 20:37:15.523910 1 main.go:297] Handling node with IPs: map[192.168.67.2:{}]
I1002 20:37:15.523977 1 main.go:301] handling current node
I1002 20:37:15.523994 1 main.go:297] Handling node with IPs: map[192.168.67.3:{}]
I1002 20:37:15.523999 1 main.go:324] Node multinode-269236-m02 has CIDR [10.244.1.0/24]
I1002 20:37:15.524240 1 routes.go:62] Adding route {Ifindex: 0 Dst: 10.244.1.0/24 Src: <nil> Gw: 192.168.67.3 Flags: [] Table: 0 Realm: 0}
I1002 20:37:25.526972 1 main.go:297] Handling node with IPs: map[192.168.67.2:{}]
I1002 20:37:25.527019 1 main.go:301] handling current node
I1002 20:37:25.527034 1 main.go:297] Handling node with IPs: map[192.168.67.3:{}]
I1002 20:37:25.527039 1 main.go:324] Node multinode-269236-m02 has CIDR [10.244.1.0/24]
I1002 20:37:35.524878 1 main.go:297] Handling node with IPs: map[192.168.67.2:{}]
I1002 20:37:35.524916 1 main.go:301] handling current node
I1002 20:37:35.524933 1 main.go:297] Handling node with IPs: map[192.168.67.3:{}]
I1002 20:37:35.524938 1 main.go:324] Node multinode-269236-m02 has CIDR [10.244.1.0/24]
I1002 20:37:45.519691 1 main.go:297] Handling node with IPs: map[192.168.67.3:{}]
I1002 20:37:45.519725 1 main.go:324] Node multinode-269236-m02 has CIDR [10.244.1.0/24]
I1002 20:37:45.520041 1 main.go:297] Handling node with IPs: map[192.168.67.2:{}]
I1002 20:37:45.520058 1 main.go:301] handling current node
I1002 20:37:55.520129 1 main.go:297] Handling node with IPs: map[192.168.67.2:{}]
I1002 20:37:55.520172 1 main.go:301] handling current node
I1002 20:37:55.520188 1 main.go:297] Handling node with IPs: map[192.168.67.3:{}]
I1002 20:37:55.520194 1 main.go:324] Node multinode-269236-m02 has CIDR [10.244.1.0/24]
I1002 20:38:05.527984 1 main.go:297] Handling node with IPs: map[192.168.67.2:{}]
I1002 20:38:05.528033 1 main.go:301] handling current node
I1002 20:38:05.528052 1 main.go:297] Handling node with IPs: map[192.168.67.3:{}]
I1002 20:38:05.528059 1 main.go:324] Node multinode-269236-m02 has CIDR [10.244.1.0/24]
==> kube-apiserver [658eae82e7e3c7c7f205546a056183dcb822ac509c3b70b8e973ff5b87980588] <==
I1002 20:36:38.221778 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1002 20:36:38.264669 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1002 20:36:38.386572 1 alloc.go:328] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W1002 20:36:38.393385 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.67.2]
I1002 20:36:38.394577 1 controller.go:667] quota admission added evaluator for: endpoints
I1002 20:36:38.399262 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1002 20:36:38.501401 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1002 20:36:39.517404 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1002 20:36:39.527966 1 alloc.go:328] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I1002 20:36:39.537096 1 controller.go:667] quota admission added evaluator for: daemonsets.apps
I1002 20:36:44.252812 1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
I1002 20:36:44.252812 1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
I1002 20:36:44.355007 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1002 20:36:44.360401 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1002 20:36:44.504569 1 controller.go:667] quota admission added evaluator for: replicasets.apps
E1002 20:37:55.037432 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60126: use of closed network connection
E1002 20:37:55.199643 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60150: use of closed network connection
E1002 20:37:55.460619 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60166: use of closed network connection
E1002 20:37:55.622348 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60192: use of closed network connection
E1002 20:37:55.785492 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60210: use of closed network connection
E1002 20:37:55.953596 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60232: use of closed network connection
E1002 20:37:56.245372 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60268: use of closed network connection
E1002 20:37:56.409334 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60288: use of closed network connection
E1002 20:37:56.566087 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60314: use of closed network connection
E1002 20:37:56.722517 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60340: use of closed network connection
==> kube-controller-manager [666830b41c276801283a9dd06fa8a57008245e531d503287030fb547655da526] <==
I1002 20:36:43.501268 1 shared_informer.go:356] "Caches are synced" controller="attach detach"
I1002 20:36:43.501362 1 shared_informer.go:356] "Caches are synced" controller="deployment"
I1002 20:36:43.501574 1 shared_informer.go:356] "Caches are synced" controller="GC"
I1002 20:36:43.502599 1 shared_informer.go:356] "Caches are synced" controller="PV protection"
I1002 20:36:43.504813 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1002 20:36:43.505051 1 shared_informer.go:356] "Caches are synced" controller="TTL"
I1002 20:36:43.506146 1 shared_informer.go:356] "Caches are synced" controller="namespace"
I1002 20:36:43.506163 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1002 20:36:43.508438 1 shared_informer.go:356] "Caches are synced" controller="node"
I1002 20:36:43.508501 1 range_allocator.go:177] "Sending events to api server" logger="node-ipam-controller"
I1002 20:36:43.508539 1 range_allocator.go:183] "Starting range CIDR allocator" logger="node-ipam-controller"
I1002 20:36:43.508549 1 shared_informer.go:349] "Waiting for caches to sync" controller="cidrallocator"
I1002 20:36:43.508556 1 shared_informer.go:356] "Caches are synced" controller="cidrallocator"
I1002 20:36:43.514786 1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
I1002 20:36:43.516153 1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="multinode-269236" podCIDRs=["10.244.0.0/24"]
I1002 20:36:43.522185 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1002 20:36:58.452837 1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
I1002 20:37:06.200600 1 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"multinode-269236-m02\" does not exist"
I1002 20:37:06.208547 1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="multinode-269236-m02" podCIDRs=["10.244.1.0/24"]
I1002 20:37:08.454350 1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="multinode-269236-m02"
I1002 20:37:48.301268 1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="multinode-269236-m02"
I1002 20:38:07.625171 1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="multinode-269236-m02"
I1002 20:38:07.625348 1 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"multinode-269236-m03\" does not exist"
I1002 20:38:07.631188 1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="multinode-269236-m03" podCIDRs=["10.244.2.0/24"]
I1002 20:38:08.471000 1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="multinode-269236-m03"
==> kube-proxy [a557b614982f18135f82f0cabc2740780c4834191a616b89da60ed5aad9a5532] <==
I1002 20:36:44.914145 1 server_linux.go:53] "Using iptables proxy"
I1002 20:36:44.971356 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1002 20:36:45.072471 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1002 20:36:45.072510 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.67.2"]
E1002 20:36:45.072625 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1002 20:36:45.130067 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1002 20:36:45.130127 1 server_linux.go:132] "Using iptables Proxier"
I1002 20:36:45.137132 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1002 20:36:45.137534 1 server.go:527] "Version info" version="v1.34.1"
I1002 20:36:45.137561 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1002 20:36:45.139178 1 config.go:403] "Starting serviceCIDR config controller"
I1002 20:36:45.139204 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1002 20:36:45.139204 1 config.go:200] "Starting service config controller"
I1002 20:36:45.139232 1 config.go:106] "Starting endpoint slice config controller"
I1002 20:36:45.139239 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1002 20:36:45.139231 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1002 20:36:45.139307 1 config.go:309] "Starting node config controller"
I1002 20:36:45.139323 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1002 20:36:45.139330 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1002 20:36:45.240237 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
I1002 20:36:45.240284 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1002 20:36:45.240260 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
==> kube-scheduler [20ee80acc3711db9dc4223a2310020d7c3e1cc7f2ad8af54be18847fb92aab78] <==
E1002 20:36:36.970806 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
E1002 20:36:36.972330 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
E1002 20:36:36.972730 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1002 20:36:36.972437 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1002 20:36:36.972537 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
E1002 20:36:36.972537 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1002 20:36:36.972621 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1002 20:36:36.972749 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1002 20:36:36.972370 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1002 20:36:36.973182 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
E1002 20:36:36.973372 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1002 20:36:36.973375 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
E1002 20:36:36.973382 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
E1002 20:36:36.972794 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1002 20:36:36.973471 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1002 20:36:36.973558 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1002 20:36:36.973610 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1002 20:36:36.973627 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1002 20:36:36.974620 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1002 20:36:37.844267 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1002 20:36:37.925661 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1002 20:36:37.954083 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1002 20:36:37.990939 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1002 20:36:38.033178 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
I1002 20:36:38.469562 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Oct 02 20:36:40 multinode-269236 kubelet[1480]: I1002 20:36:40.426388 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/etcd-multinode-269236" podStartSLOduration=1.426363028 podStartE2EDuration="1.426363028s" podCreationTimestamp="2025-10-02 20:36:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:40.414976883 +0000 UTC m=+1.145003855" watchObservedRunningTime="2025-10-02 20:36:40.426363028 +0000 UTC m=+1.156389998"
Oct 02 20:36:40 multinode-269236 kubelet[1480]: I1002 20:36:40.438644 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-multinode-269236" podStartSLOduration=1.438620727 podStartE2EDuration="1.438620727s" podCreationTimestamp="2025-10-02 20:36:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:40.426642034 +0000 UTC m=+1.156668985" watchObservedRunningTime="2025-10-02 20:36:40.438620727 +0000 UTC m=+1.168647699"
Oct 02 20:36:40 multinode-269236 kubelet[1480]: I1002 20:36:40.450079 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-controller-manager-multinode-269236" podStartSLOduration=1.4500503710000001 podStartE2EDuration="1.450050371s" podCreationTimestamp="2025-10-02 20:36:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:40.43880745 +0000 UTC m=+1.168834413" watchObservedRunningTime="2025-10-02 20:36:40.450050371 +0000 UTC m=+1.180077359"
Oct 02 20:36:40 multinode-269236 kubelet[1480]: I1002 20:36:40.461229 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-scheduler-multinode-269236" podStartSLOduration=1.461207074 podStartE2EDuration="1.461207074s" podCreationTimestamp="2025-10-02 20:36:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:40.450049223 +0000 UTC m=+1.180076195" watchObservedRunningTime="2025-10-02 20:36:40.461207074 +0000 UTC m=+1.191234046"
Oct 02 20:36:43 multinode-269236 kubelet[1480]: I1002 20:36:43.593347 1480 kuberuntime_manager.go:1828] "Updating runtime config through cri with podcidr" CIDR="10.244.0.0/24"
Oct 02 20:36:43 multinode-269236 kubelet[1480]: I1002 20:36:43.594190 1480 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.244.0.0/24"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367333 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51358b09-1a79-4e64-a9cd-7443684e1d86-lib-modules\") pod \"kindnet-cl6sd\" (UID: \"51358b09-1a79-4e64-a9cd-7443684e1d86\") " pod="kube-system/kindnet-cl6sd"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367378 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/a483457a-ffba-4887-9245-9655e230e47f-kube-proxy\") pod \"kube-proxy-l9xd2\" (UID: \"a483457a-ffba-4887-9245-9655e230e47f\") " pod="kube-system/kube-proxy-l9xd2"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367392 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/a483457a-ffba-4887-9245-9655e230e47f-xtables-lock\") pod \"kube-proxy-l9xd2\" (UID: \"a483457a-ffba-4887-9245-9655e230e47f\") " pod="kube-system/kube-proxy-l9xd2"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367413 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a483457a-ffba-4887-9245-9655e230e47f-lib-modules\") pod \"kube-proxy-l9xd2\" (UID: \"a483457a-ffba-4887-9245-9655e230e47f\") " pod="kube-system/kube-proxy-l9xd2"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367487 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jcrf\" (UniqueName: \"kubernetes.io/projected/51358b09-1a79-4e64-a9cd-7443684e1d86-kube-api-access-5jcrf\") pod \"kindnet-cl6sd\" (UID: \"51358b09-1a79-4e64-a9cd-7443684e1d86\") " pod="kube-system/kindnet-cl6sd"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367545 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smqw4\" (UniqueName: \"kubernetes.io/projected/a483457a-ffba-4887-9245-9655e230e47f-kube-api-access-smqw4\") pod \"kube-proxy-l9xd2\" (UID: \"a483457a-ffba-4887-9245-9655e230e47f\") " pod="kube-system/kube-proxy-l9xd2"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367568 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/51358b09-1a79-4e64-a9cd-7443684e1d86-cni-cfg\") pod \"kindnet-cl6sd\" (UID: \"51358b09-1a79-4e64-a9cd-7443684e1d86\") " pod="kube-system/kindnet-cl6sd"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367590 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/51358b09-1a79-4e64-a9cd-7443684e1d86-xtables-lock\") pod \"kindnet-cl6sd\" (UID: \"51358b09-1a79-4e64-a9cd-7443684e1d86\") " pod="kube-system/kindnet-cl6sd"
Oct 02 20:36:45 multinode-269236 kubelet[1480]: I1002 20:36:45.393671 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-proxy-l9xd2" podStartSLOduration=1.39365152 podStartE2EDuration="1.39365152s" podCreationTimestamp="2025-10-02 20:36:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:45.393444617 +0000 UTC m=+6.123471589" watchObservedRunningTime="2025-10-02 20:36:45.39365152 +0000 UTC m=+6.123678492"
Oct 02 20:36:46 multinode-269236 kubelet[1480]: I1002 20:36:46.141502 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kindnet-cl6sd" podStartSLOduration=2.141464268 podStartE2EDuration="2.141464268s" podCreationTimestamp="2025-10-02 20:36:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:45.40537739 +0000 UTC m=+6.135404362" watchObservedRunningTime="2025-10-02 20:36:46.141464268 +0000 UTC m=+6.871491240"
Oct 02 20:36:55 multinode-269236 kubelet[1480]: I1002 20:36:55.554398 1480 kubelet_node_status.go:439] "Fast updating node status as it just became ready"
Oct 02 20:36:55 multinode-269236 kubelet[1480]: I1002 20:36:55.649481 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htnv9\" (UniqueName: \"kubernetes.io/projected/17848551-b9d2-4174-98bd-cd9bdb8f86ff-kube-api-access-htnv9\") pod \"coredns-66bc5c9577-xvcxn\" (UID: \"17848551-b9d2-4174-98bd-cd9bdb8f86ff\") " pod="kube-system/coredns-66bc5c9577-xvcxn"
Oct 02 20:36:55 multinode-269236 kubelet[1480]: I1002 20:36:55.649597 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/71f400c9-ce64-40d9-a406-14278dfccf89-tmp\") pod \"storage-provisioner\" (UID: \"71f400c9-ce64-40d9-a406-14278dfccf89\") " pod="kube-system/storage-provisioner"
Oct 02 20:36:55 multinode-269236 kubelet[1480]: I1002 20:36:55.649644 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg44j\" (UniqueName: \"kubernetes.io/projected/71f400c9-ce64-40d9-a406-14278dfccf89-kube-api-access-sg44j\") pod \"storage-provisioner\" (UID: \"71f400c9-ce64-40d9-a406-14278dfccf89\") " pod="kube-system/storage-provisioner"
Oct 02 20:36:55 multinode-269236 kubelet[1480]: I1002 20:36:55.649671 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/17848551-b9d2-4174-98bd-cd9bdb8f86ff-config-volume\") pod \"coredns-66bc5c9577-xvcxn\" (UID: \"17848551-b9d2-4174-98bd-cd9bdb8f86ff\") " pod="kube-system/coredns-66bc5c9577-xvcxn"
Oct 02 20:36:56 multinode-269236 kubelet[1480]: I1002 20:36:56.416822 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/coredns-66bc5c9577-xvcxn" podStartSLOduration=12.416798437 podStartE2EDuration="12.416798437s" podCreationTimestamp="2025-10-02 20:36:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:56.416556401 +0000 UTC m=+17.146583387" watchObservedRunningTime="2025-10-02 20:36:56.416798437 +0000 UTC m=+17.146825408"
Oct 02 20:36:56 multinode-269236 kubelet[1480]: I1002 20:36:56.427129 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/storage-provisioner" podStartSLOduration=11.427110714 podStartE2EDuration="11.427110714s" podCreationTimestamp="2025-10-02 20:36:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:56.427012204 +0000 UTC m=+17.157039175" watchObservedRunningTime="2025-10-02 20:36:56.427110714 +0000 UTC m=+17.157137719"
Oct 02 20:37:51 multinode-269236 kubelet[1480]: I1002 20:37:51.522291 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb76h\" (UniqueName: \"kubernetes.io/projected/fc393bf7-9718-4290-bc59-ef8cdcec2732-kube-api-access-cb76h\") pod \"busybox-7b57f96db7-gdvtp\" (UID: \"fc393bf7-9718-4290-bc59-ef8cdcec2732\") " pod="default/busybox-7b57f96db7-gdvtp"
Oct 02 20:37:54 multinode-269236 kubelet[1480]: I1002 20:37:54.545054 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/busybox-7b57f96db7-gdvtp" podStartSLOduration=1.663298212 podStartE2EDuration="3.545028859s" podCreationTimestamp="2025-10-02 20:37:51 +0000 UTC" firstStartedPulling="2025-10-02 20:37:51.845745633 +0000 UTC m=+72.575772596" lastFinishedPulling="2025-10-02 20:37:53.727476288 +0000 UTC m=+74.457503243" observedRunningTime="2025-10-02 20:37:54.544993451 +0000 UTC m=+75.275020423" watchObservedRunningTime="2025-10-02 20:37:54.545028859 +0000 UTC m=+75.275055833"
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p multinode-269236 -n multinode-269236
helpers_test.go:269: (dbg) Run: kubectl --context multinode-269236 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:280: non-running pods: kindnet-ch4bx kube-proxy-hwwrq
helpers_test.go:282: ======> post-mortem[TestMultiNode/serial/AddNode]: describe non-running pods <======
helpers_test.go:285: (dbg) Run: kubectl --context multinode-269236 describe pod kindnet-ch4bx kube-proxy-hwwrq
helpers_test.go:285: (dbg) Non-zero exit: kubectl --context multinode-269236 describe pod kindnet-ch4bx kube-proxy-hwwrq: exit status 1 (62.267137ms)
** stderr **
Error from server (NotFound): pods "kindnet-ch4bx" not found
Error from server (NotFound): pods "kube-proxy-hwwrq" not found
** /stderr **
helpers_test.go:287: kubectl --context multinode-269236 describe pod kindnet-ch4bx kube-proxy-hwwrq: exit status 1
--- FAIL: TestMultiNode/serial/AddNode (12.72s)
=== RUN TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run: kubectl --context multinode-269236 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
multinode_test.go:239: expected to have label "minikube.k8s.io/commit" in node labels but got :
-- stdout --
[{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-269236","kubernetes.io/os":"linux","minikube.k8s.io/commit":"193cee6aa0f134b5df421bbd88a1ddd3223481a4","minikube.k8s.io/name":"multinode-269236","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2025_10_02T20_36_40_0700","minikube.k8s.io/version":"v1.37.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-269236-m02","kubernetes.io/os":"linux","minikube.k8s.io/commit":"193cee6aa0f134b5df421bbd88a1ddd3223481a4","minikube.k8s.io/name":"multinode-269236","minikube.k8s.io/primary":"false","minikube.k8s.io/updated_at":"2025_10_02T20_37_06_0700","minikube.k8s.io/version":"v1.37.0"},{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","ku
bernetes.io/hostname":"multinode-269236-m03","kubernetes.io/os":"linux"},]
-- /stdout --
multinode_test.go:239: expected to have label "minikube.k8s.io/version" in node labels but got :
-- stdout --
[{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-269236","kubernetes.io/os":"linux","minikube.k8s.io/commit":"193cee6aa0f134b5df421bbd88a1ddd3223481a4","minikube.k8s.io/name":"multinode-269236","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2025_10_02T20_36_40_0700","minikube.k8s.io/version":"v1.37.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-269236-m02","kubernetes.io/os":"linux","minikube.k8s.io/commit":"193cee6aa0f134b5df421bbd88a1ddd3223481a4","minikube.k8s.io/name":"multinode-269236","minikube.k8s.io/primary":"false","minikube.k8s.io/updated_at":"2025_10_02T20_37_06_0700","minikube.k8s.io/version":"v1.37.0"},{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","ku
bernetes.io/hostname":"multinode-269236-m03","kubernetes.io/os":"linux"},]
-- /stdout --
multinode_test.go:239: expected to have label "minikube.k8s.io/updated_at" in node labels but got :
-- stdout --
[{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-269236","kubernetes.io/os":"linux","minikube.k8s.io/commit":"193cee6aa0f134b5df421bbd88a1ddd3223481a4","minikube.k8s.io/name":"multinode-269236","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2025_10_02T20_36_40_0700","minikube.k8s.io/version":"v1.37.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-269236-m02","kubernetes.io/os":"linux","minikube.k8s.io/commit":"193cee6aa0f134b5df421bbd88a1ddd3223481a4","minikube.k8s.io/name":"multinode-269236","minikube.k8s.io/primary":"false","minikube.k8s.io/updated_at":"2025_10_02T20_37_06_0700","minikube.k8s.io/version":"v1.37.0"},{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","ku
bernetes.io/hostname":"multinode-269236-m03","kubernetes.io/os":"linux"},]
-- /stdout --
multinode_test.go:239: expected to have label "minikube.k8s.io/name" in node labels but got :
-- stdout --
[{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-269236","kubernetes.io/os":"linux","minikube.k8s.io/commit":"193cee6aa0f134b5df421bbd88a1ddd3223481a4","minikube.k8s.io/name":"multinode-269236","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2025_10_02T20_36_40_0700","minikube.k8s.io/version":"v1.37.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-269236-m02","kubernetes.io/os":"linux","minikube.k8s.io/commit":"193cee6aa0f134b5df421bbd88a1ddd3223481a4","minikube.k8s.io/name":"multinode-269236","minikube.k8s.io/primary":"false","minikube.k8s.io/updated_at":"2025_10_02T20_37_06_0700","minikube.k8s.io/version":"v1.37.0"},{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","ku
bernetes.io/hostname":"multinode-269236-m03","kubernetes.io/os":"linux"},]
-- /stdout --
multinode_test.go:239: expected to have label "minikube.k8s.io/primary" in node labels but got :
-- stdout --
[{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-269236","kubernetes.io/os":"linux","minikube.k8s.io/commit":"193cee6aa0f134b5df421bbd88a1ddd3223481a4","minikube.k8s.io/name":"multinode-269236","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2025_10_02T20_36_40_0700","minikube.k8s.io/version":"v1.37.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-269236-m02","kubernetes.io/os":"linux","minikube.k8s.io/commit":"193cee6aa0f134b5df421bbd88a1ddd3223481a4","minikube.k8s.io/name":"multinode-269236","minikube.k8s.io/primary":"false","minikube.k8s.io/updated_at":"2025_10_02T20_37_06_0700","minikube.k8s.io/version":"v1.37.0"},{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","ku
bernetes.io/hostname":"multinode-269236-m03","kubernetes.io/os":"linux"},]
-- /stdout --
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestMultiNode/serial/MultiNodeLabels]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestMultiNode/serial/MultiNodeLabels]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect multinode-269236
helpers_test.go:243: (dbg) docker inspect multinode-269236:
-- stdout --
[
{
"Id": "130042a04538db69d4538c33a14553aa5ad7aaadb6f55bb55d74380abaea3a03",
"Created": "2025-10-02T20:36:24.954754964Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 272754,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-10-02T20:36:24.990539461Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:1924ef027790684c42575d5cb3baf0720024642d9b38e3c15ae6ecb285884400",
"ResolvConfPath": "/var/lib/docker/containers/130042a04538db69d4538c33a14553aa5ad7aaadb6f55bb55d74380abaea3a03/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/130042a04538db69d4538c33a14553aa5ad7aaadb6f55bb55d74380abaea3a03/hostname",
"HostsPath": "/var/lib/docker/containers/130042a04538db69d4538c33a14553aa5ad7aaadb6f55bb55d74380abaea3a03/hosts",
"LogPath": "/var/lib/docker/containers/130042a04538db69d4538c33a14553aa5ad7aaadb6f55bb55d74380abaea3a03/130042a04538db69d4538c33a14553aa5ad7aaadb6f55bb55d74380abaea3a03-json.log",
"Name": "/multinode-269236",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"multinode-269236:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "multinode-269236",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "private",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": null,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "130042a04538db69d4538c33a14553aa5ad7aaadb6f55bb55d74380abaea3a03",
"LowerDir": "/var/lib/docker/overlay2/81afa5b5c00ee862e3073fde08d0444fd1c1de713245203e43723de63ce7be06-init/diff:/var/lib/docker/overlay2/23e9879d70fa6c0a6477b7de456e5e45b1a628fded9b8ef848ad2bf9b29ea71c/diff",
"MergedDir": "/var/lib/docker/overlay2/81afa5b5c00ee862e3073fde08d0444fd1c1de713245203e43723de63ce7be06/merged",
"UpperDir": "/var/lib/docker/overlay2/81afa5b5c00ee862e3073fde08d0444fd1c1de713245203e43723de63ce7be06/diff",
"WorkDir": "/var/lib/docker/overlay2/81afa5b5c00ee862e3073fde08d0444fd1c1de713245203e43723de63ce7be06/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "multinode-269236",
"Source": "/var/lib/docker/volumes/multinode-269236/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "multinode-269236",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "multinode-269236",
"name.minikube.sigs.k8s.io": "multinode-269236",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "21cd3c44d93d83d477eaa8381ea8d622fdd7769b597937d3309780047e15014a",
"SandboxKey": "/var/run/docker/netns/21cd3c44d93d",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33029"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33030"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33033"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33031"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33032"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"multinode-269236": {
"IPAMConfig": {
"IPv4Address": "192.168.67.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:23:f7:94:b4:4d",
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "d35efc5604560c1b4e74e1f364ac1201a22c9def6564fcf8a74e1e4d295905fe",
"EndpointID": "6e9de53f5860c188319ddb8dbd4830c3f7a2d0fe31b82f6d7ae8e0f572ba1186",
"Gateway": "192.168.67.1",
"IPAddress": "192.168.67.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"multinode-269236",
"130042a04538"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p multinode-269236 -n multinode-269236
helpers_test.go:252: <<< TestMultiNode/serial/MultiNodeLabels FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestMultiNode/serial/MultiNodeLabels]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p multinode-269236 logs -n 25: (1.010104126s)
helpers_test.go:260: TestMultiNode/serial/MultiNodeLabels logs:
-- stdout --
==> Audit <==
┌─────────┬────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ ssh │ mount-start-2-205791 ssh -- ls /minikube-host │ mount-start-2-205791 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ delete │ -p mount-start-1-188752 --alsologtostderr -v=5 │ mount-start-1-188752 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ ssh │ mount-start-2-205791 ssh -- ls /minikube-host │ mount-start-2-205791 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ stop │ -p mount-start-2-205791 │ mount-start-2-205791 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ start │ -p mount-start-2-205791 │ mount-start-2-205791 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ ssh │ mount-start-2-205791 ssh -- ls /minikube-host │ mount-start-2-205791 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ delete │ -p mount-start-2-205791 │ mount-start-2-205791 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ delete │ -p mount-start-1-188752 │ mount-start-1-188752 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:36 UTC │
│ start │ -p multinode-269236 --wait=true --memory=3072 --nodes=2 -v=5 --alsologtostderr --driver=docker --container-runtime=containerd │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:36 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- rollout status deployment/busybox │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- get pods -o jsonpath='{.items[*].status.podIP}' │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- get pods -o jsonpath='{.items[*].metadata.name}' │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gdvtp -- nslookup kubernetes.io │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gnp5h -- nslookup kubernetes.io │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gdvtp -- nslookup kubernetes.default │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gnp5h -- nslookup kubernetes.default │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gdvtp -- nslookup kubernetes.default.svc.cluster.local │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gnp5h -- nslookup kubernetes.default.svc.cluster.local │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- get pods -o jsonpath='{.items[*].metadata.name}' │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gdvtp -- sh -c nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3 │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gdvtp -- sh -c ping -c 1 192.168.67.1 │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gnp5h -- sh -c nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3 │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ kubectl │ -p multinode-269236 -- exec busybox-7b57f96db7-gnp5h -- sh -c ping -c 1 192.168.67.1 │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ 02 Oct 25 20:37 UTC │
│ node │ add -p multinode-269236 -v=5 --alsologtostderr │ multinode-269236 │ jenkins │ v1.37.0 │ 02 Oct 25 20:37 UTC │ │
└─────────┴────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/10/02 20:36:19
Running on machine: ubuntu-20-agent-2
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1002 20:36:19.688677 272194 out.go:360] Setting OutFile to fd 1 ...
I1002 20:36:19.688804 272194 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:36:19.688811 272194 out.go:374] Setting ErrFile to fd 2...
I1002 20:36:19.688817 272194 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:36:19.689084 272194 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:36:19.689664 272194 out.go:368] Setting JSON to false
I1002 20:36:19.690661 272194 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-2","uptime":4729,"bootTime":1759432651,"procs":198,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1041-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1002 20:36:19.690763 272194 start.go:140] virtualization: kvm guest
I1002 20:36:19.693202 272194 out.go:179] * [multinode-269236] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1002 20:36:19.694642 272194 out.go:179] - MINIKUBE_LOCATION=21682
I1002 20:36:19.694639 272194 notify.go:220] Checking for updates...
I1002 20:36:19.696299 272194 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1002 20:36:19.697789 272194 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21682-131316/kubeconfig
I1002 20:36:19.699246 272194 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21682-131316/.minikube
I1002 20:36:19.700706 272194 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1002 20:36:19.702165 272194 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1002 20:36:19.703747 272194 driver.go:421] Setting default libvirt URI to qemu:///system
I1002 20:36:19.729878 272194 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
I1002 20:36:19.730001 272194 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 20:36:19.787319 272194 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-10-02 20:36:19.776112949 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1041-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652174848 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-2 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:b98a3aace656320842a23f4a392a33f46af97866 Expected:} RuncCommit:{ID:v1.3.0-0-g4ca628d1 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.29.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.4] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v0.1.40] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1002 20:36:19.787417 272194 docker.go:318] overlay module found
I1002 20:36:19.790175 272194 out.go:179] * Using the docker driver based on user configuration
I1002 20:36:19.791613 272194 start.go:304] selected driver: docker
I1002 20:36:19.791637 272194 start.go:924] validating driver "docker" against <nil>
I1002 20:36:19.791650 272194 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1002 20:36:19.792326 272194 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 20:36:19.852741 272194 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-10-02 20:36:19.842624321 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1041-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652174848 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-2 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:b98a3aace656320842a23f4a392a33f46af97866 Expected:} RuncCommit:{ID:v1.3.0-0-g4ca628d1 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.29.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.4] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v0.1.40] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1002 20:36:19.852935 272194 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I1002 20:36:19.853145 272194 start_flags.go:1002] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1002 20:36:19.855255 272194 out.go:179] * Using Docker driver with root privileges
I1002 20:36:19.856421 272194 cni.go:84] Creating CNI manager for ""
I1002 20:36:19.856467 272194 cni.go:136] multinode detected (0 nodes found), recommending kindnet
I1002 20:36:19.856477 272194 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
I1002 20:36:19.856552 272194 start.go:348] cluster config:
{Name:multinode-269236 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR
untime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SS
HAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 20:36:19.857980 272194 out.go:179] * Starting "multinode-269236" primary control-plane node in "multinode-269236" cluster
I1002 20:36:19.859239 272194 cache.go:123] Beginning downloading kic base image for docker with containerd
I1002 20:36:19.860476 272194 out.go:179] * Pulling base image v0.0.48-1759382731-21643 ...
I1002 20:36:19.861608 272194 preload.go:183] Checking if preload exists for k8s version v1.34.1 and runtime containerd
I1002 20:36:19.861634 272194 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d in local docker daemon
I1002 20:36:19.861662 272194 preload.go:198] Found local preload: /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4
I1002 20:36:19.861673 272194 cache.go:58] Caching tarball of preloaded images
I1002 20:36:19.861790 272194 preload.go:233] Found /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
I1002 20:36:19.861805 272194 cache.go:61] Finished verifying existence of preloaded tar for v1.34.1 on containerd
I1002 20:36:19.862194 272194 profile.go:143] Saving config to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/config.json ...
I1002 20:36:19.862227 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/config.json: {Name:mk0b243db99968eea625323f928c5506453a72be Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:19.882893 272194 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d in local docker daemon, skipping pull
I1002 20:36:19.882919 272194 cache.go:147] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d exists in daemon, skipping load
I1002 20:36:19.882936 272194 cache.go:232] Successfully downloaded all kic artifacts
I1002 20:36:19.882963 272194 start.go:360] acquireMachinesLock for multinode-269236: {Name:mk3f0b42b133cfbc247d9e60c80704a6df70453f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 20:36:19.883066 272194 start.go:364] duration metric: took 86.931µs to acquireMachinesLock for "multinode-269236"
I1002 20:36:19.883090 272194 start.go:93] Provisioning new machine with config: &{Name:multinode-269236 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQ
emuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I1002 20:36:19.883160 272194 start.go:125] createHost starting for "" (driver="docker")
I1002 20:36:19.885241 272194 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
I1002 20:36:19.885445 272194 start.go:159] libmachine.API.Create for "multinode-269236" (driver="docker")
I1002 20:36:19.885470 272194 client.go:168] LocalClient.Create starting
I1002 20:36:19.885544 272194 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem
I1002 20:36:19.885572 272194 main.go:141] libmachine: Decoding PEM data...
I1002 20:36:19.885586 272194 main.go:141] libmachine: Parsing certificate...
I1002 20:36:19.885653 272194 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem
I1002 20:36:19.885673 272194 main.go:141] libmachine: Decoding PEM data...
I1002 20:36:19.885684 272194 main.go:141] libmachine: Parsing certificate...
I1002 20:36:19.886131 272194 cli_runner.go:164] Run: docker network inspect multinode-269236 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1002 20:36:19.904045 272194 cli_runner.go:211] docker network inspect multinode-269236 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1002 20:36:19.904118 272194 network_create.go:284] running [docker network inspect multinode-269236] to gather additional debugging logs...
I1002 20:36:19.904139 272194 cli_runner.go:164] Run: docker network inspect multinode-269236
W1002 20:36:19.921729 272194 cli_runner.go:211] docker network inspect multinode-269236 returned with exit code 1
I1002 20:36:19.921766 272194 network_create.go:287] error running [docker network inspect multinode-269236]: docker network inspect multinode-269236: exit status 1
stdout:
[]
stderr:
Error response from daemon: network multinode-269236 not found
I1002 20:36:19.921781 272194 network_create.go:289] output of [docker network inspect multinode-269236]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network multinode-269236 not found
** /stderr **
I1002 20:36:19.921900 272194 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1002 20:36:19.940164 272194 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-bf5fd6aece25 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:06:db:7e:8b:fe:e0} reservation:<nil>}
I1002 20:36:19.940441 272194 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-57fe2645710b IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:6a:25:56:9d:36:d4} reservation:<nil>}
I1002 20:36:19.940751 272194 network.go:206] using free private subnet 192.168.67.0/24: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0016a0e10}
I1002 20:36:19.940779 272194 network_create.go:124] attempt to create docker network multinode-269236 192.168.67.0/24 with gateway 192.168.67.1 and MTU of 1500 ...
I1002 20:36:19.940840 272194 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.67.0/24 --gateway=192.168.67.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=multinode-269236 multinode-269236
I1002 20:36:20.000978 272194 network_create.go:108] docker network multinode-269236 192.168.67.0/24 created
I1002 20:36:20.001010 272194 kic.go:121] calculated static IP "192.168.67.2" for the "multinode-269236" container
I1002 20:36:20.001086 272194 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1002 20:36:20.018406 272194 cli_runner.go:164] Run: docker volume create multinode-269236 --label name.minikube.sigs.k8s.io=multinode-269236 --label created_by.minikube.sigs.k8s.io=true
I1002 20:36:20.036909 272194 oci.go:103] Successfully created a docker volume multinode-269236
I1002 20:36:20.036994 272194 cli_runner.go:164] Run: docker run --rm --name multinode-269236-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-269236 --entrypoint /usr/bin/test -v multinode-269236:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d -d /var/lib
I1002 20:36:20.442305 272194 oci.go:107] Successfully prepared a docker volume multinode-269236
I1002 20:36:20.442341 272194 preload.go:183] Checking if preload exists for k8s version v1.34.1 and runtime containerd
I1002 20:36:20.442363 272194 kic.go:194] Starting extracting preloaded images to volume ...
I1002 20:36:20.442429 272194 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-269236:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d -I lz4 -xf /preloaded.tar -C /extractDir
I1002 20:36:24.878643 272194 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-269236:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d -I lz4 -xf /preloaded.tar -C /extractDir: (4.436148519s)
I1002 20:36:24.878684 272194 kic.go:203] duration metric: took 4.436317293s to extract preloaded images to volume ...
W1002 20:36:24.878775 272194 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1002 20:36:24.878808 272194 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1002 20:36:24.878874 272194 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1002 20:36:24.935820 272194 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname multinode-269236 --name multinode-269236 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-269236 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=multinode-269236 --network multinode-269236 --ip 192.168.67.2 --volume multinode-269236:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d
I1002 20:36:25.218816 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Running}}
I1002 20:36:25.238691 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:36:25.258817 272194 cli_runner.go:164] Run: docker exec multinode-269236 stat /var/lib/dpkg/alternatives/iptables
I1002 20:36:25.308400 272194 oci.go:144] the created container "multinode-269236" has a running status.
I1002 20:36:25.308452 272194 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa...
I1002 20:36:25.466004 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa.pub -> /home/docker/.ssh/authorized_keys
I1002 20:36:25.466066 272194 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1002 20:36:25.494608 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:36:25.515059 272194 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1002 20:36:25.515085 272194 kic_runner.go:114] Args: [docker exec --privileged multinode-269236 chown docker:docker /home/docker/.ssh/authorized_keys]
I1002 20:36:25.567526 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:36:25.589393 272194 machine.go:93] provisionDockerMachine start ...
I1002 20:36:25.589488 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:25.616098 272194 main.go:141] libmachine: Using SSH client type: native
I1002 20:36:25.616447 272194 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840040] 0x842d40 <nil> [] 0s} 127.0.0.1 33029 <nil> <nil>}
I1002 20:36:25.616470 272194 main.go:141] libmachine: About to run SSH command:
hostname
I1002 20:36:25.770208 272194 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-269236
I1002 20:36:25.770237 272194 ubuntu.go:182] provisioning hostname "multinode-269236"
I1002 20:36:25.770305 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:25.790487 272194 main.go:141] libmachine: Using SSH client type: native
I1002 20:36:25.790826 272194 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840040] 0x842d40 <nil> [] 0s} 127.0.0.1 33029 <nil> <nil>}
I1002 20:36:25.790874 272194 main.go:141] libmachine: About to run SSH command:
sudo hostname multinode-269236 && echo "multinode-269236" | sudo tee /etc/hostname
I1002 20:36:25.950677 272194 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-269236
I1002 20:36:25.950759 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:25.970765 272194 main.go:141] libmachine: Using SSH client type: native
I1002 20:36:25.971024 272194 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840040] 0x842d40 <nil> [] 0s} 127.0.0.1 33029 <nil> <nil>}
I1002 20:36:25.971047 272194 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smultinode-269236' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-269236/g' /etc/hosts;
else
echo '127.0.1.1 multinode-269236' | sudo tee -a /etc/hosts;
fi
fi
I1002 20:36:26.118257 272194 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1002 20:36:26.118282 272194 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21682-131316/.minikube CaCertPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21682-131316/.minikube}
I1002 20:36:26.118325 272194 ubuntu.go:190] setting up certificates
I1002 20:36:26.118344 272194 provision.go:84] configureAuth start
I1002 20:36:26.118400 272194 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236
I1002 20:36:26.137743 272194 provision.go:143] copyHostCerts
I1002 20:36:26.137782 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem
I1002 20:36:26.137817 272194 exec_runner.go:144] found /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem, removing ...
I1002 20:36:26.137830 272194 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem
I1002 20:36:26.137928 272194 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem (1675 bytes)
I1002 20:36:26.138055 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem
I1002 20:36:26.138086 272194 exec_runner.go:144] found /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem, removing ...
I1002 20:36:26.138097 272194 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem
I1002 20:36:26.138141 272194 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem (1078 bytes)
I1002 20:36:26.138212 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem
I1002 20:36:26.138241 272194 exec_runner.go:144] found /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem, removing ...
I1002 20:36:26.138251 272194 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem
I1002 20:36:26.138297 272194 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem (1123 bytes)
I1002 20:36:26.138369 272194 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca-key.pem org=jenkins.multinode-269236 san=[127.0.0.1 192.168.67.2 localhost minikube multinode-269236]
I1002 20:36:26.502951 272194 provision.go:177] copyRemoteCerts
I1002 20:36:26.503015 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1002 20:36:26.503050 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:26.522440 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:36:26.626700 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I1002 20:36:26.626773 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1002 20:36:26.648038 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I1002 20:36:26.648116 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1002 20:36:26.667207 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem -> /etc/docker/server.pem
I1002 20:36:26.667271 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
I1002 20:36:26.686282 272194 provision.go:87] duration metric: took 567.921979ms to configureAuth
I1002 20:36:26.686309 272194 ubuntu.go:206] setting minikube options for container-runtime
I1002 20:36:26.686503 272194 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:36:26.686520 272194 machine.go:96] duration metric: took 1.097105034s to provisionDockerMachine
I1002 20:36:26.686528 272194 client.go:171] duration metric: took 6.801048282s to LocalClient.Create
I1002 20:36:26.686558 272194 start.go:167] duration metric: took 6.801112998s to libmachine.API.Create "multinode-269236"
I1002 20:36:26.686570 272194 start.go:293] postStartSetup for "multinode-269236" (driver="docker")
I1002 20:36:26.686580 272194 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1002 20:36:26.686634 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1002 20:36:26.686707 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:26.704701 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:36:26.810957 272194 ssh_runner.go:195] Run: cat /etc/os-release
I1002 20:36:26.814827 272194 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1002 20:36:26.814874 272194 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1002 20:36:26.814887 272194 filesync.go:126] Scanning /home/jenkins/minikube-integration/21682-131316/.minikube/addons for local assets ...
I1002 20:36:26.814944 272194 filesync.go:126] Scanning /home/jenkins/minikube-integration/21682-131316/.minikube/files for local assets ...
I1002 20:36:26.815015 272194 filesync.go:149] local asset: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem -> 1348342.pem in /etc/ssl/certs
I1002 20:36:26.815025 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem -> /etc/ssl/certs/1348342.pem
I1002 20:36:26.815109 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1002 20:36:26.823686 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem --> /etc/ssl/certs/1348342.pem (1708 bytes)
I1002 20:36:26.845677 272194 start.go:296] duration metric: took 159.081175ms for postStartSetup
I1002 20:36:26.846098 272194 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236
I1002 20:36:26.864450 272194 profile.go:143] Saving config to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/config.json ...
I1002 20:36:26.864778 272194 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1002 20:36:26.864842 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:26.884289 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:36:26.985324 272194 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1002 20:36:26.990178 272194 start.go:128] duration metric: took 7.106998272s to createHost
I1002 20:36:26.990209 272194 start.go:83] releasing machines lock for "multinode-269236", held for 7.107130459s
I1002 20:36:26.990295 272194 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236
I1002 20:36:27.008722 272194 ssh_runner.go:195] Run: cat /version.json
I1002 20:36:27.008768 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:27.008803 272194 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1002 20:36:27.008896 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:27.027629 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:36:27.027956 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:36:27.178941 272194 ssh_runner.go:195] Run: systemctl --version
I1002 20:36:27.185884 272194 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1002 20:36:27.191070 272194 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1002 20:36:27.191132 272194 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1002 20:36:27.218870 272194 cni.go:262] disabled [/etc/cni/net.d/10-crio-bridge.conflist.disabled, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1002 20:36:27.218898 272194 start.go:495] detecting cgroup driver to use...
I1002 20:36:27.218938 272194 detect.go:190] detected "systemd" cgroup driver on host os
I1002 20:36:27.218995 272194 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1002 20:36:27.233814 272194 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1002 20:36:27.247078 272194 docker.go:218] disabling cri-docker service (if available) ...
I1002 20:36:27.247136 272194 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1002 20:36:27.264536 272194 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1002 20:36:27.283207 272194 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1002 20:36:27.362570 272194 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1002 20:36:27.449516 272194 docker.go:234] disabling docker service ...
I1002 20:36:27.449586 272194 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1002 20:36:27.468654 272194 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1002 20:36:27.482432 272194 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1002 20:36:27.568337 272194 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1002 20:36:27.646550 272194 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1002 20:36:27.660271 272194 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1002 20:36:27.676460 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10.1"|' /etc/containerd/config.toml"
I1002 20:36:27.688175 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1002 20:36:27.698446 272194 containerd.go:146] configuring containerd to use "systemd" as cgroup driver...
I1002 20:36:27.698514 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = true|g' /etc/containerd/config.toml"
I1002 20:36:27.708336 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1002 20:36:27.718285 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1002 20:36:27.727881 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1002 20:36:27.737758 272194 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1002 20:36:27.747020 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1002 20:36:27.756763 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I1002 20:36:27.766576 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I1002 20:36:27.776518 272194 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1002 20:36:27.784870 272194 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1002 20:36:27.793243 272194 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 20:36:27.875030 272194 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1002 20:36:27.981371 272194 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I1002 20:36:27.981434 272194 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I1002 20:36:27.986030 272194 start.go:563] Will wait 60s for crictl version
I1002 20:36:27.986103 272194 ssh_runner.go:195] Run: which crictl
I1002 20:36:27.990121 272194 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1002 20:36:28.016366 272194 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: v1.7.28
RuntimeApiVersion: v1
I1002 20:36:28.016427 272194 ssh_runner.go:195] Run: containerd --version
I1002 20:36:28.040598 272194 ssh_runner.go:195] Run: containerd --version
I1002 20:36:28.068316 272194 out.go:179] * Preparing Kubernetes v1.34.1 on containerd 1.7.28 ...
I1002 20:36:28.069574 272194 cli_runner.go:164] Run: docker network inspect multinode-269236 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1002 20:36:28.088087 272194 ssh_runner.go:195] Run: grep 192.168.67.1 host.minikube.internal$ /etc/hosts
I1002 20:36:28.092618 272194 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.67.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1002 20:36:28.103888 272194 kubeadm.go:883] updating cluster {Name:multinode-269236 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirm
warePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1002 20:36:28.104009 272194 preload.go:183] Checking if preload exists for k8s version v1.34.1 and runtime containerd
I1002 20:36:28.104059 272194 ssh_runner.go:195] Run: sudo crictl images --output json
I1002 20:36:28.130141 272194 containerd.go:627] all images are preloaded for containerd runtime.
I1002 20:36:28.130166 272194 containerd.go:534] Images already preloaded, skipping extraction
I1002 20:36:28.130225 272194 ssh_runner.go:195] Run: sudo crictl images --output json
I1002 20:36:28.155836 272194 containerd.go:627] all images are preloaded for containerd runtime.
I1002 20:36:28.155901 272194 cache_images.go:85] Images are preloaded, skipping loading
I1002 20:36:28.155910 272194 kubeadm.go:934] updating node { 192.168.67.2 8443 v1.34.1 containerd true true} ...
I1002 20:36:28.156015 272194 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=multinode-269236 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.67.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1002 20:36:28.156082 272194 ssh_runner.go:195] Run: sudo crictl info
I1002 20:36:28.183402 272194 cni.go:84] Creating CNI manager for ""
I1002 20:36:28.183423 272194 cni.go:136] multinode detected (1 nodes found), recommending kindnet
I1002 20:36:28.183436 272194 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I1002 20:36:28.183456 272194 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.67.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:multinode-269236 NodeName:multinode-269236 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.67.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.67.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath
:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1002 20:36:28.183576 272194 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.67.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "multinode-269236"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.67.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1002 20:36:28.183637 272194 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1002 20:36:28.192648 272194 binaries.go:44] Found k8s binaries, skipping transfer
I1002 20:36:28.192724 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1002 20:36:28.201281 272194 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (320 bytes)
I1002 20:36:28.215423 272194 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1002 20:36:28.232375 272194 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2228 bytes)
I1002 20:36:28.246589 272194 ssh_runner.go:195] Run: grep 192.168.67.2 control-plane.minikube.internal$ /etc/hosts
I1002 20:36:28.250734 272194 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1002 20:36:28.261683 272194 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 20:36:28.346580 272194 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1002 20:36:28.370395 272194 certs.go:69] Setting up /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236 for IP: 192.168.67.2
I1002 20:36:28.370421 272194 certs.go:195] generating shared ca certs ...
I1002 20:36:28.370442 272194 certs.go:227] acquiring lock for ca certs: {Name:mkf552d5738eef3436c5e81c3d27f053587b3fba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:28.370600 272194 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.key
I1002 20:36:28.370655 272194 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.key
I1002 20:36:28.370668 272194 certs.go:257] generating profile certs ...
I1002 20:36:28.370741 272194 certs.go:364] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key
I1002 20:36:28.370769 272194 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt with IP's: []
I1002 20:36:29.030807 272194 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt ...
I1002 20:36:29.030851 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt: {Name:mkaf323a07b6c38c38f39b4547eee07fb4fdbcfc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:29.031044 272194 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key ...
I1002 20:36:29.031058 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key: {Name:mk6d835bb611efff1089fda23628090b28a08970 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:29.031137 272194 certs.go:364] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.key.69c7d742
I1002 20:36:29.031152 272194 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.crt.69c7d742 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.67.2]
I1002 20:36:29.352525 272194 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.crt.69c7d742 ...
I1002 20:36:29.352558 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.crt.69c7d742: {Name:mkd4417ee07d65d2b9e956ad571850809d633a4b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:29.352735 272194 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.key.69c7d742 ...
I1002 20:36:29.352749 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.key.69c7d742: {Name:mkabe3258f3b31208ed4f9dedbd87b2bb24a50f3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:29.352822 272194 certs.go:382] copying /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.crt.69c7d742 -> /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.crt
I1002 20:36:29.352944 272194 certs.go:386] copying /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.key.69c7d742 -> /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.key
I1002 20:36:29.353014 272194 certs.go:364] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.key
I1002 20:36:29.353031 272194 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.crt with IP's: []
I1002 20:36:29.536089 272194 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.crt ...
I1002 20:36:29.536124 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.crt: {Name:mkfbebf463d2c179318846f1d68001f68c58505e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:29.536295 272194 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.key ...
I1002 20:36:29.536308 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.key: {Name:mkad362337bf21ee099fb88e0ba4e78425ca827c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:29.536383 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I1002 20:36:29.536401 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I1002 20:36:29.536411 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I1002 20:36:29.536424 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I1002 20:36:29.536434 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I1002 20:36:29.536447 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I1002 20:36:29.536457 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I1002 20:36:29.536469 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I1002 20:36:29.536523 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834.pem (1338 bytes)
W1002 20:36:29.536555 272194 certs.go:480] ignoring /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834_empty.pem, impossibly tiny 0 bytes
I1002 20:36:29.536564 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca-key.pem (1675 bytes)
I1002 20:36:29.536588 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem (1078 bytes)
I1002 20:36:29.536610 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem (1123 bytes)
I1002 20:36:29.536630 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem (1675 bytes)
I1002 20:36:29.536668 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem (1708 bytes)
I1002 20:36:29.536699 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I1002 20:36:29.536713 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834.pem -> /usr/share/ca-certificates/134834.pem
I1002 20:36:29.536725 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem -> /usr/share/ca-certificates/1348342.pem
I1002 20:36:29.537304 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1002 20:36:29.557817 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1002 20:36:29.577508 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1002 20:36:29.596424 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1002 20:36:29.614650 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I1002 20:36:29.633902 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1002 20:36:29.653472 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1002 20:36:29.673094 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1002 20:36:29.692277 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1002 20:36:29.714360 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834.pem --> /usr/share/ca-certificates/134834.pem (1338 bytes)
I1002 20:36:29.732949 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem --> /usr/share/ca-certificates/1348342.pem (1708 bytes)
I1002 20:36:29.752047 272194 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1002 20:36:29.765954 272194 ssh_runner.go:195] Run: openssl version
I1002 20:36:29.772620 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1002 20:36:29.782321 272194 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1002 20:36:29.786545 272194 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 2 20:16 /usr/share/ca-certificates/minikubeCA.pem
I1002 20:36:29.786610 272194 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1002 20:36:29.820952 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1002 20:36:29.830445 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/134834.pem && ln -fs /usr/share/ca-certificates/134834.pem /etc/ssl/certs/134834.pem"
I1002 20:36:29.839903 272194 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/134834.pem
I1002 20:36:29.844653 272194 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 2 20:22 /usr/share/ca-certificates/134834.pem
I1002 20:36:29.844732 272194 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/134834.pem
I1002 20:36:29.883347 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/134834.pem /etc/ssl/certs/51391683.0"
I1002 20:36:29.893017 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1348342.pem && ln -fs /usr/share/ca-certificates/1348342.pem /etc/ssl/certs/1348342.pem"
I1002 20:36:29.902805 272194 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1348342.pem
I1002 20:36:29.906874 272194 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 2 20:22 /usr/share/ca-certificates/1348342.pem
I1002 20:36:29.906957 272194 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1348342.pem
I1002 20:36:29.941313 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1348342.pem /etc/ssl/certs/3ec20f2e.0"
I1002 20:36:29.950792 272194 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1002 20:36:29.954996 272194 certs.go:400] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1002 20:36:29.955061 272194 kubeadm.go:400] StartCluster: {Name:multinode-269236 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServe
rNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwar
ePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 20:36:29.955136 272194 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I1002 20:36:29.955186 272194 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1002 20:36:29.984161 272194 cri.go:89] found id: ""
I1002 20:36:29.984250 272194 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1002 20:36:29.992960 272194 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1002 20:36:30.001936 272194 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I1002 20:36:30.002011 272194 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1002 20:36:30.010718 272194 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1002 20:36:30.010746 272194 kubeadm.go:157] found existing configuration files:
I1002 20:36:30.010799 272194 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1002 20:36:30.019299 272194 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1002 20:36:30.019363 272194 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1002 20:36:30.028354 272194 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1002 20:36:30.036971 272194 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1002 20:36:30.037079 272194 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1002 20:36:30.045598 272194 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1002 20:36:30.054106 272194 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1002 20:36:30.054160 272194 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1002 20:36:30.062217 272194 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1002 20:36:30.070629 272194 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1002 20:36:30.070691 272194 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1002 20:36:30.078764 272194 ssh_runner.go:286] Start: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.34.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I1002 20:36:30.120311 272194 kubeadm.go:318] [init] Using Kubernetes version: v1.34.1
I1002 20:36:30.120383 272194 kubeadm.go:318] [preflight] Running pre-flight checks
I1002 20:36:30.142371 272194 kubeadm.go:318] [preflight] The system verification failed. Printing the output from the verification:
I1002 20:36:30.142453 272194 kubeadm.go:318] [0;37mKERNEL_VERSION[0m: [0;32m6.8.0-1041-gcp[0m
I1002 20:36:30.142503 272194 kubeadm.go:318] [0;37mOS[0m: [0;32mLinux[0m
I1002 20:36:30.142573 272194 kubeadm.go:318] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I1002 20:36:30.142623 272194 kubeadm.go:318] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I1002 20:36:30.142692 272194 kubeadm.go:318] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I1002 20:36:30.142742 272194 kubeadm.go:318] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I1002 20:36:30.142802 272194 kubeadm.go:318] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I1002 20:36:30.142916 272194 kubeadm.go:318] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I1002 20:36:30.143001 272194 kubeadm.go:318] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I1002 20:36:30.143067 272194 kubeadm.go:318] [0;37mCGROUPS_IO[0m: [0;32menabled[0m
I1002 20:36:30.202151 272194 kubeadm.go:318] [preflight] Pulling images required for setting up a Kubernetes cluster
I1002 20:36:30.202276 272194 kubeadm.go:318] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1002 20:36:30.202409 272194 kubeadm.go:318] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I1002 20:36:30.208052 272194 kubeadm.go:318] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1002 20:36:30.210152 272194 out.go:252] - Generating certificates and keys ...
I1002 20:36:30.210250 272194 kubeadm.go:318] [certs] Using existing ca certificate authority
I1002 20:36:30.210324 272194 kubeadm.go:318] [certs] Using existing apiserver certificate and key on disk
I1002 20:36:30.730518 272194 kubeadm.go:318] [certs] Generating "apiserver-kubelet-client" certificate and key
I1002 20:36:30.795059 272194 kubeadm.go:318] [certs] Generating "front-proxy-ca" certificate and key
I1002 20:36:31.209631 272194 kubeadm.go:318] [certs] Generating "front-proxy-client" certificate and key
I1002 20:36:31.263228 272194 kubeadm.go:318] [certs] Generating "etcd/ca" certificate and key
I1002 20:36:31.328915 272194 kubeadm.go:318] [certs] Generating "etcd/server" certificate and key
I1002 20:36:31.329098 272194 kubeadm.go:318] [certs] etcd/server serving cert is signed for DNS names [localhost multinode-269236] and IPs [192.168.67.2 127.0.0.1 ::1]
I1002 20:36:31.864409 272194 kubeadm.go:318] [certs] Generating "etcd/peer" certificate and key
I1002 20:36:31.864607 272194 kubeadm.go:318] [certs] etcd/peer serving cert is signed for DNS names [localhost multinode-269236] and IPs [192.168.67.2 127.0.0.1 ::1]
I1002 20:36:32.011656 272194 kubeadm.go:318] [certs] Generating "etcd/healthcheck-client" certificate and key
I1002 20:36:32.359696 272194 kubeadm.go:318] [certs] Generating "apiserver-etcd-client" certificate and key
I1002 20:36:32.471180 272194 kubeadm.go:318] [certs] Generating "sa" key and public key
I1002 20:36:32.471344 272194 kubeadm.go:318] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1002 20:36:32.563787 272194 kubeadm.go:318] [kubeconfig] Writing "admin.conf" kubeconfig file
I1002 20:36:32.685668 272194 kubeadm.go:318] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I1002 20:36:32.960576 272194 kubeadm.go:318] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1002 20:36:33.146751 272194 kubeadm.go:318] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1002 20:36:34.062016 272194 kubeadm.go:318] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1002 20:36:34.062522 272194 kubeadm.go:318] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1002 20:36:34.066817 272194 kubeadm.go:318] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1002 20:36:34.068414 272194 out.go:252] - Booting up control plane ...
I1002 20:36:34.068563 272194 kubeadm.go:318] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1002 20:36:34.068689 272194 kubeadm.go:318] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1002 20:36:34.069435 272194 kubeadm.go:318] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1002 20:36:34.086404 272194 kubeadm.go:318] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1002 20:36:34.086550 272194 kubeadm.go:318] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
I1002 20:36:34.093638 272194 kubeadm.go:318] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
I1002 20:36:34.093814 272194 kubeadm.go:318] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1002 20:36:34.093917 272194 kubeadm.go:318] [kubelet-start] Starting the kubelet
I1002 20:36:34.197397 272194 kubeadm.go:318] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I1002 20:36:34.197563 272194 kubeadm.go:318] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I1002 20:36:34.699072 272194 kubeadm.go:318] [kubelet-check] The kubelet is healthy after 501.903941ms
I1002 20:36:34.701926 272194 kubeadm.go:318] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
I1002 20:36:34.702047 272194 kubeadm.go:318] [control-plane-check] Checking kube-apiserver at https://192.168.67.2:8443/livez
I1002 20:36:34.702172 272194 kubeadm.go:318] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
I1002 20:36:34.702287 272194 kubeadm.go:318] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
I1002 20:36:36.976036 272194 kubeadm.go:318] [control-plane-check] kube-scheduler is healthy after 2.274075116s
I1002 20:36:37.492250 272194 kubeadm.go:318] [control-plane-check] kube-controller-manager is healthy after 2.790162567s
I1002 20:36:38.704090 272194 kubeadm.go:318] [control-plane-check] kube-apiserver is healthy after 4.002082651s
I1002 20:36:38.715427 272194 kubeadm.go:318] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1002 20:36:38.726280 272194 kubeadm.go:318] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1002 20:36:38.739205 272194 kubeadm.go:318] [upload-certs] Skipping phase. Please see --upload-certs
I1002 20:36:38.739530 272194 kubeadm.go:318] [mark-control-plane] Marking the node multinode-269236 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1002 20:36:38.749183 272194 kubeadm.go:318] [bootstrap-token] Using token: ybvxvk.bdsd7yei0cagy4de
I1002 20:36:38.750712 272194 out.go:252] - Configuring RBAC rules ...
I1002 20:36:38.750883 272194 kubeadm.go:318] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1002 20:36:38.754668 272194 kubeadm.go:318] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1002 20:36:38.761044 272194 kubeadm.go:318] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1002 20:36:38.765035 272194 kubeadm.go:318] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1002 20:36:38.768381 272194 kubeadm.go:318] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1002 20:36:38.771811 272194 kubeadm.go:318] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1002 20:36:39.109940 272194 kubeadm.go:318] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1002 20:36:39.529008 272194 kubeadm.go:318] [addons] Applied essential addon: CoreDNS
I1002 20:36:40.110483 272194 kubeadm.go:318] [addons] Applied essential addon: kube-proxy
I1002 20:36:40.111303 272194 kubeadm.go:318]
I1002 20:36:40.111392 272194 kubeadm.go:318] Your Kubernetes control-plane has initialized successfully!
I1002 20:36:40.111408 272194 kubeadm.go:318]
I1002 20:36:40.111480 272194 kubeadm.go:318] To start using your cluster, you need to run the following as a regular user:
I1002 20:36:40.111486 272194 kubeadm.go:318]
I1002 20:36:40.111512 272194 kubeadm.go:318] mkdir -p $HOME/.kube
I1002 20:36:40.111567 272194 kubeadm.go:318] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1002 20:36:40.111641 272194 kubeadm.go:318] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1002 20:36:40.111648 272194 kubeadm.go:318]
I1002 20:36:40.111731 272194 kubeadm.go:318] Alternatively, if you are the root user, you can run:
I1002 20:36:40.111750 272194 kubeadm.go:318]
I1002 20:36:40.111818 272194 kubeadm.go:318] export KUBECONFIG=/etc/kubernetes/admin.conf
I1002 20:36:40.111827 272194 kubeadm.go:318]
I1002 20:36:40.111928 272194 kubeadm.go:318] You should now deploy a pod network to the cluster.
I1002 20:36:40.112049 272194 kubeadm.go:318] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1002 20:36:40.112143 272194 kubeadm.go:318] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1002 20:36:40.112151 272194 kubeadm.go:318]
I1002 20:36:40.112256 272194 kubeadm.go:318] You can now join any number of control-plane nodes by copying certificate authorities
I1002 20:36:40.112349 272194 kubeadm.go:318] and service account keys on each node and then running the following as root:
I1002 20:36:40.112370 272194 kubeadm.go:318]
I1002 20:36:40.112470 272194 kubeadm.go:318] kubeadm join control-plane.minikube.internal:8443 --token ybvxvk.bdsd7yei0cagy4de \
I1002 20:36:40.112595 272194 kubeadm.go:318] --discovery-token-ca-cert-hash sha256:19f830e57ecd67343002e647eaa09b4210d8c617f2ab1d39577e16129d93e626 \
I1002 20:36:40.112640 272194 kubeadm.go:318] --control-plane
I1002 20:36:40.112648 272194 kubeadm.go:318]
I1002 20:36:40.112782 272194 kubeadm.go:318] Then you can join any number of worker nodes by running the following on each as root:
I1002 20:36:40.112793 272194 kubeadm.go:318]
I1002 20:36:40.112917 272194 kubeadm.go:318] kubeadm join control-plane.minikube.internal:8443 --token ybvxvk.bdsd7yei0cagy4de \
I1002 20:36:40.113067 272194 kubeadm.go:318] --discovery-token-ca-cert-hash sha256:19f830e57ecd67343002e647eaa09b4210d8c617f2ab1d39577e16129d93e626
I1002 20:36:40.115296 272194 kubeadm.go:318] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1041-gcp\n", err: exit status 1
I1002 20:36:40.115398 272194 kubeadm.go:318] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1002 20:36:40.115410 272194 cni.go:84] Creating CNI manager for ""
I1002 20:36:40.115416 272194 cni.go:136] multinode detected (1 nodes found), recommending kindnet
I1002 20:36:40.117571 272194 out.go:179] * Configuring CNI (Container Networking Interface) ...
I1002 20:36:40.118796 272194 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I1002 20:36:40.123471 272194 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.1/kubectl ...
I1002 20:36:40.123497 272194 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I1002 20:36:40.136782 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I1002 20:36:40.353581 272194 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1002 20:36:40.353696 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:40.353695 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes multinode-269236 minikube.k8s.io/updated_at=2025_10_02T20_36_40_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=193cee6aa0f134b5df421bbd88a1ddd3223481a4 minikube.k8s.io/name=multinode-269236 minikube.k8s.io/primary=true
I1002 20:36:40.363741 272194 ops.go:34] apiserver oom_adj: -16
I1002 20:36:40.435635 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:40.935926 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:41.436675 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:41.935931 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:42.435891 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:42.935888 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:43.436256 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:43.936329 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:44.435892 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1002 20:36:44.513355 272194 kubeadm.go:1113] duration metric: took 4.159767647s to wait for elevateKubeSystemPrivileges
I1002 20:36:44.513401 272194 kubeadm.go:402] duration metric: took 14.55834432s to StartCluster
I1002 20:36:44.513426 272194 settings.go:142] acquiring lock: {Name:mke1f0ca63c2d2618dadf3c7cba97650e8fb155d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:44.513512 272194 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21682-131316/kubeconfig
I1002 20:36:44.514393 272194 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/kubeconfig: {Name:mkd22c02ac1b9def20da9dd625743bf2c9dc45c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:36:44.514693 272194 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1002 20:36:44.514698 272194 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I1002 20:36:44.514772 272194 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1002 20:36:44.514893 272194 addons.go:69] Setting storage-provisioner=true in profile "multinode-269236"
I1002 20:36:44.514916 272194 addons.go:238] Setting addon storage-provisioner=true in "multinode-269236"
I1002 20:36:44.514948 272194 host.go:66] Checking if "multinode-269236" exists ...
I1002 20:36:44.514936 272194 addons.go:69] Setting default-storageclass=true in profile "multinode-269236"
I1002 20:36:44.514983 272194 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "multinode-269236"
I1002 20:36:44.515002 272194 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:36:44.515318 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:36:44.515448 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:36:44.516018 272194 out.go:179] * Verifying Kubernetes components...
I1002 20:36:44.517358 272194 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 20:36:44.539759 272194 kapi.go:59] client config for multinode-269236: &rest.Config{Host:"https://192.168.67.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt", KeyFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key", CAFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Ne
xtProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2819b80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1002 20:36:44.540994 272194 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
I1002 20:36:44.541022 272194 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
I1002 20:36:44.541030 272194 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
I1002 20:36:44.541035 272194 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
I1002 20:36:44.541040 272194 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
I1002 20:36:44.541060 272194 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache"
I1002 20:36:44.541488 272194 addons.go:238] Setting addon default-storageclass=true in "multinode-269236"
I1002 20:36:44.541529 272194 host.go:66] Checking if "multinode-269236" exists ...
I1002 20:36:44.542040 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:36:44.543065 272194 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1002 20:36:44.544380 272194 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1002 20:36:44.544405 272194 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1002 20:36:44.544473 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:44.571528 272194 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
I1002 20:36:44.571552 272194 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1002 20:36:44.571611 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:36:44.578834 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:36:44.594272 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:36:44.627875 272194 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.67.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I1002 20:36:44.674091 272194 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1002 20:36:44.701995 272194 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1002 20:36:44.736605 272194 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1002 20:36:44.827818 272194 start.go:976] {"host.minikube.internal": 192.168.67.1} host record injected into CoreDNS's ConfigMap
I1002 20:36:44.828395 272194 kapi.go:59] client config for multinode-269236: &rest.Config{Host:"https://192.168.67.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt", KeyFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key", CAFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Ne
xtProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2819b80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1002 20:36:44.828617 272194 kapi.go:59] client config for multinode-269236: &rest.Config{Host:"https://192.168.67.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt", KeyFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key", CAFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Ne
xtProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2819b80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1002 20:36:44.829035 272194 node_ready.go:35] waiting up to 6m0s for node "multinode-269236" to be "Ready" ...
I1002 20:36:45.056387 272194 out.go:179] * Enabled addons: storage-provisioner, default-storageclass
I1002 20:36:45.057464 272194 addons.go:514] duration metric: took 542.694128ms for enable addons: enabled=[storage-provisioner default-storageclass]
I1002 20:36:45.340195 272194 kapi.go:214] "coredns" deployment in "kube-system" namespace and "multinode-269236" context rescaled to 1 replicas
W1002 20:36:46.832645 272194 node_ready.go:57] node "multinode-269236" has "Ready":"False" status (will retry)
W1002 20:36:49.332587 272194 node_ready.go:57] node "multinode-269236" has "Ready":"False" status (will retry)
W1002 20:36:51.832210 272194 node_ready.go:57] node "multinode-269236" has "Ready":"False" status (will retry)
W1002 20:36:53.833132 272194 node_ready.go:57] node "multinode-269236" has "Ready":"False" status (will retry)
I1002 20:36:55.832884 272194 node_ready.go:49] node "multinode-269236" is "Ready"
I1002 20:36:55.832913 272194 node_ready.go:38] duration metric: took 11.003806024s for node "multinode-269236" to be "Ready" ...
I1002 20:36:55.832935 272194 api_server.go:52] waiting for apiserver process to appear ...
I1002 20:36:55.832984 272194 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1002 20:36:55.845570 272194 api_server.go:72] duration metric: took 11.330837553s to wait for apiserver process to appear ...
I1002 20:36:55.845602 272194 api_server.go:88] waiting for apiserver healthz status ...
I1002 20:36:55.845629 272194 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
I1002 20:36:55.851015 272194 api_server.go:279] https://192.168.67.2:8443/healthz returned 200:
ok
I1002 20:36:55.851971 272194 api_server.go:141] control plane version: v1.34.1
I1002 20:36:55.851996 272194 api_server.go:131] duration metric: took 6.387081ms to wait for apiserver health ...
I1002 20:36:55.852005 272194 system_pods.go:43] waiting for kube-system pods to appear ...
I1002 20:36:55.855076 272194 system_pods.go:59] 8 kube-system pods found
I1002 20:36:55.855107 272194 system_pods.go:61] "coredns-66bc5c9577-xvcxn" [17848551-b9d2-4174-98bd-cd9bdb8f86ff] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1002 20:36:55.855115 272194 system_pods.go:61] "etcd-multinode-269236" [2ce9f1c0-bfb9-48b5-bb8d-05dafa2e8ba7] Running
I1002 20:36:55.855123 272194 system_pods.go:61] "kindnet-cl6sd" [51358b09-1a79-4e64-a9cd-7443684e1d86] Running
I1002 20:36:55.855126 272194 system_pods.go:61] "kube-apiserver-multinode-269236" [6b9d8533-8d0f-4f18-a9eb-1f6bcc3d4cb5] Running
I1002 20:36:55.855131 272194 system_pods.go:61] "kube-controller-manager-multinode-269236" [596362ca-cc79-4ae9-902d-0d19724b62f7] Running
I1002 20:36:55.855134 272194 system_pods.go:61] "kube-proxy-l9xd2" [a483457a-ffba-4887-9245-9655e230e47f] Running
I1002 20:36:55.855138 272194 system_pods.go:61] "kube-scheduler-multinode-269236" [7437218e-ca9c-4ac3-9e2c-055663e26bfb] Running
I1002 20:36:55.855143 272194 system_pods.go:61] "storage-provisioner" [71f400c9-ce64-40d9-a406-14278dfccf89] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1002 20:36:55.855152 272194 system_pods.go:74] duration metric: took 3.141872ms to wait for pod list to return data ...
I1002 20:36:55.855160 272194 default_sa.go:34] waiting for default service account to be created ...
I1002 20:36:55.857543 272194 default_sa.go:45] found service account: "default"
I1002 20:36:55.857563 272194 default_sa.go:55] duration metric: took 2.396372ms for default service account to be created ...
I1002 20:36:55.857573 272194 system_pods.go:116] waiting for k8s-apps to be running ...
I1002 20:36:55.860067 272194 system_pods.go:86] 8 kube-system pods found
I1002 20:36:55.860093 272194 system_pods.go:89] "coredns-66bc5c9577-xvcxn" [17848551-b9d2-4174-98bd-cd9bdb8f86ff] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1002 20:36:55.860098 272194 system_pods.go:89] "etcd-multinode-269236" [2ce9f1c0-bfb9-48b5-bb8d-05dafa2e8ba7] Running
I1002 20:36:55.860104 272194 system_pods.go:89] "kindnet-cl6sd" [51358b09-1a79-4e64-a9cd-7443684e1d86] Running
I1002 20:36:55.860110 272194 system_pods.go:89] "kube-apiserver-multinode-269236" [6b9d8533-8d0f-4f18-a9eb-1f6bcc3d4cb5] Running
I1002 20:36:55.860114 272194 system_pods.go:89] "kube-controller-manager-multinode-269236" [596362ca-cc79-4ae9-902d-0d19724b62f7] Running
I1002 20:36:55.860117 272194 system_pods.go:89] "kube-proxy-l9xd2" [a483457a-ffba-4887-9245-9655e230e47f] Running
I1002 20:36:55.860121 272194 system_pods.go:89] "kube-scheduler-multinode-269236" [7437218e-ca9c-4ac3-9e2c-055663e26bfb] Running
I1002 20:36:55.860126 272194 system_pods.go:89] "storage-provisioner" [71f400c9-ce64-40d9-a406-14278dfccf89] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1002 20:36:55.860161 272194 retry.go:31] will retry after 204.191722ms: missing components: kube-dns
I1002 20:36:56.069524 272194 system_pods.go:86] 8 kube-system pods found
I1002 20:36:56.069564 272194 system_pods.go:89] "coredns-66bc5c9577-xvcxn" [17848551-b9d2-4174-98bd-cd9bdb8f86ff] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1002 20:36:56.069572 272194 system_pods.go:89] "etcd-multinode-269236" [2ce9f1c0-bfb9-48b5-bb8d-05dafa2e8ba7] Running
I1002 20:36:56.069581 272194 system_pods.go:89] "kindnet-cl6sd" [51358b09-1a79-4e64-a9cd-7443684e1d86] Running
I1002 20:36:56.069586 272194 system_pods.go:89] "kube-apiserver-multinode-269236" [6b9d8533-8d0f-4f18-a9eb-1f6bcc3d4cb5] Running
I1002 20:36:56.069592 272194 system_pods.go:89] "kube-controller-manager-multinode-269236" [596362ca-cc79-4ae9-902d-0d19724b62f7] Running
I1002 20:36:56.069597 272194 system_pods.go:89] "kube-proxy-l9xd2" [a483457a-ffba-4887-9245-9655e230e47f] Running
I1002 20:36:56.069602 272194 system_pods.go:89] "kube-scheduler-multinode-269236" [7437218e-ca9c-4ac3-9e2c-055663e26bfb] Running
I1002 20:36:56.069610 272194 system_pods.go:89] "storage-provisioner" [71f400c9-ce64-40d9-a406-14278dfccf89] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1002 20:36:56.069630 272194 retry.go:31] will retry after 289.097595ms: missing components: kube-dns
I1002 20:36:56.362519 272194 system_pods.go:86] 8 kube-system pods found
I1002 20:36:56.362552 272194 system_pods.go:89] "coredns-66bc5c9577-xvcxn" [17848551-b9d2-4174-98bd-cd9bdb8f86ff] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I1002 20:36:56.362557 272194 system_pods.go:89] "etcd-multinode-269236" [2ce9f1c0-bfb9-48b5-bb8d-05dafa2e8ba7] Running
I1002 20:36:56.362565 272194 system_pods.go:89] "kindnet-cl6sd" [51358b09-1a79-4e64-a9cd-7443684e1d86] Running
I1002 20:36:56.362569 272194 system_pods.go:89] "kube-apiserver-multinode-269236" [6b9d8533-8d0f-4f18-a9eb-1f6bcc3d4cb5] Running
I1002 20:36:56.362573 272194 system_pods.go:89] "kube-controller-manager-multinode-269236" [596362ca-cc79-4ae9-902d-0d19724b62f7] Running
I1002 20:36:56.362576 272194 system_pods.go:89] "kube-proxy-l9xd2" [a483457a-ffba-4887-9245-9655e230e47f] Running
I1002 20:36:56.362579 272194 system_pods.go:89] "kube-scheduler-multinode-269236" [7437218e-ca9c-4ac3-9e2c-055663e26bfb] Running
I1002 20:36:56.362584 272194 system_pods.go:89] "storage-provisioner" [71f400c9-ce64-40d9-a406-14278dfccf89] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I1002 20:36:56.362605 272194 retry.go:31] will retry after 399.671953ms: missing components: kube-dns
I1002 20:36:56.766535 272194 system_pods.go:86] 8 kube-system pods found
I1002 20:36:56.766563 272194 system_pods.go:89] "coredns-66bc5c9577-xvcxn" [17848551-b9d2-4174-98bd-cd9bdb8f86ff] Running
I1002 20:36:56.766569 272194 system_pods.go:89] "etcd-multinode-269236" [2ce9f1c0-bfb9-48b5-bb8d-05dafa2e8ba7] Running
I1002 20:36:56.766572 272194 system_pods.go:89] "kindnet-cl6sd" [51358b09-1a79-4e64-a9cd-7443684e1d86] Running
I1002 20:36:56.766576 272194 system_pods.go:89] "kube-apiserver-multinode-269236" [6b9d8533-8d0f-4f18-a9eb-1f6bcc3d4cb5] Running
I1002 20:36:56.766580 272194 system_pods.go:89] "kube-controller-manager-multinode-269236" [596362ca-cc79-4ae9-902d-0d19724b62f7] Running
I1002 20:36:56.766583 272194 system_pods.go:89] "kube-proxy-l9xd2" [a483457a-ffba-4887-9245-9655e230e47f] Running
I1002 20:36:56.766586 272194 system_pods.go:89] "kube-scheduler-multinode-269236" [7437218e-ca9c-4ac3-9e2c-055663e26bfb] Running
I1002 20:36:56.766589 272194 system_pods.go:89] "storage-provisioner" [71f400c9-ce64-40d9-a406-14278dfccf89] Running
I1002 20:36:56.766598 272194 system_pods.go:126] duration metric: took 909.01809ms to wait for k8s-apps to be running ...
I1002 20:36:56.766608 272194 system_svc.go:44] waiting for kubelet service to be running ....
I1002 20:36:56.766669 272194 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1002 20:36:56.779920 272194 system_svc.go:56] duration metric: took 13.29337ms WaitForService to wait for kubelet
I1002 20:36:56.779947 272194 kubeadm.go:586] duration metric: took 12.265222484s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1002 20:36:56.779969 272194 node_conditions.go:102] verifying NodePressure condition ...
I1002 20:36:56.782793 272194 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1002 20:36:56.782822 272194 node_conditions.go:123] node cpu capacity is 8
I1002 20:36:56.782862 272194 node_conditions.go:105] duration metric: took 2.886494ms to run NodePressure ...
I1002 20:36:56.782879 272194 start.go:241] waiting for startup goroutines ...
I1002 20:36:56.782888 272194 start.go:246] waiting for cluster config update ...
I1002 20:36:56.782902 272194 start.go:255] writing updated cluster config ...
I1002 20:36:56.785176 272194 out.go:203]
I1002 20:36:56.786767 272194 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:36:56.786888 272194 profile.go:143] Saving config to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/config.json ...
I1002 20:36:56.788387 272194 out.go:179] * Starting "multinode-269236-m02" worker node in "multinode-269236" cluster
I1002 20:36:56.789928 272194 cache.go:123] Beginning downloading kic base image for docker with containerd
I1002 20:36:56.791175 272194 out.go:179] * Pulling base image v0.0.48-1759382731-21643 ...
I1002 20:36:56.792259 272194 preload.go:183] Checking if preload exists for k8s version v1.34.1 and runtime containerd
I1002 20:36:56.792286 272194 cache.go:58] Caching tarball of preloaded images
I1002 20:36:56.792354 272194 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d in local docker daemon
I1002 20:36:56.792384 272194 preload.go:233] Found /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4 in cache, skipping download
I1002 20:36:56.792395 272194 cache.go:61] Finished verifying existence of preloaded tar for v1.34.1 on containerd
I1002 20:36:56.792469 272194 profile.go:143] Saving config to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/config.json ...
I1002 20:36:56.813715 272194 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d in local docker daemon, skipping pull
I1002 20:36:56.813735 272194 cache.go:147] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d exists in daemon, skipping load
I1002 20:36:56.813750 272194 cache.go:232] Successfully downloaded all kic artifacts
I1002 20:36:56.813776 272194 start.go:360] acquireMachinesLock for multinode-269236-m02: {Name:mkb9f2ec51b473505117c59b8e8aff8882c03812 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 20:36:56.813906 272194 start.go:364] duration metric: took 113.953µs to acquireMachinesLock for "multinode-269236-m02"
I1002 20:36:56.813937 272194 start.go:93] Provisioning new machine with config: &{Name:multinode-269236 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:false Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker Mount
IP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:false Worker:true}
I1002 20:36:56.814002 272194 start.go:125] createHost starting for "m02" (driver="docker")
I1002 20:36:56.816588 272194 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
I1002 20:36:56.816684 272194 start.go:159] libmachine.API.Create for "multinode-269236" (driver="docker")
I1002 20:36:56.816710 272194 client.go:168] LocalClient.Create starting
I1002 20:36:56.816775 272194 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem
I1002 20:36:56.816804 272194 main.go:141] libmachine: Decoding PEM data...
I1002 20:36:56.816820 272194 main.go:141] libmachine: Parsing certificate...
I1002 20:36:56.816901 272194 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem
I1002 20:36:56.816924 272194 main.go:141] libmachine: Decoding PEM data...
I1002 20:36:56.816936 272194 main.go:141] libmachine: Parsing certificate...
I1002 20:36:56.817123 272194 cli_runner.go:164] Run: docker network inspect multinode-269236 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1002 20:36:56.835120 272194 network_create.go:77] Found existing network {name:multinode-269236 subnet:0xc0018d3d40 gateway:[0 0 0 0 0 0 0 0 0 0 255 255 192 168 67 1] mtu:1500}
I1002 20:36:56.835163 272194 kic.go:121] calculated static IP "192.168.67.3" for the "multinode-269236-m02" container
I1002 20:36:56.835223 272194 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I1002 20:36:56.852300 272194 cli_runner.go:164] Run: docker volume create multinode-269236-m02 --label name.minikube.sigs.k8s.io=multinode-269236-m02 --label created_by.minikube.sigs.k8s.io=true
I1002 20:36:56.872106 272194 oci.go:103] Successfully created a docker volume multinode-269236-m02
I1002 20:36:56.872196 272194 cli_runner.go:164] Run: docker run --rm --name multinode-269236-m02-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-269236-m02 --entrypoint /usr/bin/test -v multinode-269236-m02:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d -d /var/lib
I1002 20:36:57.254673 272194 oci.go:107] Successfully prepared a docker volume multinode-269236-m02
I1002 20:36:57.254717 272194 preload.go:183] Checking if preload exists for k8s version v1.34.1 and runtime containerd
I1002 20:36:57.254739 272194 kic.go:194] Starting extracting preloaded images to volume ...
I1002 20:36:57.254792 272194 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-269236-m02:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d -I lz4 -xf /preloaded.tar -C /extractDir
I1002 20:37:01.662098 272194 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v multinode-269236-m02:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d -I lz4 -xf /preloaded.tar -C /extractDir: (4.407262446s)
I1002 20:37:01.662134 272194 kic.go:203] duration metric: took 4.407391414s to extract preloaded images to volume ...
W1002 20:37:01.662226 272194 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
W1002 20:37:01.662255 272194 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
I1002 20:37:01.662293 272194 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I1002 20:37:01.715904 272194 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname multinode-269236-m02 --name multinode-269236-m02 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=multinode-269236-m02 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=multinode-269236-m02 --network multinode-269236 --ip 192.168.67.3 --volume multinode-269236-m02:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d
I1002 20:37:02.005994 272194 cli_runner.go:164] Run: docker container inspect multinode-269236-m02 --format={{.State.Running}}
I1002 20:37:02.026895 272194 cli_runner.go:164] Run: docker container inspect multinode-269236-m02 --format={{.State.Status}}
I1002 20:37:02.046706 272194 cli_runner.go:164] Run: docker exec multinode-269236-m02 stat /var/lib/dpkg/alternatives/iptables
I1002 20:37:02.092662 272194 oci.go:144] the created container "multinode-269236-m02" has a running status.
I1002 20:37:02.092695 272194 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa...
I1002 20:37:02.408608 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa.pub -> /home/docker/.ssh/authorized_keys
I1002 20:37:02.408702 272194 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I1002 20:37:02.439192 272194 cli_runner.go:164] Run: docker container inspect multinode-269236-m02 --format={{.State.Status}}
I1002 20:37:02.458766 272194 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I1002 20:37:02.458794 272194 kic_runner.go:114] Args: [docker exec --privileged multinode-269236-m02 chown docker:docker /home/docker/.ssh/authorized_keys]
I1002 20:37:02.505382 272194 cli_runner.go:164] Run: docker container inspect multinode-269236-m02 --format={{.State.Status}}
I1002 20:37:02.526292 272194 machine.go:93] provisionDockerMachine start ...
I1002 20:37:02.526380 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:02.548060 272194 main.go:141] libmachine: Using SSH client type: native
I1002 20:37:02.548303 272194 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840040] 0x842d40 <nil> [] 0s} 127.0.0.1 33034 <nil> <nil>}
I1002 20:37:02.548318 272194 main.go:141] libmachine: About to run SSH command:
hostname
I1002 20:37:02.696382 272194 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-269236-m02
I1002 20:37:02.696421 272194 ubuntu.go:182] provisioning hostname "multinode-269236-m02"
I1002 20:37:02.696496 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:02.716294 272194 main.go:141] libmachine: Using SSH client type: native
I1002 20:37:02.716504 272194 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840040] 0x842d40 <nil> [] 0s} 127.0.0.1 33034 <nil> <nil>}
I1002 20:37:02.716517 272194 main.go:141] libmachine: About to run SSH command:
sudo hostname multinode-269236-m02 && echo "multinode-269236-m02" | sudo tee /etc/hostname
I1002 20:37:02.874557 272194 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-269236-m02
I1002 20:37:02.874639 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:02.893427 272194 main.go:141] libmachine: Using SSH client type: native
I1002 20:37:02.893669 272194 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840040] 0x842d40 <nil> [] 0s} 127.0.0.1 33034 <nil> <nil>}
I1002 20:37:02.893691 272194 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smultinode-269236-m02' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-269236-m02/g' /etc/hosts;
else
echo '127.0.1.1 multinode-269236-m02' | sudo tee -a /etc/hosts;
fi
fi
I1002 20:37:03.041026 272194 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1002 20:37:03.041065 272194 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21682-131316/.minikube CaCertPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21682-131316/.minikube}
I1002 20:37:03.041083 272194 ubuntu.go:190] setting up certificates
I1002 20:37:03.041113 272194 provision.go:84] configureAuth start
I1002 20:37:03.041185 272194 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236-m02
I1002 20:37:03.059208 272194 provision.go:143] copyHostCerts
I1002 20:37:03.059247 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem
I1002 20:37:03.059278 272194 exec_runner.go:144] found /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem, removing ...
I1002 20:37:03.059288 272194 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem
I1002 20:37:03.059361 272194 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21682-131316/.minikube/ca.pem (1078 bytes)
I1002 20:37:03.059439 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem
I1002 20:37:03.059460 272194 exec_runner.go:144] found /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem, removing ...
I1002 20:37:03.059466 272194 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem
I1002 20:37:03.059493 272194 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21682-131316/.minikube/cert.pem (1123 bytes)
I1002 20:37:03.059538 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem
I1002 20:37:03.059554 272194 exec_runner.go:144] found /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem, removing ...
I1002 20:37:03.059560 272194 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem
I1002 20:37:03.059582 272194 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21682-131316/.minikube/key.pem (1675 bytes)
I1002 20:37:03.059635 272194 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca-key.pem org=jenkins.multinode-269236-m02 san=[127.0.0.1 192.168.67.3 localhost minikube multinode-269236-m02]
I1002 20:37:03.185075 272194 provision.go:177] copyRemoteCerts
I1002 20:37:03.185150 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1002 20:37:03.185187 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:03.205082 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33034 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa Username:docker}
I1002 20:37:03.310046 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I1002 20:37:03.310132 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1002 20:37:03.331051 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem -> /etc/docker/server.pem
I1002 20:37:03.331107 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server.pem --> /etc/docker/server.pem (1229 bytes)
I1002 20:37:03.349833 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I1002 20:37:03.349908 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1002 20:37:03.368618 272194 provision.go:87] duration metric: took 327.483229ms to configureAuth
I1002 20:37:03.368649 272194 ubuntu.go:206] setting minikube options for container-runtime
I1002 20:37:03.368836 272194 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:37:03.368875 272194 machine.go:96] duration metric: took 842.558721ms to provisionDockerMachine
I1002 20:37:03.368886 272194 client.go:171] duration metric: took 6.552164526s to LocalClient.Create
I1002 20:37:03.368915 272194 start.go:167] duration metric: took 6.552229267s to libmachine.API.Create "multinode-269236"
I1002 20:37:03.368929 272194 start.go:293] postStartSetup for "multinode-269236-m02" (driver="docker")
I1002 20:37:03.368951 272194 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1002 20:37:03.369015 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1002 20:37:03.369071 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:03.387606 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33034 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa Username:docker}
I1002 20:37:03.494445 272194 ssh_runner.go:195] Run: cat /etc/os-release
I1002 20:37:03.498589 272194 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1002 20:37:03.498616 272194 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1002 20:37:03.498628 272194 filesync.go:126] Scanning /home/jenkins/minikube-integration/21682-131316/.minikube/addons for local assets ...
I1002 20:37:03.498685 272194 filesync.go:126] Scanning /home/jenkins/minikube-integration/21682-131316/.minikube/files for local assets ...
I1002 20:37:03.498750 272194 filesync.go:149] local asset: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem -> 1348342.pem in /etc/ssl/certs
I1002 20:37:03.498760 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem -> /etc/ssl/certs/1348342.pem
I1002 20:37:03.498840 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1002 20:37:03.507655 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem --> /etc/ssl/certs/1348342.pem (1708 bytes)
I1002 20:37:03.530326 272194 start.go:296] duration metric: took 161.382401ms for postStartSetup
I1002 20:37:03.530717 272194 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236-m02
I1002 20:37:03.548971 272194 profile.go:143] Saving config to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/config.json ...
I1002 20:37:03.549258 272194 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1002 20:37:03.549302 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:03.567633 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33034 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa Username:docker}
I1002 20:37:03.668386 272194 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1002 20:37:03.673614 272194 start.go:128] duration metric: took 6.859591671s to createHost
I1002 20:37:03.673647 272194 start.go:83] releasing machines lock for "multinode-269236-m02", held for 6.859724336s
I1002 20:37:03.673727 272194 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236-m02
I1002 20:37:03.695212 272194 out.go:179] * Found network options:
I1002 20:37:03.696597 272194 out.go:179] - NO_PROXY=192.168.67.2
W1002 20:37:03.697796 272194 proxy.go:120] fail to check proxy env: Error ip not in block
W1002 20:37:03.697884 272194 proxy.go:120] fail to check proxy env: Error ip not in block
I1002 20:37:03.697980 272194 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1002 20:37:03.698033 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:03.698068 272194 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1002 20:37:03.698142 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:37:03.717602 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33034 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa Username:docker}
I1002 20:37:03.717895 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33034 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa Username:docker}
W1002 20:37:03.871862 272194 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1002 20:37:03.871953 272194 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1002 20:37:03.899103 272194 cni.go:262] disabled [/etc/cni/net.d/10-crio-bridge.conflist.disabled, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1002 20:37:03.899144 272194 start.go:495] detecting cgroup driver to use...
I1002 20:37:03.899187 272194 detect.go:190] detected "systemd" cgroup driver on host os
I1002 20:37:03.899243 272194 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1002 20:37:03.914975 272194 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1002 20:37:03.928658 272194 docker.go:218] disabling cri-docker service (if available) ...
I1002 20:37:03.928750 272194 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1002 20:37:03.946470 272194 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1002 20:37:03.965477 272194 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1002 20:37:04.051650 272194 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1002 20:37:04.141110 272194 docker.go:234] disabling docker service ...
I1002 20:37:04.141191 272194 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1002 20:37:04.160950 272194 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1002 20:37:04.175512 272194 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1002 20:37:04.260001 272194 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1002 20:37:04.343927 272194 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1002 20:37:04.358127 272194 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1002 20:37:04.373538 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10.1"|' /etc/containerd/config.toml"
I1002 20:37:04.385172 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1002 20:37:04.394986 272194 containerd.go:146] configuring containerd to use "systemd" as cgroup driver...
I1002 20:37:04.395063 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = true|g' /etc/containerd/config.toml"
I1002 20:37:04.405174 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1002 20:37:04.414655 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1002 20:37:04.424387 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1002 20:37:04.434664 272194 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1002 20:37:04.444054 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1002 20:37:04.453942 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I1002 20:37:04.464335 272194 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I1002 20:37:04.474185 272194 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1002 20:37:04.482464 272194 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1002 20:37:04.491485 272194 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 20:37:04.567076 272194 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1002 20:37:04.674685 272194 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I1002 20:37:04.674767 272194 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I1002 20:37:04.678953 272194 start.go:563] Will wait 60s for crictl version
I1002 20:37:04.679026 272194 ssh_runner.go:195] Run: which crictl
I1002 20:37:04.682898 272194 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1002 20:37:04.709141 272194 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: v1.7.28
RuntimeApiVersion: v1
I1002 20:37:04.709225 272194 ssh_runner.go:195] Run: containerd --version
I1002 20:37:04.734439 272194 ssh_runner.go:195] Run: containerd --version
I1002 20:37:04.760911 272194 out.go:179] * Preparing Kubernetes v1.34.1 on containerd 1.7.28 ...
I1002 20:37:04.762567 272194 out.go:179] - env NO_PROXY=192.168.67.2
I1002 20:37:04.763961 272194 cli_runner.go:164] Run: docker network inspect multinode-269236 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1002 20:37:04.781657 272194 ssh_runner.go:195] Run: grep 192.168.67.1 host.minikube.internal$ /etc/hosts
I1002 20:37:04.785913 272194 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.67.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1002 20:37:04.796677 272194 mustload.go:65] Loading cluster: multinode-269236
I1002 20:37:04.796921 272194 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:37:04.797132 272194 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:37:04.816313 272194 host.go:66] Checking if "multinode-269236" exists ...
I1002 20:37:04.816543 272194 certs.go:69] Setting up /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236 for IP: 192.168.67.3
I1002 20:37:04.816552 272194 certs.go:195] generating shared ca certs ...
I1002 20:37:04.816566 272194 certs.go:227] acquiring lock for ca certs: {Name:mkf552d5738eef3436c5e81c3d27f053587b3fba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:37:04.816677 272194 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.key
I1002 20:37:04.816715 272194 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.key
I1002 20:37:04.816729 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I1002 20:37:04.816743 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I1002 20:37:04.816755 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I1002 20:37:04.816771 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I1002 20:37:04.816819 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834.pem (1338 bytes)
W1002 20:37:04.816880 272194 certs.go:480] ignoring /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834_empty.pem, impossibly tiny 0 bytes
I1002 20:37:04.816895 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca-key.pem (1675 bytes)
I1002 20:37:04.816920 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/ca.pem (1078 bytes)
I1002 20:37:04.816944 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/cert.pem (1123 bytes)
I1002 20:37:04.816964 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/key.pem (1675 bytes)
I1002 20:37:04.817001 272194 certs.go:484] found cert: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem (1708 bytes)
I1002 20:37:04.817029 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I1002 20:37:04.817046 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834.pem -> /usr/share/ca-certificates/134834.pem
I1002 20:37:04.817055 272194 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem -> /usr/share/ca-certificates/1348342.pem
I1002 20:37:04.817075 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1002 20:37:04.836673 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1002 20:37:04.856152 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1002 20:37:04.875190 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1002 20:37:04.894577 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1002 20:37:04.916836 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/certs/134834.pem --> /usr/share/ca-certificates/134834.pem (1338 bytes)
I1002 20:37:04.935661 272194 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/ssl/certs/1348342.pem --> /usr/share/ca-certificates/1348342.pem (1708 bytes)
I1002 20:37:04.954806 272194 ssh_runner.go:195] Run: openssl version
I1002 20:37:04.961052 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1002 20:37:04.970873 272194 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1002 20:37:04.975095 272194 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 2 20:16 /usr/share/ca-certificates/minikubeCA.pem
I1002 20:37:04.975164 272194 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1002 20:37:05.010397 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1002 20:37:05.020057 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/134834.pem && ln -fs /usr/share/ca-certificates/134834.pem /etc/ssl/certs/134834.pem"
I1002 20:37:05.029403 272194 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/134834.pem
I1002 20:37:05.033731 272194 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 2 20:22 /usr/share/ca-certificates/134834.pem
I1002 20:37:05.033791 272194 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/134834.pem
I1002 20:37:05.068727 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/134834.pem /etc/ssl/certs/51391683.0"
I1002 20:37:05.078201 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1348342.pem && ln -fs /usr/share/ca-certificates/1348342.pem /etc/ssl/certs/1348342.pem"
I1002 20:37:05.088014 272194 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1348342.pem
I1002 20:37:05.092079 272194 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 2 20:22 /usr/share/ca-certificates/1348342.pem
I1002 20:37:05.092133 272194 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1348342.pem
I1002 20:37:05.127081 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/1348342.pem /etc/ssl/certs/3ec20f2e.0"
I1002 20:37:05.136690 272194 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1002 20:37:05.140924 272194 certs.go:400] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1002 20:37:05.140979 272194 kubeadm.go:934] updating node {m02 192.168.67.3 8443 v1.34.1 containerd false true} ...
I1002 20:37:05.141079 272194 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=multinode-269236-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.67.3
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1002 20:37:05.141151 272194 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1002 20:37:05.149778 272194 binaries.go:44] Found k8s binaries, skipping transfer
I1002 20:37:05.149926 272194 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system
I1002 20:37:05.158738 272194 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (324 bytes)
I1002 20:37:05.173559 272194 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1002 20:37:05.190764 272194 ssh_runner.go:195] Run: grep 192.168.67.2 control-plane.minikube.internal$ /etc/hosts
I1002 20:37:05.194791 272194 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1002 20:37:05.205730 272194 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 20:37:05.293043 272194 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1002 20:37:05.326437 272194 host.go:66] Checking if "multinode-269236" exists ...
I1002 20:37:05.326745 272194 start.go:317] joinCluster: &{Name:multinode-269236 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:multinode-269236 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true} {Name:m02 IP:192.168.67.3 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:false Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSi
ze:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 20:37:05.326917 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.34.1:$PATH" kubeadm token create --print-join-command --ttl=0"
I1002 20:37:05.326965 272194 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:37:05.347171 272194 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:37:05.499969 272194 start.go:343] trying to join worker node "m02" to cluster: &{Name:m02 IP:192.168.67.3 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:false Worker:true}
I1002 20:37:05.500058 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "env PATH="/var/lib/minikube/binaries/v1.34.1:$PATH" kubeadm join control-plane.minikube.internal:8443 --token r8kdl7.22eg59ezgk1lyka2 --discovery-token-ca-cert-hash sha256:19f830e57ecd67343002e647eaa09b4210d8c617f2ab1d39577e16129d93e626 --ignore-preflight-errors=all --cri-socket unix:///run/containerd/containerd.sock --node-name=multinode-269236-m02"
I1002 20:37:06.272049 272194 ssh_runner.go:195] Run: sudo /bin/bash -c "systemctl daemon-reload && systemctl enable kubelet && systemctl start kubelet"
I1002 20:37:06.465092 272194 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes multinode-269236-m02 minikube.k8s.io/updated_at=2025_10_02T20_37_06_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=193cee6aa0f134b5df421bbd88a1ddd3223481a4 minikube.k8s.io/name=multinode-269236 minikube.k8s.io/primary=false
I1002 20:37:06.540432 272194 start.go:319] duration metric: took 1.21368218s to joinCluster
I1002 20:37:06.540513 272194 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.67.3 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:false Worker:true}
I1002 20:37:06.540768 272194 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:37:06.542692 272194 out.go:179] * Verifying Kubernetes components...
I1002 20:37:06.544131 272194 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1002 20:37:06.634382 272194 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1002 20:37:06.649452 272194 kapi.go:59] client config for multinode-269236: &rest.Config{Host:"https://192.168.67.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt", KeyFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key", CAFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Ne
xtProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2819b80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1002 20:37:06.649746 272194 node_ready.go:35] waiting up to 6m0s for node "multinode-269236-m02" to be "Ready" ...
W1002 20:37:08.653514 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:11.153063 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:13.153533 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:15.652925 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:18.152927 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:20.153432 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:22.153715 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:24.653182 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:27.153382 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:29.153455 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:31.652643 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:33.653199 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:36.152943 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:38.653250 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:41.153768 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:43.652777 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:45.652982 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
W1002 20:37:48.152769 272194 node_ready.go:57] node "multinode-269236-m02" has "Ready":"False" status (will retry)
I1002 20:37:48.653138 272194 node_ready.go:49] node "multinode-269236-m02" is "Ready"
I1002 20:37:48.653183 272194 node_ready.go:38] duration metric: took 42.003404514s for node "multinode-269236-m02" to be "Ready" ...
I1002 20:37:48.653206 272194 system_svc.go:44] waiting for kubelet service to be running ....
I1002 20:37:48.653264 272194 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1002 20:37:48.666423 272194 system_svc.go:56] duration metric: took 13.205017ms WaitForService to wait for kubelet
I1002 20:37:48.666451 272194 kubeadm.go:586] duration metric: took 42.125905325s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1002 20:37:48.666479 272194 node_conditions.go:102] verifying NodePressure condition ...
I1002 20:37:48.669083 272194 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1002 20:37:48.669112 272194 node_conditions.go:123] node cpu capacity is 8
I1002 20:37:48.669127 272194 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1002 20:37:48.669133 272194 node_conditions.go:123] node cpu capacity is 8
I1002 20:37:48.669140 272194 node_conditions.go:105] duration metric: took 2.655023ms to run NodePressure ...
I1002 20:37:48.669154 272194 start.go:241] waiting for startup goroutines ...
I1002 20:37:48.669201 272194 start.go:255] writing updated cluster config ...
I1002 20:37:48.669566 272194 ssh_runner.go:195] Run: rm -f paused
I1002 20:37:48.673478 272194 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1002 20:37:48.674002 272194 kapi.go:59] client config for multinode-269236: &rest.Config{Host:"https://192.168.67.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.crt", KeyFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/profiles/multinode-269236/client.key", CAFile:"/home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Ne
xtProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2819b80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1002 20:37:48.677569 272194 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-xvcxn" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:48.682164 272194 pod_ready.go:94] pod "coredns-66bc5c9577-xvcxn" is "Ready"
I1002 20:37:48.682184 272194 pod_ready.go:86] duration metric: took 4.595161ms for pod "coredns-66bc5c9577-xvcxn" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:48.684286 272194 pod_ready.go:83] waiting for pod "etcd-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:48.688334 272194 pod_ready.go:94] pod "etcd-multinode-269236" is "Ready"
I1002 20:37:48.688362 272194 pod_ready.go:86] duration metric: took 4.053116ms for pod "etcd-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:48.690438 272194 pod_ready.go:83] waiting for pod "kube-apiserver-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:48.694501 272194 pod_ready.go:94] pod "kube-apiserver-multinode-269236" is "Ready"
I1002 20:37:48.694524 272194 pod_ready.go:86] duration metric: took 4.060175ms for pod "kube-apiserver-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:48.696614 272194 pod_ready.go:83] waiting for pod "kube-controller-manager-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:48.875047 272194 request.go:683] "Waited before sending request" delay="178.303494ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-multinode-269236"
I1002 20:37:49.075324 272194 request.go:683] "Waited before sending request" delay="197.304499ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/nodes/multinode-269236"
I1002 20:37:49.077995 272194 pod_ready.go:94] pod "kube-controller-manager-multinode-269236" is "Ready"
I1002 20:37:49.078111 272194 pod_ready.go:86] duration metric: took 381.460684ms for pod "kube-controller-manager-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:49.274611 272194 request.go:683] "Waited before sending request" delay="196.334038ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/namespaces/kube-system/pods?labelSelector=k8s-app%3Dkube-proxy"
I1002 20:37:49.277918 272194 pod_ready.go:83] waiting for pod "kube-proxy-kfmt6" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:49.475447 272194 request.go:683] "Waited before sending request" delay="197.406714ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/namespaces/kube-system/pods/kube-proxy-kfmt6"
I1002 20:37:49.674695 272194 request.go:683] "Waited before sending request" delay="196.311501ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/nodes/multinode-269236-m02"
I1002 20:37:49.677680 272194 pod_ready.go:94] pod "kube-proxy-kfmt6" is "Ready"
I1002 20:37:49.677709 272194 pod_ready.go:86] duration metric: took 399.766536ms for pod "kube-proxy-kfmt6" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:49.677717 272194 pod_ready.go:83] waiting for pod "kube-proxy-l9xd2" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:49.875457 272194 request.go:683] "Waited before sending request" delay="197.636489ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/namespaces/kube-system/pods/kube-proxy-l9xd2"
I1002 20:37:50.074811 272194 request.go:683] "Waited before sending request" delay="196.390267ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/nodes/multinode-269236"
I1002 20:37:50.077912 272194 pod_ready.go:94] pod "kube-proxy-l9xd2" is "Ready"
I1002 20:37:50.077943 272194 pod_ready.go:86] duration metric: took 400.219176ms for pod "kube-proxy-l9xd2" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:50.275450 272194 request.go:683] "Waited before sending request" delay="197.374951ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Dkube-scheduler"
I1002 20:37:50.278247 272194 pod_ready.go:83] waiting for pod "kube-scheduler-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:50.474651 272194 request.go:683] "Waited before sending request" delay="196.283204ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-269236"
I1002 20:37:50.674688 272194 request.go:683] "Waited before sending request" delay="197.299723ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.67.2:8443/api/v1/nodes/multinode-269236"
I1002 20:37:50.677486 272194 pod_ready.go:94] pod "kube-scheduler-multinode-269236" is "Ready"
I1002 20:37:50.677517 272194 pod_ready.go:86] duration metric: took 399.245564ms for pod "kube-scheduler-multinode-269236" in "kube-system" namespace to be "Ready" or be gone ...
I1002 20:37:50.677533 272194 pod_ready.go:40] duration metric: took 2.004018523s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I1002 20:37:50.723919 272194 start.go:623] kubectl: 1.34.1, cluster: 1.34.1 (minor skew: 0)
I1002 20:37:50.725983 272194 out.go:179] * Done! kubectl is now configured to use "multinode-269236" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
6396f60f21d6a 8c811b4aec35f 16 seconds ago Running busybox 0 196afa8ff63b4 busybox-7b57f96db7-gdvtp default
6d15f1c224a06 52546a367cc9e About a minute ago Running coredns 0 daf857d133691 coredns-66bc5c9577-xvcxn kube-system
924ab5d6383aa 6e38f40d628db About a minute ago Running storage-provisioner 0 e958230a98539 storage-provisioner kube-system
c8120c5b18a23 409467f978b4a About a minute ago Running kindnet-cni 0 8bbf2a95da2f4 kindnet-cl6sd kube-system
a557b614982f1 fc25172553d79 About a minute ago Running kube-proxy 0 366296b46ee0c kube-proxy-l9xd2 kube-system
666830b41c276 c80c8dbafe7dd About a minute ago Running kube-controller-manager 0 589dca4df67a1 kube-controller-manager-multinode-269236 kube-system
658eae82e7e3c c3994bc696102 About a minute ago Running kube-apiserver 0 162c2f825d6c2 kube-apiserver-multinode-269236 kube-system
0381a561c5e33 5f1f5298c888d About a minute ago Running etcd 0 8e29d0b79677c etcd-multinode-269236 kube-system
20ee80acc3711 7dd6aaa1717ab About a minute ago Running kube-scheduler 0 07027ef7aeb58 kube-scheduler-multinode-269236 kube-system
==> containerd <==
Oct 02 20:36:55 multinode-269236 containerd[666]: time="2025-10-02T20:36:55.888097619Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:71f400c9-ce64-40d9-a406-14278dfccf89,Namespace:kube-system,Attempt:0,}"
Oct 02 20:36:55 multinode-269236 containerd[666]: time="2025-10-02T20:36:55.890507798Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-66bc5c9577-xvcxn,Uid:17848551-b9d2-4174-98bd-cd9bdb8f86ff,Namespace:kube-system,Attempt:0,}"
Oct 02 20:36:55 multinode-269236 containerd[666]: time="2025-10-02T20:36:55.976834259Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:storage-provisioner,Uid:71f400c9-ce64-40d9-a406-14278dfccf89,Namespace:kube-system,Attempt:0,} returns sandbox id \"e958230a98539de196811cff98497c0c6a56bfd590c04f8daea7f043b5d07ed5\""
Oct 02 20:36:55 multinode-269236 containerd[666]: time="2025-10-02T20:36:55.983063781Z" level=info msg="CreateContainer within sandbox \"e958230a98539de196811cff98497c0c6a56bfd590c04f8daea7f043b5d07ed5\" for container &ContainerMetadata{Name:storage-provisioner,Attempt:0,}"
Oct 02 20:36:55 multinode-269236 containerd[666]: time="2025-10-02T20:36:55.996114210Z" level=info msg="CreateContainer within sandbox \"e958230a98539de196811cff98497c0c6a56bfd590c04f8daea7f043b5d07ed5\" for &ContainerMetadata{Name:storage-provisioner,Attempt:0,} returns container id \"924ab5d6383aaa0390ff7a6fadb5f8e8737062b74e270d36daab8e72aa7691c5\""
Oct 02 20:36:55 multinode-269236 containerd[666]: time="2025-10-02T20:36:55.996837332Z" level=info msg="StartContainer for \"924ab5d6383aaa0390ff7a6fadb5f8e8737062b74e270d36daab8e72aa7691c5\""
Oct 02 20:36:55 multinode-269236 containerd[666]: time="2025-10-02T20:36:55.999883734Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-66bc5c9577-xvcxn,Uid:17848551-b9d2-4174-98bd-cd9bdb8f86ff,Namespace:kube-system,Attempt:0,} returns sandbox id \"daf857d13369108b70e4310f5990bd62d1a799514cb5584257a33f93a13be77b\""
Oct 02 20:36:56 multinode-269236 containerd[666]: time="2025-10-02T20:36:56.005078206Z" level=info msg="CreateContainer within sandbox \"daf857d13369108b70e4310f5990bd62d1a799514cb5584257a33f93a13be77b\" for container &ContainerMetadata{Name:coredns,Attempt:0,}"
Oct 02 20:36:56 multinode-269236 containerd[666]: time="2025-10-02T20:36:56.016599256Z" level=info msg="CreateContainer within sandbox \"daf857d13369108b70e4310f5990bd62d1a799514cb5584257a33f93a13be77b\" for &ContainerMetadata{Name:coredns,Attempt:0,} returns container id \"6d15f1c224a06287d21f8484c36dcb653d5e3de372920e7b903f59fa9d899edb\""
Oct 02 20:36:56 multinode-269236 containerd[666]: time="2025-10-02T20:36:56.017256981Z" level=info msg="StartContainer for \"6d15f1c224a06287d21f8484c36dcb653d5e3de372920e7b903f59fa9d899edb\""
Oct 02 20:36:56 multinode-269236 containerd[666]: time="2025-10-02T20:36:56.054290258Z" level=info msg="StartContainer for \"924ab5d6383aaa0390ff7a6fadb5f8e8737062b74e270d36daab8e72aa7691c5\" returns successfully"
Oct 02 20:36:56 multinode-269236 containerd[666]: time="2025-10-02T20:36:56.085032181Z" level=info msg="StartContainer for \"6d15f1c224a06287d21f8484c36dcb653d5e3de372920e7b903f59fa9d899edb\" returns successfully"
Oct 02 20:37:51 multinode-269236 containerd[666]: time="2025-10-02T20:37:51.741873374Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:busybox-7b57f96db7-gdvtp,Uid:fc393bf7-9718-4290-bc59-ef8cdcec2732,Namespace:default,Attempt:0,}"
Oct 02 20:37:51 multinode-269236 containerd[666]: time="2025-10-02T20:37:51.843772768Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:busybox-7b57f96db7-gdvtp,Uid:fc393bf7-9718-4290-bc59-ef8cdcec2732,Namespace:default,Attempt:0,} returns sandbox id \"196afa8ff63b47bd1b64a3d8b9170cda4d956852abcf33d357f8bd69a49d392d\""
Oct 02 20:37:51 multinode-269236 containerd[666]: time="2025-10-02T20:37:51.846301708Z" level=info msg="PullImage \"gcr.io/k8s-minikube/busybox:1.28\""
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.721570228Z" level=info msg="ImageCreate event name:\"gcr.io/k8s-minikube/busybox:1.28\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.723489176Z" level=info msg="stop pulling image gcr.io/k8s-minikube/busybox:1.28: active requests=0, bytes read=727667"
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.724252006Z" level=info msg="ImageCreate event name:\"sha256:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.725994946Z" level=info msg="ImageCreate event name:\"gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.726507687Z" level=info msg="Pulled image \"gcr.io/k8s-minikube/busybox:1.28\" with image id \"sha256:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a\", repo tag \"gcr.io/k8s-minikube/busybox:1.28\", repo digest \"gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12\", size \"725911\" in 1.88016213s"
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.726543646Z" level=info msg="PullImage \"gcr.io/k8s-minikube/busybox:1.28\" returns image reference \"sha256:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a\""
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.731326209Z" level=info msg="CreateContainer within sandbox \"196afa8ff63b47bd1b64a3d8b9170cda4d956852abcf33d357f8bd69a49d392d\" for container &ContainerMetadata{Name:busybox,Attempt:0,}"
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.740777198Z" level=info msg="CreateContainer within sandbox \"196afa8ff63b47bd1b64a3d8b9170cda4d956852abcf33d357f8bd69a49d392d\" for &ContainerMetadata{Name:busybox,Attempt:0,} returns container id \"6396f60f21d6a4da9130987288da9e08ddc5783f831a13f955dc0f54c01715d8\""
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.741429157Z" level=info msg="StartContainer for \"6396f60f21d6a4da9130987288da9e08ddc5783f831a13f955dc0f54c01715d8\""
Oct 02 20:37:53 multinode-269236 containerd[666]: time="2025-10-02T20:37:53.808076438Z" level=info msg="StartContainer for \"6396f60f21d6a4da9130987288da9e08ddc5783f831a13f955dc0f54c01715d8\" returns successfully"
==> coredns [6d15f1c224a06287d21f8484c36dcb653d5e3de372920e7b903f59fa9d899edb] <==
[INFO] 10.244.0.3:37539 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000113174s
[INFO] 10.244.1.2:35091 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000179637s
[INFO] 10.244.1.2:36611 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000171494s
[INFO] 10.244.1.2:36132 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000130423s
[INFO] 10.244.1.2:41104 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00008954s
[INFO] 10.244.1.2:40002 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000066235s
[INFO] 10.244.1.2:36880 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000140014s
[INFO] 10.244.1.2:49624 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000147513s
[INFO] 10.244.1.2:57768 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00007537s
[INFO] 10.244.0.3:50452 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000161601s
[INFO] 10.244.0.3:50446 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000215003s
[INFO] 10.244.0.3:32806 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000168783s
[INFO] 10.244.0.3:52580 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000080646s
[INFO] 10.244.1.2:36587 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000167276s
[INFO] 10.244.1.2:52916 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000169416s
[INFO] 10.244.1.2:49809 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000234769s
[INFO] 10.244.1.2:42835 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000099958s
[INFO] 10.244.0.3:44728 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000148953s
[INFO] 10.244.0.3:58315 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000120128s
[INFO] 10.244.0.3:34957 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.00009717s
[INFO] 10.244.0.3:34384 - 5 "PTR IN 1.67.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000147133s
[INFO] 10.244.1.2:33298 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000182913s
[INFO] 10.244.1.2:46091 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000113894s
[INFO] 10.244.1.2:59526 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000109444s
[INFO] 10.244.1.2:48716 - 5 "PTR IN 1.67.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000082952s
==> describe nodes <==
Name: multinode-269236
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-269236
kubernetes.io/os=linux
minikube.k8s.io/commit=193cee6aa0f134b5df421bbd88a1ddd3223481a4
minikube.k8s.io/name=multinode-269236
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_10_02T20_36_40_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 02 Oct 2025 20:36:36 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: multinode-269236
AcquireTime: <unset>
RenewTime: Thu, 02 Oct 2025 20:38:01 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 02 Oct 2025 20:36:55 +0000 Thu, 02 Oct 2025 20:36:36 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 02 Oct 2025 20:36:55 +0000 Thu, 02 Oct 2025 20:36:36 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 02 Oct 2025 20:36:55 +0000 Thu, 02 Oct 2025 20:36:36 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 02 Oct 2025 20:36:55 +0000 Thu, 02 Oct 2025 20:36:55 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.67.2
Hostname: multinode-269236
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863452Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863452Ki
pods: 110
System Info:
Machine ID: 799e9b934aec4d26b4ea01f5e06a0cb6
System UUID: d92e25b4-a3c1-44ef-ab82-b736d3f12369
Boot ID: f7e88a84-8870-4a38-a6c2-e18741e6e9d3
Kernel Version: 6.8.0-1041-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: containerd://1.7.28
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-7b57f96db7-gdvtp 0 (0%) 0 (0%) 0 (0%) 0 (0%) 19s
kube-system coredns-66bc5c9577-xvcxn 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 86s
kube-system etcd-multinode-269236 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 91s
kube-system kindnet-cl6sd 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 86s
kube-system kube-apiserver-multinode-269236 250m (3%) 0 (0%) 0 (0%) 0 (0%) 91s
kube-system kube-controller-manager-multinode-269236 200m (2%) 0 (0%) 0 (0%) 0 (0%) 91s
kube-system kube-proxy-l9xd2 0 (0%) 0 (0%) 0 (0%) 0 (0%) 86s
kube-system kube-scheduler-multinode-269236 100m (1%) 0 (0%) 0 (0%) 0 (0%) 91s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 85s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 100m (1%)
memory 220Mi (0%) 220Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 85s kube-proxy
Normal Starting 91s kubelet Starting kubelet.
Normal NodeAllocatableEnforced 91s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 91s kubelet Node multinode-269236 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 91s kubelet Node multinode-269236 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 91s kubelet Node multinode-269236 status is now: NodeHasSufficientPID
Normal RegisteredNode 87s node-controller Node multinode-269236 event: Registered Node multinode-269236 in Controller
Normal NodeReady 75s kubelet Node multinode-269236 status is now: NodeReady
Name: multinode-269236-m02
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-269236-m02
kubernetes.io/os=linux
minikube.k8s.io/commit=193cee6aa0f134b5df421bbd88a1ddd3223481a4
minikube.k8s.io/name=multinode-269236
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2025_10_02T20_37_06_0700
minikube.k8s.io/version=v1.37.0
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 02 Oct 2025 20:37:06 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: multinode-269236-m02
AcquireTime: <unset>
RenewTime: Thu, 02 Oct 2025 20:38:07 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:37:06 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:37:06 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:37:06 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:37:48 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.67.3
Hostname: multinode-269236-m02
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863452Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863452Ki
pods: 110
System Info:
Machine ID: 3c0b6853b4834a24ac1ce03475aeceab
System UUID: 3dc3ee28-c84f-4d07-9abf-b7492ad449a3
Boot ID: f7e88a84-8870-4a38-a6c2-e18741e6e9d3
Kernel Version: 6.8.0-1041-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: containerd://1.7.28
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.1.0/24
PodCIDRs: 10.244.1.0/24
Non-terminated Pods: (3 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-7b57f96db7-gnp5h 0 (0%) 0 (0%) 0 (0%) 0 (0%) 19s
kube-system kindnet-8l5tn 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 64s
kube-system kube-proxy-kfmt6 0 (0%) 0 (0%) 0 (0%) 0 (0%) 64s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (1%) 100m (1%)
memory 50Mi (0%) 50Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 62s kube-proxy
Normal NodeHasSufficientMemory 64s (x3 over 64s) kubelet Node multinode-269236-m02 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 64s (x3 over 64s) kubelet Node multinode-269236-m02 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 64s (x3 over 64s) kubelet Node multinode-269236-m02 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 64s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 62s node-controller Node multinode-269236-m02 event: Registered Node multinode-269236-m02 in Controller
Normal NodeReady 22s kubelet Node multinode-269236-m02 status is now: NodeReady
Name: multinode-269236-m03
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-269236-m03
kubernetes.io/os=linux
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 02 Oct 2025 20:38:07 +0000
Taints: node.kubernetes.io/not-ready:NoExecute
node.kubernetes.io/not-ready:NoSchedule
Unschedulable: false
Lease: Failed to get lease: leases.coordination.k8s.io "multinode-269236-m03" not found
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:38:07 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:38:07 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:38:07 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready False Thu, 02 Oct 2025 20:38:07 +0000 Thu, 02 Oct 2025 20:38:07 +0000 KubeletNotReady [container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized, CSINode is not yet initialized]
Addresses:
InternalIP: 192.168.67.4
Hostname: multinode-269236-m03
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863452Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32863452Ki
pods: 110
System Info:
Machine ID: ee0d188506574878b4f34d0752128355
System UUID: c053c45d-c63b-4b01-be39-74bc97b5aa89
Boot ID: f7e88a84-8870-4a38-a6c2-e18741e6e9d3
Kernel Version: 6.8.0-1041-gcp
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: amd64
Container Runtime Version: containerd://1.7.28
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.2.0/24
PodCIDRs: 10.244.2.0/24
Non-terminated Pods: (2 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system kindnet-ch4bx 100m (1%) 100m (1%) 50Mi (0%) 50Mi (0%) 3s
kube-system kube-proxy-hwwrq 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (1%) 100m (1%)
memory 50Mi (0%) 50Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 0s kube-proxy
Normal NodeHasSufficientMemory 3s (x3 over 3s) kubelet Node multinode-269236-m03 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 3s (x3 over 3s) kubelet Node multinode-269236-m03 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 3s (x3 over 3s) kubelet Node multinode-269236-m03 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 3s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 2s node-controller Node multinode-269236-m03 event: Registered Node multinode-269236-m03 in Controller
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 0e d3 32 fb 39 1d 08 06
[Oct 2 20:05] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000010] ll header: 00000000: ff ff ff ff ff ff a2 2f 04 c3 10 a5 08 06
[ +0.840382] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff ce b9 ee d2 9f fc 08 06
[ +0.040405] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 8a b8 47 01 75 cc 08 06
[ +4.475907] IPv4: martian source 10.244.0.1 from 10.244.0.5, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff 76 3e b5 43 48 61 08 06
[ +31.475518] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 7e 86 e5 88 af a8 08 06
[ +1.070870] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000010] ll header: 00000000: ff ff ff ff ff ff 5e 08 fe e7 a5 fd 08 06
[ +0.038925] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 42 67 d2 88 24 fd 08 06
[ +6.407336] IPv4: martian source 10.244.0.1 from 10.244.0.5, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 9a 23 a1 2a 3e 5c 08 06
[Oct 2 20:06] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 66 b9 ba 13 eb d5 08 06
[ +1.238739] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff ae 03 dc c0 5f 73 08 06
[ +0.037592] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 22 75 f5 ad 12 6d 08 06
[ +6.200456] IPv4: martian source 10.244.0.1 from 10.244.0.5, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 22 27 a4 60 11 6b 08 06
==> etcd [0381a561c5e33e07c56cbe9ff0c579f4575441a89cbf109fd541377aed8ba28e] <==
{"level":"warn","ts":"2025-10-02T20:36:36.052109Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54162","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.058811Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54170","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.073723Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54178","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.079238Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54198","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.085633Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54206","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.092104Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54230","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.098956Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54244","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.105280Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54264","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.111508Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54282","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.118871Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54304","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.126978Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54340","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.133482Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54352","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.139900Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54372","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.146979Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54392","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.154103Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54410","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.160880Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54420","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.169185Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54432","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.175818Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54452","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.183507Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54472","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.190911Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54484","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.206226Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54498","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.216704Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54516","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.223429Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54548","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.230756Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54574","server-name":"","error":"EOF"}
{"level":"warn","ts":"2025-10-02T20:36:36.283021Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:54600","server-name":"","error":"EOF"}
==> kernel <==
20:38:10 up 1:20, 0 user, load average: 0.97, 1.47, 1.66
Linux multinode-269236 6.8.0-1041-gcp #43~22.04.1-Ubuntu SMP Wed Sep 24 23:11:19 UTC 2025 x86_64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [c8120c5b18a2319c0b0ee8e61910a9beb89732853ea37a1a75d286a4b53d8c10] <==
I1002 20:37:15.523910 1 main.go:297] Handling node with IPs: map[192.168.67.2:{}]
I1002 20:37:15.523977 1 main.go:301] handling current node
I1002 20:37:15.523994 1 main.go:297] Handling node with IPs: map[192.168.67.3:{}]
I1002 20:37:15.523999 1 main.go:324] Node multinode-269236-m02 has CIDR [10.244.1.0/24]
I1002 20:37:15.524240 1 routes.go:62] Adding route {Ifindex: 0 Dst: 10.244.1.0/24 Src: <nil> Gw: 192.168.67.3 Flags: [] Table: 0 Realm: 0}
I1002 20:37:25.526972 1 main.go:297] Handling node with IPs: map[192.168.67.2:{}]
I1002 20:37:25.527019 1 main.go:301] handling current node
I1002 20:37:25.527034 1 main.go:297] Handling node with IPs: map[192.168.67.3:{}]
I1002 20:37:25.527039 1 main.go:324] Node multinode-269236-m02 has CIDR [10.244.1.0/24]
I1002 20:37:35.524878 1 main.go:297] Handling node with IPs: map[192.168.67.2:{}]
I1002 20:37:35.524916 1 main.go:301] handling current node
I1002 20:37:35.524933 1 main.go:297] Handling node with IPs: map[192.168.67.3:{}]
I1002 20:37:35.524938 1 main.go:324] Node multinode-269236-m02 has CIDR [10.244.1.0/24]
I1002 20:37:45.519691 1 main.go:297] Handling node with IPs: map[192.168.67.3:{}]
I1002 20:37:45.519725 1 main.go:324] Node multinode-269236-m02 has CIDR [10.244.1.0/24]
I1002 20:37:45.520041 1 main.go:297] Handling node with IPs: map[192.168.67.2:{}]
I1002 20:37:45.520058 1 main.go:301] handling current node
I1002 20:37:55.520129 1 main.go:297] Handling node with IPs: map[192.168.67.2:{}]
I1002 20:37:55.520172 1 main.go:301] handling current node
I1002 20:37:55.520188 1 main.go:297] Handling node with IPs: map[192.168.67.3:{}]
I1002 20:37:55.520194 1 main.go:324] Node multinode-269236-m02 has CIDR [10.244.1.0/24]
I1002 20:38:05.527984 1 main.go:297] Handling node with IPs: map[192.168.67.2:{}]
I1002 20:38:05.528033 1 main.go:301] handling current node
I1002 20:38:05.528052 1 main.go:297] Handling node with IPs: map[192.168.67.3:{}]
I1002 20:38:05.528059 1 main.go:324] Node multinode-269236-m02 has CIDR [10.244.1.0/24]
==> kube-apiserver [658eae82e7e3c7c7f205546a056183dcb822ac509c3b70b8e973ff5b87980588] <==
I1002 20:36:38.221778 1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I1002 20:36:38.264669 1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I1002 20:36:38.386572 1 alloc.go:328] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W1002 20:36:38.393385 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.67.2]
I1002 20:36:38.394577 1 controller.go:667] quota admission added evaluator for: endpoints
I1002 20:36:38.399262 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1002 20:36:38.501401 1 controller.go:667] quota admission added evaluator for: serviceaccounts
I1002 20:36:39.517404 1 controller.go:667] quota admission added evaluator for: deployments.apps
I1002 20:36:39.527966 1 alloc.go:328] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I1002 20:36:39.537096 1 controller.go:667] quota admission added evaluator for: daemonsets.apps
I1002 20:36:44.252812 1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
I1002 20:36:44.252812 1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
I1002 20:36:44.355007 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1002 20:36:44.360401 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1002 20:36:44.504569 1 controller.go:667] quota admission added evaluator for: replicasets.apps
E1002 20:37:55.037432 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60126: use of closed network connection
E1002 20:37:55.199643 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60150: use of closed network connection
E1002 20:37:55.460619 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60166: use of closed network connection
E1002 20:37:55.622348 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60192: use of closed network connection
E1002 20:37:55.785492 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60210: use of closed network connection
E1002 20:37:55.953596 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60232: use of closed network connection
E1002 20:37:56.245372 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60268: use of closed network connection
E1002 20:37:56.409334 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60288: use of closed network connection
E1002 20:37:56.566087 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60314: use of closed network connection
E1002 20:37:56.722517 1 conn.go:339] Error on socket receive: read tcp 192.168.67.2:8443->192.168.67.1:60340: use of closed network connection
==> kube-controller-manager [666830b41c276801283a9dd06fa8a57008245e531d503287030fb547655da526] <==
I1002 20:36:43.501268 1 shared_informer.go:356] "Caches are synced" controller="attach detach"
I1002 20:36:43.501362 1 shared_informer.go:356] "Caches are synced" controller="deployment"
I1002 20:36:43.501574 1 shared_informer.go:356] "Caches are synced" controller="GC"
I1002 20:36:43.502599 1 shared_informer.go:356] "Caches are synced" controller="PV protection"
I1002 20:36:43.504813 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1002 20:36:43.505051 1 shared_informer.go:356] "Caches are synced" controller="TTL"
I1002 20:36:43.506146 1 shared_informer.go:356] "Caches are synced" controller="namespace"
I1002 20:36:43.506163 1 shared_informer.go:356] "Caches are synced" controller="resource quota"
I1002 20:36:43.508438 1 shared_informer.go:356] "Caches are synced" controller="node"
I1002 20:36:43.508501 1 range_allocator.go:177] "Sending events to api server" logger="node-ipam-controller"
I1002 20:36:43.508539 1 range_allocator.go:183] "Starting range CIDR allocator" logger="node-ipam-controller"
I1002 20:36:43.508549 1 shared_informer.go:349] "Waiting for caches to sync" controller="cidrallocator"
I1002 20:36:43.508556 1 shared_informer.go:356] "Caches are synced" controller="cidrallocator"
I1002 20:36:43.514786 1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
I1002 20:36:43.516153 1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="multinode-269236" podCIDRs=["10.244.0.0/24"]
I1002 20:36:43.522185 1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
I1002 20:36:58.452837 1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
I1002 20:37:06.200600 1 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"multinode-269236-m02\" does not exist"
I1002 20:37:06.208547 1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="multinode-269236-m02" podCIDRs=["10.244.1.0/24"]
I1002 20:37:08.454350 1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="multinode-269236-m02"
I1002 20:37:48.301268 1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="multinode-269236-m02"
I1002 20:38:07.625171 1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="multinode-269236-m02"
I1002 20:38:07.625348 1 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"multinode-269236-m03\" does not exist"
I1002 20:38:07.631188 1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="multinode-269236-m03" podCIDRs=["10.244.2.0/24"]
I1002 20:38:08.471000 1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="multinode-269236-m03"
==> kube-proxy [a557b614982f18135f82f0cabc2740780c4834191a616b89da60ed5aad9a5532] <==
I1002 20:36:44.914145 1 server_linux.go:53] "Using iptables proxy"
I1002 20:36:44.971356 1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
I1002 20:36:45.072471 1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
I1002 20:36:45.072510 1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.67.2"]
E1002 20:36:45.072625 1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1002 20:36:45.130067 1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1002 20:36:45.130127 1 server_linux.go:132] "Using iptables Proxier"
I1002 20:36:45.137132 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1002 20:36:45.137534 1 server.go:527] "Version info" version="v1.34.1"
I1002 20:36:45.137561 1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1002 20:36:45.139178 1 config.go:403] "Starting serviceCIDR config controller"
I1002 20:36:45.139204 1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
I1002 20:36:45.139204 1 config.go:200] "Starting service config controller"
I1002 20:36:45.139232 1 config.go:106] "Starting endpoint slice config controller"
I1002 20:36:45.139239 1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
I1002 20:36:45.139231 1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
I1002 20:36:45.139307 1 config.go:309] "Starting node config controller"
I1002 20:36:45.139323 1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
I1002 20:36:45.139330 1 shared_informer.go:356] "Caches are synced" controller="node config"
I1002 20:36:45.240237 1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
I1002 20:36:45.240284 1 shared_informer.go:356] "Caches are synced" controller="service config"
I1002 20:36:45.240260 1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
==> kube-scheduler [20ee80acc3711db9dc4223a2310020d7c3e1cc7f2ad8af54be18847fb92aab78] <==
E1002 20:36:36.970806 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
E1002 20:36:36.972330 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
E1002 20:36:36.972730 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1002 20:36:36.972437 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1002 20:36:36.972537 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
E1002 20:36:36.972537 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1002 20:36:36.972621 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
E1002 20:36:36.972749 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
E1002 20:36:36.972370 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
E1002 20:36:36.973182 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
E1002 20:36:36.973372 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1002 20:36:36.973375 1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
E1002 20:36:36.973382 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
E1002 20:36:36.972794 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
E1002 20:36:36.973471 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
E1002 20:36:36.973558 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
E1002 20:36:36.973610 1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
E1002 20:36:36.973627 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1002 20:36:36.974620 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1002 20:36:37.844267 1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
E1002 20:36:37.925661 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
E1002 20:36:37.954083 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
E1002 20:36:37.990939 1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
E1002 20:36:38.033178 1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
I1002 20:36:38.469562 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Oct 02 20:36:40 multinode-269236 kubelet[1480]: I1002 20:36:40.426388 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/etcd-multinode-269236" podStartSLOduration=1.426363028 podStartE2EDuration="1.426363028s" podCreationTimestamp="2025-10-02 20:36:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:40.414976883 +0000 UTC m=+1.145003855" watchObservedRunningTime="2025-10-02 20:36:40.426363028 +0000 UTC m=+1.156389998"
Oct 02 20:36:40 multinode-269236 kubelet[1480]: I1002 20:36:40.438644 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-multinode-269236" podStartSLOduration=1.438620727 podStartE2EDuration="1.438620727s" podCreationTimestamp="2025-10-02 20:36:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:40.426642034 +0000 UTC m=+1.156668985" watchObservedRunningTime="2025-10-02 20:36:40.438620727 +0000 UTC m=+1.168647699"
Oct 02 20:36:40 multinode-269236 kubelet[1480]: I1002 20:36:40.450079 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-controller-manager-multinode-269236" podStartSLOduration=1.4500503710000001 podStartE2EDuration="1.450050371s" podCreationTimestamp="2025-10-02 20:36:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:40.43880745 +0000 UTC m=+1.168834413" watchObservedRunningTime="2025-10-02 20:36:40.450050371 +0000 UTC m=+1.180077359"
Oct 02 20:36:40 multinode-269236 kubelet[1480]: I1002 20:36:40.461229 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-scheduler-multinode-269236" podStartSLOduration=1.461207074 podStartE2EDuration="1.461207074s" podCreationTimestamp="2025-10-02 20:36:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:40.450049223 +0000 UTC m=+1.180076195" watchObservedRunningTime="2025-10-02 20:36:40.461207074 +0000 UTC m=+1.191234046"
Oct 02 20:36:43 multinode-269236 kubelet[1480]: I1002 20:36:43.593347 1480 kuberuntime_manager.go:1828] "Updating runtime config through cri with podcidr" CIDR="10.244.0.0/24"
Oct 02 20:36:43 multinode-269236 kubelet[1480]: I1002 20:36:43.594190 1480 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.244.0.0/24"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367333 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51358b09-1a79-4e64-a9cd-7443684e1d86-lib-modules\") pod \"kindnet-cl6sd\" (UID: \"51358b09-1a79-4e64-a9cd-7443684e1d86\") " pod="kube-system/kindnet-cl6sd"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367378 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/a483457a-ffba-4887-9245-9655e230e47f-kube-proxy\") pod \"kube-proxy-l9xd2\" (UID: \"a483457a-ffba-4887-9245-9655e230e47f\") " pod="kube-system/kube-proxy-l9xd2"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367392 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/a483457a-ffba-4887-9245-9655e230e47f-xtables-lock\") pod \"kube-proxy-l9xd2\" (UID: \"a483457a-ffba-4887-9245-9655e230e47f\") " pod="kube-system/kube-proxy-l9xd2"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367413 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a483457a-ffba-4887-9245-9655e230e47f-lib-modules\") pod \"kube-proxy-l9xd2\" (UID: \"a483457a-ffba-4887-9245-9655e230e47f\") " pod="kube-system/kube-proxy-l9xd2"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367487 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jcrf\" (UniqueName: \"kubernetes.io/projected/51358b09-1a79-4e64-a9cd-7443684e1d86-kube-api-access-5jcrf\") pod \"kindnet-cl6sd\" (UID: \"51358b09-1a79-4e64-a9cd-7443684e1d86\") " pod="kube-system/kindnet-cl6sd"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367545 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smqw4\" (UniqueName: \"kubernetes.io/projected/a483457a-ffba-4887-9245-9655e230e47f-kube-api-access-smqw4\") pod \"kube-proxy-l9xd2\" (UID: \"a483457a-ffba-4887-9245-9655e230e47f\") " pod="kube-system/kube-proxy-l9xd2"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367568 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/51358b09-1a79-4e64-a9cd-7443684e1d86-cni-cfg\") pod \"kindnet-cl6sd\" (UID: \"51358b09-1a79-4e64-a9cd-7443684e1d86\") " pod="kube-system/kindnet-cl6sd"
Oct 02 20:36:44 multinode-269236 kubelet[1480]: I1002 20:36:44.367590 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/51358b09-1a79-4e64-a9cd-7443684e1d86-xtables-lock\") pod \"kindnet-cl6sd\" (UID: \"51358b09-1a79-4e64-a9cd-7443684e1d86\") " pod="kube-system/kindnet-cl6sd"
Oct 02 20:36:45 multinode-269236 kubelet[1480]: I1002 20:36:45.393671 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-proxy-l9xd2" podStartSLOduration=1.39365152 podStartE2EDuration="1.39365152s" podCreationTimestamp="2025-10-02 20:36:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:45.393444617 +0000 UTC m=+6.123471589" watchObservedRunningTime="2025-10-02 20:36:45.39365152 +0000 UTC m=+6.123678492"
Oct 02 20:36:46 multinode-269236 kubelet[1480]: I1002 20:36:46.141502 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kindnet-cl6sd" podStartSLOduration=2.141464268 podStartE2EDuration="2.141464268s" podCreationTimestamp="2025-10-02 20:36:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:45.40537739 +0000 UTC m=+6.135404362" watchObservedRunningTime="2025-10-02 20:36:46.141464268 +0000 UTC m=+6.871491240"
Oct 02 20:36:55 multinode-269236 kubelet[1480]: I1002 20:36:55.554398 1480 kubelet_node_status.go:439] "Fast updating node status as it just became ready"
Oct 02 20:36:55 multinode-269236 kubelet[1480]: I1002 20:36:55.649481 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htnv9\" (UniqueName: \"kubernetes.io/projected/17848551-b9d2-4174-98bd-cd9bdb8f86ff-kube-api-access-htnv9\") pod \"coredns-66bc5c9577-xvcxn\" (UID: \"17848551-b9d2-4174-98bd-cd9bdb8f86ff\") " pod="kube-system/coredns-66bc5c9577-xvcxn"
Oct 02 20:36:55 multinode-269236 kubelet[1480]: I1002 20:36:55.649597 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/71f400c9-ce64-40d9-a406-14278dfccf89-tmp\") pod \"storage-provisioner\" (UID: \"71f400c9-ce64-40d9-a406-14278dfccf89\") " pod="kube-system/storage-provisioner"
Oct 02 20:36:55 multinode-269236 kubelet[1480]: I1002 20:36:55.649644 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg44j\" (UniqueName: \"kubernetes.io/projected/71f400c9-ce64-40d9-a406-14278dfccf89-kube-api-access-sg44j\") pod \"storage-provisioner\" (UID: \"71f400c9-ce64-40d9-a406-14278dfccf89\") " pod="kube-system/storage-provisioner"
Oct 02 20:36:55 multinode-269236 kubelet[1480]: I1002 20:36:55.649671 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/17848551-b9d2-4174-98bd-cd9bdb8f86ff-config-volume\") pod \"coredns-66bc5c9577-xvcxn\" (UID: \"17848551-b9d2-4174-98bd-cd9bdb8f86ff\") " pod="kube-system/coredns-66bc5c9577-xvcxn"
Oct 02 20:36:56 multinode-269236 kubelet[1480]: I1002 20:36:56.416822 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/coredns-66bc5c9577-xvcxn" podStartSLOduration=12.416798437 podStartE2EDuration="12.416798437s" podCreationTimestamp="2025-10-02 20:36:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:56.416556401 +0000 UTC m=+17.146583387" watchObservedRunningTime="2025-10-02 20:36:56.416798437 +0000 UTC m=+17.146825408"
Oct 02 20:36:56 multinode-269236 kubelet[1480]: I1002 20:36:56.427129 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/storage-provisioner" podStartSLOduration=11.427110714 podStartE2EDuration="11.427110714s" podCreationTimestamp="2025-10-02 20:36:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-02 20:36:56.427012204 +0000 UTC m=+17.157039175" watchObservedRunningTime="2025-10-02 20:36:56.427110714 +0000 UTC m=+17.157137719"
Oct 02 20:37:51 multinode-269236 kubelet[1480]: I1002 20:37:51.522291 1480 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb76h\" (UniqueName: \"kubernetes.io/projected/fc393bf7-9718-4290-bc59-ef8cdcec2732-kube-api-access-cb76h\") pod \"busybox-7b57f96db7-gdvtp\" (UID: \"fc393bf7-9718-4290-bc59-ef8cdcec2732\") " pod="default/busybox-7b57f96db7-gdvtp"
Oct 02 20:37:54 multinode-269236 kubelet[1480]: I1002 20:37:54.545054 1480 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/busybox-7b57f96db7-gdvtp" podStartSLOduration=1.663298212 podStartE2EDuration="3.545028859s" podCreationTimestamp="2025-10-02 20:37:51 +0000 UTC" firstStartedPulling="2025-10-02 20:37:51.845745633 +0000 UTC m=+72.575772596" lastFinishedPulling="2025-10-02 20:37:53.727476288 +0000 UTC m=+74.457503243" observedRunningTime="2025-10-02 20:37:54.544993451 +0000 UTC m=+75.275020423" watchObservedRunningTime="2025-10-02 20:37:54.545028859 +0000 UTC m=+75.275055833"
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p multinode-269236 -n multinode-269236
helpers_test.go:269: (dbg) Run: kubectl --context multinode-269236 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestMultiNode/serial/MultiNodeLabels FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiNode/serial/MultiNodeLabels (1.90s)
=== RUN TestDownloadOnly/v1.28.0/json-events
aaa_download_only_test.go:80: (dbg) Run: out/minikube-linux-amd64 start -o=json --download-only -p download-only-935488 --force --alsologtostderr --kubernetes-version=v1.28.0 --container-runtime=containerd --driver=docker --container-runtime=containerd
aaa_download_only_test.go:80: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-935488 --force --alsologtostderr --kubernetes-version=v1.28.0 --container-runtime=containerd --driver=docker --container-runtime=containerd: (5.27935552s)
--- PASS: TestDownloadOnly/v1.28.0/json-events (5.28s)
=== RUN TestDownloadOnly/v1.28.0/preload-exists
I1002 20:15:42.737809 134834 preload.go:183] Checking if preload exists for k8s version v1.28.0 and runtime containerd
I1002 20:15:42.737961 134834 preload.go:198] Found local preload: /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-containerd-overlay2-amd64.tar.lz4
--- PASS: TestDownloadOnly/v1.28.0/preload-exists (0.00s)
=== RUN TestDownloadOnly/v1.28.0/LogsDuration
aaa_download_only_test.go:183: (dbg) Run: out/minikube-linux-amd64 logs -p download-only-935488
aaa_download_only_test.go:183: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-935488: exit status 85 (68.483832ms)
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────┬─────────┬─────────┬─────────────────────┬──────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────┼─────────┼─────────┼─────────────────────┼──────────┤
│ start │ -o=json --download-only -p download-only-935488 --force --alsologtostderr --kubernetes-version=v1.28.0 --container-runtime=containerd --driver=docker --container-runtime=containerd │ download-only-935488 │ jenkins │ v1.37.0 │ 02 Oct 25 20:15 UTC │ │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────┴─────────┴─────────┴─────────────────────┴──────────┘
==> Last Start <==
Log file created at: 2025/10/02 20:15:37
Running on machine: ubuntu-20-agent-2
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1002 20:15:37.503342 134846 out.go:360] Setting OutFile to fd 1 ...
I1002 20:15:37.503671 134846 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:15:37.503684 134846 out.go:374] Setting ErrFile to fd 2...
I1002 20:15:37.503691 134846 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:15:37.504017 134846 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
W1002 20:15:37.504235 134846 root.go:314] Error reading config file at /home/jenkins/minikube-integration/21682-131316/.minikube/config/config.json: open /home/jenkins/minikube-integration/21682-131316/.minikube/config/config.json: no such file or directory
I1002 20:15:37.504891 134846 out.go:368] Setting JSON to true
I1002 20:15:37.505981 134846 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-2","uptime":3487,"bootTime":1759432651,"procs":223,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1041-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1002 20:15:37.506132 134846 start.go:140] virtualization: kvm guest
I1002 20:15:37.508673 134846 out.go:99] [download-only-935488] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
W1002 20:15:37.508898 134846 preload.go:349] Failed to list preload files: open /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball: no such file or directory
I1002 20:15:37.508905 134846 notify.go:220] Checking for updates...
I1002 20:15:37.510491 134846 out.go:171] MINIKUBE_LOCATION=21682
I1002 20:15:37.512060 134846 out.go:171] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1002 20:15:37.513580 134846 out.go:171] KUBECONFIG=/home/jenkins/minikube-integration/21682-131316/kubeconfig
I1002 20:15:37.515121 134846 out.go:171] MINIKUBE_HOME=/home/jenkins/minikube-integration/21682-131316/.minikube
I1002 20:15:37.516590 134846 out.go:171] MINIKUBE_BIN=out/minikube-linux-amd64
W1002 20:15:37.518996 134846 out.go:336] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
I1002 20:15:37.519352 134846 driver.go:421] Setting default libvirt URI to qemu:///system
I1002 20:15:37.543267 134846 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
I1002 20:15:37.543421 134846 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 20:15:37.605703 134846 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:31 OomKillDisable:false NGoroutines:66 SystemTime:2025-10-02 20:15:37.594359314 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1041-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652174848 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-2 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:b98a3aace656320842a23f4a392a33f46af97866 Expected:} RuncCommit:{ID:v1.3.0-0-g4ca628d1 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.29.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.4] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v0.1.40] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1002 20:15:37.605816 134846 docker.go:318] overlay module found
I1002 20:15:37.610018 134846 out.go:99] Using the docker driver based on user configuration
I1002 20:15:37.610057 134846 start.go:304] selected driver: docker
I1002 20:15:37.610064 134846 start.go:924] validating driver "docker" against <nil>
I1002 20:15:37.610158 134846 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 20:15:37.669495 134846 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:31 OomKillDisable:false NGoroutines:66 SystemTime:2025-10-02 20:15:37.658977608 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1041-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652174848 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-2 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:b98a3aace656320842a23f4a392a33f46af97866 Expected:} RuncCommit:{ID:v1.3.0-0-g4ca628d1 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.29.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.4] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v0.1.40] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1002 20:15:37.669779 134846 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I1002 20:15:37.670465 134846 start_flags.go:410] Using suggested 8000MB memory alloc based on sys=32093MB, container=32093MB
I1002 20:15:37.670661 134846 start_flags.go:984] Wait components to verify : map[apiserver:true system_pods:true]
I1002 20:15:37.672732 134846 out.go:171] Using Docker driver with root privileges
I1002 20:15:37.674487 134846 cni.go:84] Creating CNI manager for ""
I1002 20:15:37.674550 134846 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I1002 20:15:37.674560 134846 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
I1002 20:15:37.674656 134846 start.go:348] cluster config:
{Name:download-only-935488 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:8000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.0 ClusterName:download-only-935488 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 20:15:37.676286 134846 out.go:99] Starting "download-only-935488" primary control-plane node in "download-only-935488" cluster
I1002 20:15:37.676321 134846 cache.go:123] Beginning downloading kic base image for docker with containerd
I1002 20:15:37.677892 134846 out.go:99] Pulling base image v0.0.48-1759382731-21643 ...
I1002 20:15:37.677934 134846 preload.go:183] Checking if preload exists for k8s version v1.28.0 and runtime containerd
I1002 20:15:37.678052 134846 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d in local docker daemon
I1002 20:15:37.696042 134846 preload.go:148] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.0/preloaded-images-k8s-v18-v1.28.0-containerd-overlay2-amd64.tar.lz4
I1002 20:15:37.696081 134846 cache.go:58] Caching tarball of preloaded images
I1002 20:15:37.696235 134846 preload.go:183] Checking if preload exists for k8s version v1.28.0 and runtime containerd
I1002 20:15:37.696632 134846 cache.go:152] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d to local cache
I1002 20:15:37.696787 134846 image.go:65] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d in local cache directory
I1002 20:15:37.696934 134846 image.go:150] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d to local cache
I1002 20:15:37.698300 134846 out.go:99] Downloading Kubernetes v1.28.0 preload ...
I1002 20:15:37.698326 134846 preload.go:313] getting checksum for preloaded-images-k8s-v18-v1.28.0-containerd-overlay2-amd64.tar.lz4 from gcs api...
I1002 20:15:37.723463 134846 preload.go:290] Got checksum from GCS API "2746dfda401436a5341e0500068bf339"
I1002 20:15:37.723587 134846 download.go:108] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.0/preloaded-images-k8s-v18-v1.28.0-containerd-overlay2-amd64.tar.lz4?checksum=md5:2746dfda401436a5341e0500068bf339 -> /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-containerd-overlay2-amd64.tar.lz4
I1002 20:15:41.042917 134846 cache.go:61] Finished verifying existence of preloaded tar for v1.28.0 on containerd
I1002 20:15:41.043474 134846 profile.go:143] Saving config to /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/download-only-935488/config.json ...
I1002 20:15:41.043527 134846 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/download-only-935488/config.json: {Name:mk78162974945149af73e83c0d448b84c3bacf71 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1002 20:15:41.043688 134846 preload.go:183] Checking if preload exists for k8s version v1.28.0 and runtime containerd
I1002 20:15:41.043917 134846 download.go:108] Downloading: https://dl.k8s.io/release/v1.28.0/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.0/bin/linux/amd64/kubectl.sha256 -> /home/jenkins/minikube-integration/21682-131316/.minikube/cache/linux/amd64/v1.28.0/kubectl
* The control-plane node download-only-935488 host does not exist
To start a cluster, run: "minikube start -p download-only-935488"
-- /stdout --
aaa_download_only_test.go:184: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.28.0/LogsDuration (0.07s)
=== RUN TestDownloadOnly/v1.28.0/DeleteAll
aaa_download_only_test.go:196: (dbg) Run: out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/v1.28.0/DeleteAll (0.22s)
=== RUN TestDownloadOnly/v1.28.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:207: (dbg) Run: out/minikube-linux-amd64 delete -p download-only-935488
--- PASS: TestDownloadOnly/v1.28.0/DeleteAlwaysSucceeds (0.14s)
=== RUN TestDownloadOnly/v1.34.1/json-events
aaa_download_only_test.go:80: (dbg) Run: out/minikube-linux-amd64 start -o=json --download-only -p download-only-406385 --force --alsologtostderr --kubernetes-version=v1.34.1 --container-runtime=containerd --driver=docker --container-runtime=containerd
aaa_download_only_test.go:80: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-406385 --force --alsologtostderr --kubernetes-version=v1.34.1 --container-runtime=containerd --driver=docker --container-runtime=containerd: (4.884499754s)
--- PASS: TestDownloadOnly/v1.34.1/json-events (4.88s)
=== RUN TestDownloadOnly/v1.34.1/preload-exists
I1002 20:15:48.055298 134834 preload.go:183] Checking if preload exists for k8s version v1.34.1 and runtime containerd
I1002 20:15:48.055352 134834 preload.go:198] Found local preload: /home/jenkins/minikube-integration/21682-131316/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-containerd-overlay2-amd64.tar.lz4
--- PASS: TestDownloadOnly/v1.34.1/preload-exists (0.00s)
=== RUN TestDownloadOnly/v1.34.1/LogsDuration
aaa_download_only_test.go:183: (dbg) Run: out/minikube-linux-amd64 logs -p download-only-406385
aaa_download_only_test.go:183: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-406385: exit status 85 (68.961077ms)
-- stdout --
==> Audit <==
┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ start │ -o=json --download-only -p download-only-935488 --force --alsologtostderr --kubernetes-version=v1.28.0 --container-runtime=containerd --driver=docker --container-runtime=containerd │ download-only-935488 │ jenkins │ v1.37.0 │ 02 Oct 25 20:15 UTC │ │
│ delete │ --all │ minikube │ jenkins │ v1.37.0 │ 02 Oct 25 20:15 UTC │ 02 Oct 25 20:15 UTC │
│ delete │ -p download-only-935488 │ download-only-935488 │ jenkins │ v1.37.0 │ 02 Oct 25 20:15 UTC │ 02 Oct 25 20:15 UTC │
│ start │ -o=json --download-only -p download-only-406385 --force --alsologtostderr --kubernetes-version=v1.34.1 --container-runtime=containerd --driver=docker --container-runtime=containerd │ download-only-406385 │ jenkins │ v1.37.0 │ 02 Oct 25 20:15 UTC │ │
└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/10/02 20:15:43
Running on machine: ubuntu-20-agent-2
Binary: Built with gc go1.24.6 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1002 20:15:43.213968 135198 out.go:360] Setting OutFile to fd 1 ...
I1002 20:15:43.214241 135198 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:15:43.214252 135198 out.go:374] Setting ErrFile to fd 2...
I1002 20:15:43.214256 135198 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:15:43.214541 135198 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:15:43.215090 135198 out.go:368] Setting JSON to true
I1002 20:15:43.216029 135198 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-2","uptime":3492,"bootTime":1759432651,"procs":193,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1041-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1002 20:15:43.216131 135198 start.go:140] virtualization: kvm guest
I1002 20:15:43.218535 135198 out.go:99] [download-only-406385] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1002 20:15:43.218727 135198 notify.go:220] Checking for updates...
I1002 20:15:43.220442 135198 out.go:171] MINIKUBE_LOCATION=21682
I1002 20:15:43.222077 135198 out.go:171] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1002 20:15:43.227252 135198 out.go:171] KUBECONFIG=/home/jenkins/minikube-integration/21682-131316/kubeconfig
I1002 20:15:43.228891 135198 out.go:171] MINIKUBE_HOME=/home/jenkins/minikube-integration/21682-131316/.minikube
I1002 20:15:43.230312 135198 out.go:171] MINIKUBE_BIN=out/minikube-linux-amd64
W1002 20:15:43.232935 135198 out.go:336] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
I1002 20:15:43.233245 135198 driver.go:421] Setting default libvirt URI to qemu:///system
I1002 20:15:43.257879 135198 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
I1002 20:15:43.257980 135198 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 20:15:43.314930 135198 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:31 OomKillDisable:false NGoroutines:54 SystemTime:2025-10-02 20:15:43.304729215 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1041-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652174848 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-2 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:b98a3aace656320842a23f4a392a33f46af97866 Expected:} RuncCommit:{ID:v1.3.0-0-g4ca628d1 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.29.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.4] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v0.1.40] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1002 20:15:43.315037 135198 docker.go:318] overlay module found
I1002 20:15:43.316956 135198 out.go:99] Using the docker driver based on user configuration
I1002 20:15:43.316984 135198 start.go:304] selected driver: docker
I1002 20:15:43.316990 135198 start.go:924] validating driver "docker" against <nil>
I1002 20:15:43.317082 135198 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 20:15:43.375256 135198 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:31 OomKillDisable:false NGoroutines:54 SystemTime:2025-10-02 20:15:43.364181203 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1041-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652174848 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-2 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:b98a3aace656320842a23f4a392a33f46af97866 Expected:} RuncCommit:{ID:v1.3.0-0-g4ca628d1 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.29.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.4] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v0.1.40] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1002 20:15:43.375411 135198 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I1002 20:15:43.375937 135198 start_flags.go:410] Using suggested 8000MB memory alloc based on sys=32093MB, container=32093MB
I1002 20:15:43.376077 135198 start_flags.go:984] Wait components to verify : map[apiserver:true system_pods:true]
I1002 20:15:43.378236 135198 out.go:171] Using Docker driver with root privileges
* The control-plane node download-only-406385 host does not exist
To start a cluster, run: "minikube start -p download-only-406385"
-- /stdout --
aaa_download_only_test.go:184: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.34.1/LogsDuration (0.07s)
=== RUN TestDownloadOnly/v1.34.1/DeleteAll
aaa_download_only_test.go:196: (dbg) Run: out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/v1.34.1/DeleteAll (0.23s)
=== RUN TestDownloadOnly/v1.34.1/DeleteAlwaysSucceeds
aaa_download_only_test.go:207: (dbg) Run: out/minikube-linux-amd64 delete -p download-only-406385
--- PASS: TestDownloadOnly/v1.34.1/DeleteAlwaysSucceeds (0.14s)
=== RUN TestDownloadOnlyKic
aaa_download_only_test.go:231: (dbg) Run: out/minikube-linux-amd64 start --download-only -p download-docker-390089 --alsologtostderr --driver=docker --container-runtime=containerd
helpers_test.go:175: Cleaning up "download-docker-390089" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p download-docker-390089
--- PASS: TestDownloadOnlyKic (0.41s)
=== RUN TestBinaryMirror
I1002 20:15:49.179821 134834 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.34.1/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.34.1/bin/linux/amd64/kubectl.sha256
aaa_download_only_test.go:309: (dbg) Run: out/minikube-linux-amd64 start --download-only -p binary-mirror-102635 --alsologtostderr --binary-mirror http://127.0.0.1:42799 --driver=docker --container-runtime=containerd
helpers_test.go:175: Cleaning up "binary-mirror-102635" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p binary-mirror-102635
--- PASS: TestBinaryMirror (0.82s)
=== RUN TestOffline
=== PAUSE TestOffline
=== CONT TestOffline
aab_offline_test.go:55: (dbg) Run: out/minikube-linux-amd64 start -p offline-containerd-956646 --alsologtostderr -v=1 --memory=3072 --wait=true --driver=docker --container-runtime=containerd
aab_offline_test.go:55: (dbg) Done: out/minikube-linux-amd64 start -p offline-containerd-956646 --alsologtostderr -v=1 --memory=3072 --wait=true --driver=docker --container-runtime=containerd: (1m1.727010669s)
helpers_test.go:175: Cleaning up "offline-containerd-956646" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p offline-containerd-956646
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p offline-containerd-956646: (2.677581428s)
--- PASS: TestOffline (64.40s)
=== RUN TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== CONT TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:1000: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p addons-906277
addons_test.go:1000: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable dashboard -p addons-906277: exit status 85 (55.017276ms)
-- stdout --
* Profile "addons-906277" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p addons-906277"
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.06s)
=== RUN TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== CONT TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:1011: (dbg) Run: out/minikube-linux-amd64 addons disable dashboard -p addons-906277
addons_test.go:1011: (dbg) Non-zero exit: out/minikube-linux-amd64 addons disable dashboard -p addons-906277: exit status 85 (57.800479ms)
-- stdout --
* Profile "addons-906277" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p addons-906277"
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.06s)
=== RUN TestAddons/Setup
addons_test.go:108: (dbg) Run: out/minikube-linux-amd64 start -p addons-906277 --wait=true --memory=4096 --alsologtostderr --addons=registry --addons=registry-creds --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher
addons_test.go:108: (dbg) Done: out/minikube-linux-amd64 start -p addons-906277 --wait=true --memory=4096 --alsologtostderr --addons=registry --addons=registry-creds --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker --container-runtime=containerd --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher: (2m28.872441264s)
--- PASS: TestAddons/Setup (148.87s)
=== RUN TestAddons/serial/Volcano
addons_test.go:884: volcano-controller stabilized in 15.003826ms
addons_test.go:876: volcano-admission stabilized in 15.294344ms
addons_test.go:868: volcano-scheduler stabilized in 15.563528ms
addons_test.go:890: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:352: "volcano-scheduler-76c996c8bf-7hsqp" [eedcf43a-77b7-4ad8-805a-910fc87b4707] Running
addons_test.go:890: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 5.003587825s
addons_test.go:894: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:352: "volcano-admission-6c447bd768-kmngz" [4efe922b-5d19-4317-9ae1-e2d99ad9f004] Running
addons_test.go:894: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.003080115s
addons_test.go:898: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:352: "volcano-controllers-6fd4f85cb8-jdjnw" [109bfe70-2a37-453f-b28c-f7ea4b88ba7a] Running
addons_test.go:898: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.00575102s
addons_test.go:903: (dbg) Run: kubectl --context addons-906277 delete -n volcano-system job volcano-admission-init
addons_test.go:909: (dbg) Run: kubectl --context addons-906277 create -f testdata/vcjob.yaml
addons_test.go:917: (dbg) Run: kubectl --context addons-906277 get vcjob -n my-volcano
addons_test.go:935: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:352: "test-job-nginx-0" [d5dd6cb9-af0b-4335-ba54-e3a6f786a7c5] Pending
helpers_test.go:352: "test-job-nginx-0" [d5dd6cb9-af0b-4335-ba54-e3a6f786a7c5] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:352: "test-job-nginx-0" [d5dd6cb9-af0b-4335-ba54-e3a6f786a7c5] Running
addons_test.go:935: (dbg) TestAddons/serial/Volcano: volcano.sh/job-name=test-job healthy within 14.003208774s
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 addons disable volcano --alsologtostderr -v=1
addons_test.go:1053: (dbg) Done: out/minikube-linux-amd64 -p addons-906277 addons disable volcano --alsologtostderr -v=1: (11.901526415s)
--- PASS: TestAddons/serial/Volcano (41.37s)
=== RUN TestAddons/serial/GCPAuth/Namespaces
addons_test.go:630: (dbg) Run: kubectl --context addons-906277 create ns new-namespace
addons_test.go:644: (dbg) Run: kubectl --context addons-906277 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.12s)
=== RUN TestAddons/serial/GCPAuth/FakeCredentials
addons_test.go:675: (dbg) Run: kubectl --context addons-906277 create -f testdata/busybox.yaml
addons_test.go:682: (dbg) Run: kubectl --context addons-906277 create sa gcp-auth-test
addons_test.go:688: (dbg) TestAddons/serial/GCPAuth/FakeCredentials: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:352: "busybox" [b1e6805c-370e-45c6-a995-5d147f064a3c] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "busybox" [b1e6805c-370e-45c6-a995-5d147f064a3c] Running
addons_test.go:688: (dbg) TestAddons/serial/GCPAuth/FakeCredentials: integration-test=busybox healthy within 8.003967982s
addons_test.go:694: (dbg) Run: kubectl --context addons-906277 exec busybox -- /bin/sh -c "printenv GOOGLE_APPLICATION_CREDENTIALS"
addons_test.go:706: (dbg) Run: kubectl --context addons-906277 describe sa gcp-auth-test
addons_test.go:744: (dbg) Run: kubectl --context addons-906277 exec busybox -- /bin/sh -c "printenv GOOGLE_CLOUD_PROJECT"
--- PASS: TestAddons/serial/GCPAuth/FakeCredentials (8.48s)
=== RUN TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry
=== CONT TestAddons/parallel/Registry
addons_test.go:382: registry stabilized in 3.493195ms
addons_test.go:384: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:352: "registry-66898fdd98-4frqj" [331ee31b-e6fd-4369-a058-449f052f9b79] Running
addons_test.go:384: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.00270091s
addons_test.go:387: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:352: "registry-proxy-hpbjd" [8b8e0ab8-7b52-4678-baea-84f7c5981130] Running
addons_test.go:387: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 6.00410194s
addons_test.go:392: (dbg) Run: kubectl --context addons-906277 delete po -l run=registry-test --now
addons_test.go:397: (dbg) Run: kubectl --context addons-906277 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:397: (dbg) Done: kubectl --context addons-906277 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.77238512s)
addons_test.go:411: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 ip
2025/10/02 20:19:32 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (15.61s)
=== RUN TestAddons/parallel/RegistryCreds
=== PAUSE TestAddons/parallel/RegistryCreds
=== CONT TestAddons/parallel/RegistryCreds
addons_test.go:323: registry-creds stabilized in 2.904586ms
addons_test.go:325: (dbg) Run: out/minikube-linux-amd64 addons configure registry-creds -f ./testdata/addons_testconfig.json -p addons-906277
addons_test.go:332: (dbg) Run: kubectl --context addons-906277 -n kube-system get secret -o yaml
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 addons disable registry-creds --alsologtostderr -v=1
--- PASS: TestAddons/parallel/RegistryCreds (0.67s)
=== RUN TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress
=== CONT TestAddons/parallel/Ingress
addons_test.go:209: (dbg) Run: kubectl --context addons-906277 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:234: (dbg) Run: kubectl --context addons-906277 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:247: (dbg) Run: kubectl --context addons-906277 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:352: "nginx" [dcb15765-c878-467d-977a-1984e46a17e7] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:352: "nginx" [dcb15765-c878-467d-977a-1984e46a17e7] Running
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 9.003655154s
I1002 20:19:33.037187 134834 kapi.go:150] Service nginx in namespace default found.
addons_test.go:264: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:288: (dbg) Run: kubectl --context addons-906277 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:293: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 ip
addons_test.go:299: (dbg) Run: nslookup hello-john.test 192.168.49.2
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:1053: (dbg) Done: out/minikube-linux-amd64 -p addons-906277 addons disable ingress-dns --alsologtostderr -v=1: (1.659104185s)
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 addons disable ingress --alsologtostderr -v=1
addons_test.go:1053: (dbg) Done: out/minikube-linux-amd64 -p addons-906277 addons disable ingress --alsologtostderr -v=1: (7.765998003s)
--- PASS: TestAddons/parallel/Ingress (19.83s)
=== RUN TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget
=== CONT TestAddons/parallel/InspektorGadget
addons_test.go:823: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:352: "gadget-bdw4j" [5bfe474f-8564-4189-8c28-05704b005a33] Running
addons_test.go:823: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 6.003894903s
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 addons disable inspektor-gadget --alsologtostderr -v=1
--- PASS: TestAddons/parallel/InspektorGadget (6.28s)
=== RUN TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer
=== CONT TestAddons/parallel/MetricsServer
addons_test.go:455: metrics-server stabilized in 2.813516ms
addons_test.go:457: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:352: "metrics-server-85b7d694d7-sq7g8" [5abf98b6-ad6a-447a-a59f-c3a424681a2f] Running
addons_test.go:457: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.002673497s
addons_test.go:463: (dbg) Run: kubectl --context addons-906277 top pods -n kube-system
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.74s)
=== RUN TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI
=== CONT TestAddons/parallel/CSI
I1002 20:19:30.354652 134834 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I1002 20:19:30.357622 134834 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I1002 20:19:30.357649 134834 kapi.go:107] duration metric: took 3.00776ms to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
addons_test.go:549: csi-hostpath-driver pods stabilized in 3.017369ms
addons_test.go:552: (dbg) Run: kubectl --context addons-906277 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:557: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:562: (dbg) Run: kubectl --context addons-906277 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:567: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:352: "task-pv-pod" [b93f3163-e929-4c82-b30a-1ff12f336aa6] Pending
helpers_test.go:352: "task-pv-pod" [b93f3163-e929-4c82-b30a-1ff12f336aa6] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:352: "task-pv-pod" [b93f3163-e929-4c82-b30a-1ff12f336aa6] Running
addons_test.go:567: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 8.003448614s
addons_test.go:572: (dbg) Run: kubectl --context addons-906277 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:577: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:427: (dbg) Run: kubectl --context addons-906277 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:427: (dbg) Run: kubectl --context addons-906277 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:582: (dbg) Run: kubectl --context addons-906277 delete pod task-pv-pod
addons_test.go:588: (dbg) Run: kubectl --context addons-906277 delete pvc hpvc
addons_test.go:594: (dbg) Run: kubectl --context addons-906277 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:599: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:604: (dbg) Run: kubectl --context addons-906277 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:609: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:352: "task-pv-pod-restore" [df3547a3-a94e-4a57-81d7-50167055a9a5] Pending
helpers_test.go:352: "task-pv-pod-restore" [df3547a3-a94e-4a57-81d7-50167055a9a5] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:352: "task-pv-pod-restore" [df3547a3-a94e-4a57-81d7-50167055a9a5] Running
addons_test.go:609: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.004305022s
addons_test.go:614: (dbg) Run: kubectl --context addons-906277 delete pod task-pv-pod-restore
addons_test.go:618: (dbg) Run: kubectl --context addons-906277 delete pvc hpvc-restore
addons_test.go:622: (dbg) Run: kubectl --context addons-906277 delete volumesnapshot new-snapshot-demo
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 addons disable volumesnapshots --alsologtostderr -v=1
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:1053: (dbg) Done: out/minikube-linux-amd64 -p addons-906277 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.582996127s)
--- PASS: TestAddons/parallel/CSI (45.98s)
=== RUN TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp
=== CONT TestAddons/parallel/Headlamp
addons_test.go:808: (dbg) Run: out/minikube-linux-amd64 addons enable headlamp -p addons-906277 --alsologtostderr -v=1
addons_test.go:813: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:352: "headlamp-85f8f8dc54-zrfgn" [e30ad051-7719-4a7c-85b9-d57ae8766a68] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:352: "headlamp-85f8f8dc54-zrfgn" [e30ad051-7719-4a7c-85b9-d57ae8766a68] Running / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:352: "headlamp-85f8f8dc54-zrfgn" [e30ad051-7719-4a7c-85b9-d57ae8766a68] Running
addons_test.go:813: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 10.003105952s
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 addons disable headlamp --alsologtostderr -v=1
addons_test.go:1053: (dbg) Done: out/minikube-linux-amd64 -p addons-906277 addons disable headlamp --alsologtostderr -v=1: (5.809874231s)
--- PASS: TestAddons/parallel/Headlamp (16.58s)
=== RUN TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner
=== CONT TestAddons/parallel/CloudSpanner
addons_test.go:840: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:352: "cloud-spanner-emulator-85f6b7fc65-2kzwz" [142468ce-d42d-4007-a9d8-04d0e9e80cd0] Running
addons_test.go:840: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.003056069s
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 addons disable cloud-spanner --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CloudSpanner (5.55s)
=== RUN TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath
=== CONT TestAddons/parallel/LocalPath
addons_test.go:949: (dbg) Run: kubectl --context addons-906277 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:955: (dbg) Run: kubectl --context addons-906277 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:959: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run: kubectl --context addons-906277 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:962: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:352: "test-local-path" [22c9b861-3ca2-46ee-b9b6-9a120a2017e3] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "test-local-path" [22c9b861-3ca2-46ee-b9b6-9a120a2017e3] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:352: "test-local-path" [22c9b861-3ca2-46ee-b9b6-9a120a2017e3] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:962: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 4.003663585s
addons_test.go:967: (dbg) Run: kubectl --context addons-906277 get pvc test-pvc -o=json
addons_test.go:976: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 ssh "cat /opt/local-path-provisioner/pvc-a444bd9c-490e-4ceb-a098-75b7d11de164_default_test-pvc/file1"
addons_test.go:988: (dbg) Run: kubectl --context addons-906277 delete pod test-local-path
addons_test.go:992: (dbg) Run: kubectl --context addons-906277 delete pvc test-pvc
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:1053: (dbg) Done: out/minikube-linux-amd64 -p addons-906277 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (42.766142937s)
--- PASS: TestAddons/parallel/LocalPath (53.67s)
=== RUN TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin
=== CONT TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:1025: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:352: "nvidia-device-plugin-daemonset-8xdg9" [af6afb2c-9daf-486a-8a46-a8b240ffee1f] Running
addons_test.go:1025: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 5.003452912s
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 addons disable nvidia-device-plugin --alsologtostderr -v=1
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (5.55s)
=== RUN TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd
=== CONT TestAddons/parallel/Yakd
addons_test.go:1047: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:352: "yakd-dashboard-5ff678cb9-whn9x" [4aab48f8-2913-4038-9eb7-ecf7f9bf8639] Running
addons_test.go:1047: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 6.002861784s
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 addons disable yakd --alsologtostderr -v=1
addons_test.go:1053: (dbg) Done: out/minikube-linux-amd64 -p addons-906277 addons disable yakd --alsologtostderr -v=1: (5.72663845s)
--- PASS: TestAddons/parallel/Yakd (11.73s)
=== RUN TestAddons/parallel/AmdGpuDevicePlugin
=== PAUSE TestAddons/parallel/AmdGpuDevicePlugin
=== CONT TestAddons/parallel/AmdGpuDevicePlugin
addons_test.go:1038: (dbg) TestAddons/parallel/AmdGpuDevicePlugin: waiting 6m0s for pods matching "name=amd-gpu-device-plugin" in namespace "kube-system" ...
helpers_test.go:352: "amd-gpu-device-plugin-rhcbw" [1129f4f8-bc66-488c-b693-963d10e36ab1] Running
addons_test.go:1038: (dbg) TestAddons/parallel/AmdGpuDevicePlugin: name=amd-gpu-device-plugin healthy within 6.003206829s
addons_test.go:1053: (dbg) Run: out/minikube-linux-amd64 -p addons-906277 addons disable amd-gpu-device-plugin --alsologtostderr -v=1
--- PASS: TestAddons/parallel/AmdGpuDevicePlugin (6.49s)
=== RUN TestAddons/StoppedEnableDisable
addons_test.go:172: (dbg) Run: out/minikube-linux-amd64 stop -p addons-906277
addons_test.go:172: (dbg) Done: out/minikube-linux-amd64 stop -p addons-906277: (12.541348779s)
addons_test.go:176: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p addons-906277
addons_test.go:180: (dbg) Run: out/minikube-linux-amd64 addons disable dashboard -p addons-906277
addons_test.go:185: (dbg) Run: out/minikube-linux-amd64 addons disable gvisor -p addons-906277
--- PASS: TestAddons/StoppedEnableDisable (12.80s)
=== RUN TestCertOptions
=== PAUSE TestCertOptions
=== CONT TestCertOptions
cert_options_test.go:49: (dbg) Run: out/minikube-linux-amd64 start -p cert-options-304957 --memory=3072 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker --container-runtime=containerd
cert_options_test.go:49: (dbg) Done: out/minikube-linux-amd64 start -p cert-options-304957 --memory=3072 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker --container-runtime=containerd: (23.044252461s)
cert_options_test.go:60: (dbg) Run: out/minikube-linux-amd64 -p cert-options-304957 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run: kubectl --context cert-options-304957 config view
cert_options_test.go:100: (dbg) Run: out/minikube-linux-amd64 ssh -p cert-options-304957 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-304957" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p cert-options-304957
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p cert-options-304957: (1.986536752s)
--- PASS: TestCertOptions (25.69s)
=== RUN TestCertExpiration
=== PAUSE TestCertExpiration
=== CONT TestCertExpiration
cert_options_test.go:123: (dbg) Run: out/minikube-linux-amd64 start -p cert-expiration-008968 --memory=3072 --cert-expiration=3m --driver=docker --container-runtime=containerd
cert_options_test.go:123: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-008968 --memory=3072 --cert-expiration=3m --driver=docker --container-runtime=containerd: (26.838061273s)
cert_options_test.go:131: (dbg) Run: out/minikube-linux-amd64 start -p cert-expiration-008968 --memory=3072 --cert-expiration=8760h --driver=docker --container-runtime=containerd
cert_options_test.go:131: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-008968 --memory=3072 --cert-expiration=8760h --driver=docker --container-runtime=containerd: (7.050547911s)
helpers_test.go:175: Cleaning up "cert-expiration-008968" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p cert-expiration-008968
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p cert-expiration-008968: (2.499296598s)
--- PASS: TestCertExpiration (216.39s)
=== RUN TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag
=== CONT TestForceSystemdFlag
docker_test.go:91: (dbg) Run: out/minikube-linux-amd64 start -p force-systemd-flag-756548 --memory=3072 --force-systemd --alsologtostderr -v=5 --driver=docker --container-runtime=containerd
docker_test.go:91: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-flag-756548 --memory=3072 --force-systemd --alsologtostderr -v=5 --driver=docker --container-runtime=containerd: (26.773940763s)
docker_test.go:121: (dbg) Run: out/minikube-linux-amd64 -p force-systemd-flag-756548 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-flag-756548" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p force-systemd-flag-756548
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-flag-756548: (2.012065566s)
--- PASS: TestForceSystemdFlag (29.08s)
=== RUN TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv
=== CONT TestForceSystemdEnv
docker_test.go:155: (dbg) Run: out/minikube-linux-amd64 start -p force-systemd-env-971508 --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=containerd
docker_test.go:155: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-env-971508 --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=containerd: (36.658945324s)
docker_test.go:121: (dbg) Run: out/minikube-linux-amd64 -p force-systemd-env-971508 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-env-971508" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p force-systemd-env-971508
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-env-971508: (2.813866212s)
--- PASS: TestForceSystemdEnv (39.94s)
=== RUN TestDockerEnvContainerd
docker_test.go:170: running with containerd true linux amd64
docker_test.go:181: (dbg) Run: out/minikube-linux-amd64 start -p dockerenv-043623 --driver=docker --container-runtime=containerd
docker_test.go:181: (dbg) Done: out/minikube-linux-amd64 start -p dockerenv-043623 --driver=docker --container-runtime=containerd: (21.628322829s)
docker_test.go:189: (dbg) Run: /bin/bash -c "out/minikube-linux-amd64 docker-env --ssh-host --ssh-add -p dockerenv-043623"
docker_test.go:189: (dbg) Done: /bin/bash -c "out/minikube-linux-amd64 docker-env --ssh-host --ssh-add -p dockerenv-043623": (1.034412252s)
docker_test.go:220: (dbg) Run: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-XXXXXXqK2R8c/agent.161086" SSH_AGENT_PID="161087" DOCKER_HOST=ssh://docker@127.0.0.1:32893 docker version"
docker_test.go:243: (dbg) Run: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-XXXXXXqK2R8c/agent.161086" SSH_AGENT_PID="161087" DOCKER_HOST=ssh://docker@127.0.0.1:32893 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env"
docker_test.go:243: (dbg) Done: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-XXXXXXqK2R8c/agent.161086" SSH_AGENT_PID="161087" DOCKER_HOST=ssh://docker@127.0.0.1:32893 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env": (1.729327235s)
docker_test.go:250: (dbg) Run: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-XXXXXXqK2R8c/agent.161086" SSH_AGENT_PID="161087" DOCKER_HOST=ssh://docker@127.0.0.1:32893 docker image ls"
helpers_test.go:175: Cleaning up "dockerenv-043623" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p dockerenv-043623
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p dockerenv-043623: (1.964098222s)
--- PASS: TestDockerEnvContainerd (37.34s)
=== RUN TestKVMDriverInstallOrUpdate
=== PAUSE TestKVMDriverInstallOrUpdate
=== CONT TestKVMDriverInstallOrUpdate
I1002 20:47:11.488732 134834 install.go:66] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1002 20:47:11.488945 134834 install.go:138] Validating docker-machine-driver-kvm2, PATH=/tmp/TestKVMDriverInstallOrUpdate2875409696/001:/home/jenkins/workspace/Docker_Linux_containerd_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I1002 20:47:11.517970 134834 install.go:163] /tmp/TestKVMDriverInstallOrUpdate2875409696/001/docker-machine-driver-kvm2 version is 1.1.1
W1002 20:47:11.518026 134834 install.go:76] docker-machine-driver-kvm2: docker-machine-driver-kvm2 is version 1.1.1, want 1.37.0
W1002 20:47:11.518129 134834 out.go:176] [unset outFile]: * Downloading driver docker-machine-driver-kvm2:
I1002 20:47:11.518170 134834 download.go:108] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.37.0/docker-machine-driver-kvm2-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.37.0/docker-machine-driver-kvm2-amd64.sha256 -> /tmp/TestKVMDriverInstallOrUpdate2875409696/001/docker-machine-driver-kvm2
I1002 20:47:12.176592 134834 install.go:138] Validating docker-machine-driver-kvm2, PATH=/tmp/TestKVMDriverInstallOrUpdate2875409696/001:/home/jenkins/workspace/Docker_Linux_containerd_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I1002 20:47:12.192329 134834 install.go:163] /tmp/TestKVMDriverInstallOrUpdate2875409696/001/docker-machine-driver-kvm2 version is 1.37.0
--- PASS: TestKVMDriverInstallOrUpdate (0.87s)
=== RUN TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run: out/minikube-linux-amd64 start -p nospam-336289 -n=1 --memory=3072 --wait=false --log_dir=/tmp/nospam-336289 --driver=docker --container-runtime=containerd
error_spam_test.go:81: (dbg) Done: out/minikube-linux-amd64 start -p nospam-336289 -n=1 --memory=3072 --wait=false --log_dir=/tmp/nospam-336289 --driver=docker --container-runtime=containerd: (20.70696754s)
--- PASS: TestErrorSpam/setup (20.71s)
=== RUN TestErrorSpam/start
error_spam_test.go:206: Cleaning up 1 logfile(s) ...
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 start --dry-run
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 start --dry-run
error_spam_test.go:172: (dbg) Run: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 start --dry-run
--- PASS: TestErrorSpam/start (0.68s)
=== RUN TestErrorSpam/status
error_spam_test.go:206: Cleaning up 0 logfile(s) ...
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 status
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 status
error_spam_test.go:172: (dbg) Run: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 status
--- PASS: TestErrorSpam/status (0.97s)
=== RUN TestErrorSpam/pause
error_spam_test.go:206: Cleaning up 0 logfile(s) ...
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 pause
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 pause
error_spam_test.go:172: (dbg) Run: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 pause
--- PASS: TestErrorSpam/pause (1.50s)
=== RUN TestErrorSpam/unpause
error_spam_test.go:206: Cleaning up 0 logfile(s) ...
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 unpause
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 unpause
error_spam_test.go:172: (dbg) Run: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 unpause
--- PASS: TestErrorSpam/unpause (1.56s)
=== RUN TestErrorSpam/stop
error_spam_test.go:206: Cleaning up 0 logfile(s) ...
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 stop
error_spam_test.go:149: (dbg) Done: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 stop: (1.234628034s)
error_spam_test.go:149: (dbg) Run: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 stop
error_spam_test.go:172: (dbg) Run: out/minikube-linux-amd64 -p nospam-336289 --log_dir /tmp/nospam-336289 stop
--- PASS: TestErrorSpam/stop (1.43s)
=== RUN TestFunctional/serial/CopySyncFile
functional_test.go:1860: local sync path: /home/jenkins/minikube-integration/21682-131316/.minikube/files/etc/test/nested/copy/134834/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)
=== RUN TestFunctional/serial/StartWithProxy
functional_test.go:2239: (dbg) Run: out/minikube-linux-amd64 start -p functional-873823 --memory=4096 --apiserver-port=8441 --wait=all --driver=docker --container-runtime=containerd
functional_test.go:2239: (dbg) Done: out/minikube-linux-amd64 start -p functional-873823 --memory=4096 --apiserver-port=8441 --wait=all --driver=docker --container-runtime=containerd: (39.456227912s)
--- PASS: TestFunctional/serial/StartWithProxy (39.46s)
=== RUN TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)
=== RUN TestFunctional/serial/SoftStart
I1002 20:22:40.259189 134834 config.go:182] Loaded profile config "functional-873823": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
functional_test.go:674: (dbg) Run: out/minikube-linux-amd64 start -p functional-873823 --alsologtostderr -v=8
functional_test.go:674: (dbg) Done: out/minikube-linux-amd64 start -p functional-873823 --alsologtostderr -v=8: (6.221051133s)
functional_test.go:678: soft start took 6.221911043s for "functional-873823" cluster.
I1002 20:22:46.480741 134834 config.go:182] Loaded profile config "functional-873823": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
--- PASS: TestFunctional/serial/SoftStart (6.22s)
=== RUN TestFunctional/serial/KubeContext
functional_test.go:696: (dbg) Run: kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.05s)
=== RUN TestFunctional/serial/KubectlGetPods
functional_test.go:711: (dbg) Run: kubectl --context functional-873823 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.08s)
=== RUN TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1064: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 cache add registry.k8s.io/pause:3.1
functional_test.go:1064: (dbg) Done: out/minikube-linux-amd64 -p functional-873823 cache add registry.k8s.io/pause:3.1: (1.015723252s)
functional_test.go:1064: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 cache add registry.k8s.io/pause:3.3
functional_test.go:1064: (dbg) Done: out/minikube-linux-amd64 -p functional-873823 cache add registry.k8s.io/pause:3.3: (1.00372904s)
functional_test.go:1064: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 cache add registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (2.95s)
=== RUN TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1092: (dbg) Run: docker build -t minikube-local-cache-test:functional-873823 /tmp/TestFunctionalserialCacheCmdcacheadd_local351621967/001
functional_test.go:1104: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 cache add minikube-local-cache-test:functional-873823
functional_test.go:1104: (dbg) Done: out/minikube-linux-amd64 -p functional-873823 cache add minikube-local-cache-test:functional-873823: (1.469589805s)
functional_test.go:1109: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 cache delete minikube-local-cache-test:functional-873823
functional_test.go:1098: (dbg) Run: docker rmi minikube-local-cache-test:functional-873823
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.84s)
=== RUN TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1117: (dbg) Run: out/minikube-linux-amd64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.05s)
=== RUN TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1125: (dbg) Run: out/minikube-linux-amd64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.05s)
=== RUN TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1139: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.30s)
=== RUN TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1162: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh sudo crictl rmi registry.k8s.io/pause:latest
functional_test.go:1168: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1168: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-873823 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (283.971965ms)
-- stdout --
[31mFATA[0m[0000] no such image "registry.k8s.io/pause:latest" present
-- /stdout --
** stderr **
ssh: Process exited with status 1
** /stderr **
functional_test.go:1173: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 cache reload
functional_test.go:1178: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (1.67s)
=== RUN TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1187: (dbg) Run: out/minikube-linux-amd64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1187: (dbg) Run: out/minikube-linux-amd64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.11s)
=== RUN TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:731: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 kubectl -- --context functional-873823 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.12s)
=== RUN TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:756: (dbg) Run: out/kubectl --context functional-873823 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.11s)
=== RUN TestFunctional/serial/ExtraConfig
functional_test.go:772: (dbg) Run: out/minikube-linux-amd64 start -p functional-873823 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E1002 20:23:18.939764 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:23:18.946269 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:23:18.957672 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:23:18.979195 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:23:19.020673 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:23:19.102139 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:23:19.263693 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:23:19.585463 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:23:20.227100 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:23:21.509049 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:23:24.071953 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:23:29.193471 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
functional_test.go:772: (dbg) Done: out/minikube-linux-amd64 start -p functional-873823 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (41.542235151s)
functional_test.go:776: restart took 41.542379293s for "functional-873823" cluster.
I1002 20:23:35.348285 134834 config.go:182] Loaded profile config "functional-873823": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
--- PASS: TestFunctional/serial/ExtraConfig (41.54s)
=== RUN TestFunctional/serial/ComponentHealth
functional_test.go:825: (dbg) Run: kubectl --context functional-873823 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:840: etcd phase: Running
functional_test.go:850: etcd status: Ready
functional_test.go:840: kube-apiserver phase: Running
functional_test.go:850: kube-apiserver status: Ready
functional_test.go:840: kube-controller-manager phase: Running
functional_test.go:850: kube-controller-manager status: Ready
functional_test.go:840: kube-scheduler phase: Running
functional_test.go:850: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.07s)
=== RUN TestFunctional/serial/LogsCmd
functional_test.go:1251: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 logs
functional_test.go:1251: (dbg) Done: out/minikube-linux-amd64 -p functional-873823 logs: (1.285557575s)
--- PASS: TestFunctional/serial/LogsCmd (1.29s)
=== RUN TestFunctional/serial/LogsFileCmd
functional_test.go:1265: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 logs --file /tmp/TestFunctionalserialLogsFileCmd3763036473/001/logs.txt
functional_test.go:1265: (dbg) Done: out/minikube-linux-amd64 -p functional-873823 logs --file /tmp/TestFunctionalserialLogsFileCmd3763036473/001/logs.txt: (1.300009016s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.30s)
=== RUN TestFunctional/serial/InvalidService
functional_test.go:2326: (dbg) Run: kubectl --context functional-873823 apply -f testdata/invalidsvc.yaml
E1002 20:23:39.435059 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
functional_test.go:2340: (dbg) Run: out/minikube-linux-amd64 service invalid-svc -p functional-873823
functional_test.go:2340: (dbg) Non-zero exit: out/minikube-linux-amd64 service invalid-svc -p functional-873823: exit status 115 (355.77421ms)
-- stdout --
┌───────────┬─────────────┬─────────────┬───────────────────────────┐
│ NAMESPACE │ NAME │ TARGET PORT │ URL │
├───────────┼─────────────┼─────────────┼───────────────────────────┤
│ default │ invalid-svc │ 80 │ http://192.168.49.2:32207 │
└───────────┴─────────────┴─────────────┴───────────────────────────┘
-- /stdout --
** stderr **
X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
functional_test.go:2332: (dbg) Run: kubectl --context functional-873823 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (3.87s)
=== RUN TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd
=== CONT TestFunctional/parallel/ConfigCmd
functional_test.go:1214: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 config unset cpus
functional_test.go:1214: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 config get cpus
functional_test.go:1214: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-873823 config get cpus: exit status 14 (81.26454ms)
** stderr **
Error: specified key could not be found in config
** /stderr **
functional_test.go:1214: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 config set cpus 2
functional_test.go:1214: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 config get cpus
functional_test.go:1214: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 config unset cpus
functional_test.go:1214: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 config get cpus
functional_test.go:1214: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-873823 config get cpus: exit status 14 (56.969269ms)
** stderr **
Error: specified key could not be found in config
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.40s)
=== RUN TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd
=== CONT TestFunctional/parallel/DashboardCmd
functional_test.go:920: (dbg) daemon: [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-873823 --alsologtostderr -v=1]
functional_test.go:925: (dbg) stopping [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-873823 --alsologtostderr -v=1] ...
helpers_test.go:525: unable to kill pid 182523: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (14.13s)
=== RUN TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun
=== CONT TestFunctional/parallel/DryRun
functional_test.go:989: (dbg) Run: out/minikube-linux-amd64 start -p functional-873823 --dry-run --memory 250MB --alsologtostderr --driver=docker --container-runtime=containerd
functional_test.go:989: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-873823 --dry-run --memory 250MB --alsologtostderr --driver=docker --container-runtime=containerd: exit status 23 (221.523995ms)
-- stdout --
* [functional-873823] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
- MINIKUBE_LOCATION=21682
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/21682-131316/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/21682-131316/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the docker driver based on existing profile
-- /stdout --
** stderr **
I1002 20:23:55.838453 180581 out.go:360] Setting OutFile to fd 1 ...
I1002 20:23:55.838743 180581 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:23:55.838755 180581 out.go:374] Setting ErrFile to fd 2...
I1002 20:23:55.838762 180581 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:23:55.839062 180581 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:23:55.839632 180581 out.go:368] Setting JSON to false
I1002 20:23:55.840869 180581 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-2","uptime":3985,"bootTime":1759432651,"procs":259,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1041-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1002 20:23:55.840977 180581 start.go:140] virtualization: kvm guest
I1002 20:23:55.845312 180581 out.go:179] * [functional-873823] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1002 20:23:55.846952 180581 notify.go:220] Checking for updates...
I1002 20:23:55.848296 180581 out.go:179] - MINIKUBE_LOCATION=21682
I1002 20:23:55.849551 180581 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1002 20:23:55.854991 180581 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21682-131316/kubeconfig
I1002 20:23:55.857292 180581 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21682-131316/.minikube
I1002 20:23:55.859600 180581 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1002 20:23:55.861142 180581 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1002 20:23:55.864013 180581 config.go:182] Loaded profile config "functional-873823": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:23:55.864718 180581 driver.go:421] Setting default libvirt URI to qemu:///system
I1002 20:23:55.900455 180581 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
I1002 20:23:55.900566 180581 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 20:23:55.988867 180581 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:38 OomKillDisable:false NGoroutines:58 SystemTime:2025-10-02 20:23:55.976440331 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1041-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652174848 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-2 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:b98a3aace656320842a23f4a392a33f46af97866 Expected:} RuncCommit:{ID:v1.3.0-0-g4ca628d1 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.29.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.4] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v0.1.40] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1002 20:23:55.989023 180581 docker.go:318] overlay module found
I1002 20:23:55.991089 180581 out.go:179] * Using the docker driver based on existing profile
I1002 20:23:55.992532 180581 start.go:304] selected driver: docker
I1002 20:23:55.992550 180581 start.go:924] validating driver "docker" against &{Name:functional-873823 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:functional-873823 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpt
ions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 20:23:55.992646 180581 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1002 20:23:55.994749 180581 out.go:203]
W1002 20:23:55.996209 180581 out.go:285] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
I1002 20:23:55.997879 180581 out.go:203]
** /stderr **
functional_test.go:1006: (dbg) Run: out/minikube-linux-amd64 start -p functional-873823 --dry-run --alsologtostderr -v=1 --driver=docker --container-runtime=containerd
--- PASS: TestFunctional/parallel/DryRun (0.46s)
=== RUN TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage
=== CONT TestFunctional/parallel/InternationalLanguage
functional_test.go:1035: (dbg) Run: out/minikube-linux-amd64 start -p functional-873823 --dry-run --memory 250MB --alsologtostderr --driver=docker --container-runtime=containerd
functional_test.go:1035: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-873823 --dry-run --memory 250MB --alsologtostderr --driver=docker --container-runtime=containerd: exit status 23 (208.727626ms)
-- stdout --
* [functional-873823] minikube v1.37.0 sur Ubuntu 22.04 (kvm/amd64)
- MINIKUBE_LOCATION=21682
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/21682-131316/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/21682-131316/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Utilisation du pilote docker basé sur le profil existant
-- /stdout --
** stderr **
I1002 20:23:55.850758 180588 out.go:360] Setting OutFile to fd 1 ...
I1002 20:23:55.850910 180588 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:23:55.850923 180588 out.go:374] Setting ErrFile to fd 2...
I1002 20:23:55.850929 180588 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:23:55.851452 180588 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:23:55.852110 180588 out.go:368] Setting JSON to false
I1002 20:23:55.853532 180588 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-2","uptime":3985,"bootTime":1759432651,"procs":259,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1041-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1002 20:23:55.853669 180588 start.go:140] virtualization: kvm guest
I1002 20:23:55.856067 180588 out.go:179] * [functional-873823] minikube v1.37.0 sur Ubuntu 22.04 (kvm/amd64)
I1002 20:23:55.857477 180588 notify.go:220] Checking for updates...
I1002 20:23:55.858301 180588 out.go:179] - MINIKUBE_LOCATION=21682
I1002 20:23:55.861017 180588 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1002 20:23:55.862695 180588 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21682-131316/kubeconfig
I1002 20:23:55.864207 180588 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21682-131316/.minikube
I1002 20:23:55.865493 180588 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1002 20:23:55.867131 180588 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1002 20:23:55.868838 180588 config.go:182] Loaded profile config "functional-873823": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:23:55.869546 180588 driver.go:421] Setting default libvirt URI to qemu:///system
I1002 20:23:55.899804 180588 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
I1002 20:23:55.900016 180588 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 20:23:55.987996 180588 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:38 OomKillDisable:false NGoroutines:58 SystemTime:2025-10-02 20:23:55.976440331 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1041-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652174848 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-2 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:b98a3aace656320842a23f4a392a33f46af97866 Expected:} RuncCommit:{ID:v1.3.0-0-g4ca628d1 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.29.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.4] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v0.1.40] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1002 20:23:55.988100 180588 docker.go:318] overlay module found
I1002 20:23:55.990111 180588 out.go:179] * Utilisation du pilote docker basé sur le profil existant
I1002 20:23:55.991894 180588 start.go:304] selected driver: docker
I1002 20:23:55.991915 180588 start.go:924] validating driver "docker" against &{Name:functional-873823 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1759382731-21643@sha256:ca1b4db171879edd6bbb9546a4b1afac2eb5be94a0f5528496e62d2ff99de37d Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:functional-873823 Namespace:default APIServerHAVIP: APIServerNa
me:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.34.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOpt
ions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1002 20:23:55.992037 180588 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1002 20:23:55.993892 180588 out.go:203]
W1002 20:23:55.995496 180588 out.go:285] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
I1002 20:23:55.996956 180588 out.go:203]
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.21s)
=== RUN TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd
=== CONT TestFunctional/parallel/StatusCmd
functional_test.go:869: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 status
functional_test.go:875: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:887: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.14s)
=== RUN TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect
=== CONT TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1636: (dbg) Run: kubectl --context functional-873823 create deployment hello-node-connect --image kicbase/echo-server
functional_test.go:1640: (dbg) Run: kubectl --context functional-873823 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1645: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:352: "hello-node-connect-7d85dfc575-6bg7d" [313b6fec-0f4e-4b64-bb8b-17b05e9f7d9d] Pending / Ready:ContainersNotReady (containers with unready status: [echo-server]) / ContainersReady:ContainersNotReady (containers with unready status: [echo-server])
helpers_test.go:352: "hello-node-connect-7d85dfc575-6bg7d" [313b6fec-0f4e-4b64-bb8b-17b05e9f7d9d] Running
functional_test.go:1645: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 9.00390942s
functional_test.go:1654: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 service hello-node-connect --url
functional_test.go:1660: found endpoint for hello-node-connect: http://192.168.49.2:30857
functional_test.go:1680: http://192.168.49.2:30857: success! body:
Request served by hello-node-connect-7d85dfc575-6bg7d
HTTP/1.1 GET /
Host: 192.168.49.2:30857
Accept-Encoding: gzip
User-Agent: Go-http-client/1.1
--- PASS: TestFunctional/parallel/ServiceCmdConnect (9.59s)
=== RUN TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd
=== CONT TestFunctional/parallel/AddonsCmd
functional_test.go:1695: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 addons list
functional_test.go:1707: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.14s)
=== RUN TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim
=== CONT TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:50: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:352: "storage-provisioner" [5a21bf7c-4124-4644-bd19-791ff26e881f] Running
functional_test_pvc_test.go:50: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 6.003997524s
functional_test_pvc_test.go:55: (dbg) Run: kubectl --context functional-873823 get storageclass -o=json
functional_test_pvc_test.go:75: (dbg) Run: kubectl --context functional-873823 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:82: (dbg) Run: kubectl --context functional-873823 get pvc myclaim -o=json
functional_test_pvc_test.go:131: (dbg) Run: kubectl --context functional-873823 apply -f testdata/storage-provisioner/pod.yaml
I1002 20:23:48.932795 134834 detect.go:223] nested VM detected
functional_test_pvc_test.go:140: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 6m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:352: "sp-pod" [b6390377-3ae1-41b3-a964-157b367f4a8d] Pending
helpers_test.go:352: "sp-pod" [b6390377-3ae1-41b3-a964-157b367f4a8d] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:352: "sp-pod" [b6390377-3ae1-41b3-a964-157b367f4a8d] Running
functional_test_pvc_test.go:140: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 11.003365611s
functional_test_pvc_test.go:106: (dbg) Run: kubectl --context functional-873823 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:112: (dbg) Run: kubectl --context functional-873823 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:112: (dbg) Done: kubectl --context functional-873823 delete -f testdata/storage-provisioner/pod.yaml: (1.901156733s)
functional_test_pvc_test.go:131: (dbg) Run: kubectl --context functional-873823 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:140: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 6m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:352: "sp-pod" [608d1dd7-9d46-439a-b14f-9ebfe2e64976] Pending
helpers_test.go:352: "sp-pod" [608d1dd7-9d46-439a-b14f-9ebfe2e64976] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:352: "sp-pod" [608d1dd7-9d46-439a-b14f-9ebfe2e64976] Running
functional_test_pvc_test.go:140: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 13.004278676s
functional_test_pvc_test.go:120: (dbg) Run: kubectl --context functional-873823 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (32.66s)
=== RUN TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd
=== CONT TestFunctional/parallel/SSHCmd
functional_test.go:1730: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "echo hello"
functional_test.go:1747: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.68s)
=== RUN TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd
=== CONT TestFunctional/parallel/CpCmd
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh -n functional-873823 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 cp functional-873823:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd1637009835/001/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh -n functional-873823 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh -n functional-873823 "sudo cat /tmp/does/not/exist/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.85s)
=== RUN TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL
=== CONT TestFunctional/parallel/MySQL
functional_test.go:1798: (dbg) Run: kubectl --context functional-873823 replace --force -f testdata/mysql.yaml
functional_test.go:1804: (dbg) TestFunctional/parallel/MySQL: waiting 10m0s for pods matching "app=mysql" in namespace "default" ...
helpers_test.go:352: "mysql-5bb876957f-6lht4" [613fa8d3-3fdd-43f9-8693-0754f9784f5a] Pending / Ready:ContainersNotReady (containers with unready status: [mysql]) / ContainersReady:ContainersNotReady (containers with unready status: [mysql])
helpers_test.go:352: "mysql-5bb876957f-6lht4" [613fa8d3-3fdd-43f9-8693-0754f9784f5a] Running
functional_test.go:1804: (dbg) TestFunctional/parallel/MySQL: app=mysql healthy within 17.003741618s
functional_test.go:1812: (dbg) Run: kubectl --context functional-873823 exec mysql-5bb876957f-6lht4 -- mysql -ppassword -e "show databases;"
functional_test.go:1812: (dbg) Non-zero exit: kubectl --context functional-873823 exec mysql-5bb876957f-6lht4 -- mysql -ppassword -e "show databases;": exit status 1 (137.185395ms)
** stderr **
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
command terminated with exit code 1
** /stderr **
I1002 20:24:13.554897 134834 retry.go:31] will retry after 1.310177368s: exit status 1
functional_test.go:1812: (dbg) Run: kubectl --context functional-873823 exec mysql-5bb876957f-6lht4 -- mysql -ppassword -e "show databases;"
functional_test.go:1812: (dbg) Non-zero exit: kubectl --context functional-873823 exec mysql-5bb876957f-6lht4 -- mysql -ppassword -e "show databases;": exit status 1 (215.056256ms)
** stderr **
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
command terminated with exit code 1
** /stderr **
I1002 20:24:15.080538 134834 retry.go:31] will retry after 1.28085017s: exit status 1
functional_test.go:1812: (dbg) Run: kubectl --context functional-873823 exec mysql-5bb876957f-6lht4 -- mysql -ppassword -e "show databases;"
functional_test.go:1812: (dbg) Non-zero exit: kubectl --context functional-873823 exec mysql-5bb876957f-6lht4 -- mysql -ppassword -e "show databases;": exit status 1 (133.323771ms)
** stderr **
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
command terminated with exit code 1
** /stderr **
I1002 20:24:16.495268 134834 retry.go:31] will retry after 3.016597997s: exit status 1
functional_test.go:1812: (dbg) Run: kubectl --context functional-873823 exec mysql-5bb876957f-6lht4 -- mysql -ppassword -e "show databases;"
--- PASS: TestFunctional/parallel/MySQL (23.38s)
=== RUN TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync
=== CONT TestFunctional/parallel/FileSync
functional_test.go:1934: Checking for existence of /etc/test/nested/copy/134834/hosts within VM
functional_test.go:1936: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "sudo cat /etc/test/nested/copy/134834/hosts"
functional_test.go:1941: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.31s)
=== RUN TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync
=== CONT TestFunctional/parallel/CertSync
functional_test.go:1977: Checking for existence of /etc/ssl/certs/134834.pem within VM
functional_test.go:1978: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "sudo cat /etc/ssl/certs/134834.pem"
functional_test.go:1977: Checking for existence of /usr/share/ca-certificates/134834.pem within VM
functional_test.go:1978: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "sudo cat /usr/share/ca-certificates/134834.pem"
functional_test.go:1977: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1978: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:2004: Checking for existence of /etc/ssl/certs/1348342.pem within VM
functional_test.go:2005: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "sudo cat /etc/ssl/certs/1348342.pem"
functional_test.go:2004: Checking for existence of /usr/share/ca-certificates/1348342.pem within VM
functional_test.go:2005: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "sudo cat /usr/share/ca-certificates/1348342.pem"
functional_test.go:2004: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:2005: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (1.97s)
=== RUN TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels
=== CONT TestFunctional/parallel/NodeLabels
functional_test.go:234: (dbg) Run: kubectl --context functional-873823 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.06s)
=== RUN TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled
=== CONT TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2032: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "sudo systemctl is-active docker"
functional_test.go:2032: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-873823 ssh "sudo systemctl is-active docker": exit status 1 (292.210224ms)
-- stdout --
inactive
-- /stdout --
** stderr **
ssh: Process exited with status 3
** /stderr **
functional_test.go:2032: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "sudo systemctl is-active crio"
functional_test.go:2032: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-873823 ssh "sudo systemctl is-active crio": exit status 1 (292.69993ms)
-- stdout --
inactive
-- /stdout --
** stderr **
ssh: Process exited with status 3
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.59s)
=== RUN TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License
=== CONT TestFunctional/parallel/License
functional_test.go:2293: (dbg) Run: out/minikube-linux-amd64 license
--- PASS: TestFunctional/parallel/License (0.57s)
=== RUN TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1451: (dbg) Run: kubectl --context functional-873823 create deployment hello-node --image kicbase/echo-server
functional_test.go:1455: (dbg) Run: kubectl --context functional-873823 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1460: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:352: "hello-node-75c85bcc94-sl2hl" [7a43e8ec-ad1f-4eae-b17e-2e0a0a7b3623] Pending / Ready:ContainersNotReady (containers with unready status: [echo-server]) / ContainersReady:ContainersNotReady (containers with unready status: [echo-server])
helpers_test.go:352: "hello-node-75c85bcc94-sl2hl" [7a43e8ec-ad1f-4eae-b17e-2e0a0a7b3623] Running
functional_test.go:1460: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 9.003484261s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (9.21s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-amd64 -p functional-873823 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-amd64 -p functional-873823 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-amd64 -p functional-873823 tunnel --alsologtostderr] ...
helpers_test.go:525: unable to kill pid 176774: os: process already finished
helpers_test.go:525: unable to kill pid 176355: os: process already finished
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-amd64 -p functional-873823 tunnel --alsologtostderr] ...
helpers_test.go:507: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.56s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-amd64 -p functional-873823 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run: kubectl --context functional-873823 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:352: "nginx-svc" [b8fb70c2-3280-44ce-b17d-61091028e2b5] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:352: "nginx-svc" [b8fb70c2-3280-44ce-b17d-61091028e2b5] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 10.005536866s
I1002 20:23:53.066023 134834 kapi.go:150] Service nginx-svc in namespace default found.
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (10.23s)
=== RUN TestFunctional/parallel/ServiceCmd/List
functional_test.go:1469: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.51s)
=== RUN TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1499: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 service list -o json
functional_test.go:1504: Took "528.908036ms" to run "out/minikube-linux-amd64 -p functional-873823 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.53s)
=== RUN TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1519: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 service --namespace=default --https --url hello-node
functional_test.go:1532: found endpoint: https://192.168.49.2:30142
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.41s)
=== RUN TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1550: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.40s)
=== RUN TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1569: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 service hello-node --url
functional_test.go:1575: found endpoint for hello-node: http://192.168.49.2:30142
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.44s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run: kubectl --context functional-873823 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.08s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.101.208.180 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-amd64 -p functional-873823 tunnel --alsologtostderr] ...
functional_test_tunnel_test.go:437: failed to stop process: signal: terminated
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)
=== RUN TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes
=== CONT TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2124: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.14s)
=== RUN TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== CONT TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2124: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.15s)
=== RUN TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters
=== CONT TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2124: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)
=== RUN TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1285: (dbg) Run: out/minikube-linux-amd64 profile lis
functional_test.go:1290: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.50s)
=== RUN TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1325: (dbg) Run: out/minikube-linux-amd64 profile list
functional_test.go:1330: Took "408.029484ms" to run "out/minikube-linux-amd64 profile list"
functional_test.go:1339: (dbg) Run: out/minikube-linux-amd64 profile list -l
functional_test.go:1344: Took "63.059272ms" to run "out/minikube-linux-amd64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.47s)
=== RUN TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1376: (dbg) Run: out/minikube-linux-amd64 profile list -o json
functional_test.go:1381: Took "405.691921ms" to run "out/minikube-linux-amd64 profile list -o json"
functional_test.go:1389: (dbg) Run: out/minikube-linux-amd64 profile list -o json --light
functional_test.go:1394: Took "55.915337ms" to run "out/minikube-linux-amd64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.46s)
=== RUN TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-873823 /tmp/TestFunctionalparallelMountCmdany-port3929741472/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1759436634511732529" to /tmp/TestFunctionalparallelMountCmdany-port3929741472/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1759436634511732529" to /tmp/TestFunctionalparallelMountCmdany-port3929741472/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1759436634511732529" to /tmp/TestFunctionalparallelMountCmdany-port3929741472/001/test-1759436634511732529
functional_test_mount_test.go:115: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-873823 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (333.125512ms)
** stderr **
ssh: Process exited with status 1
** /stderr **
I1002 20:23:54.845287 134834 retry.go:31] will retry after 614.383085ms: exit status 1
functional_test_mount_test.go:115: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Oct 2 20:23 created-by-test
-rw-r--r-- 1 docker docker 24 Oct 2 20:23 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Oct 2 20:23 test-1759436634511732529
functional_test_mount_test.go:137: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh cat /mount-9p/test-1759436634511732529
functional_test_mount_test.go:148: (dbg) Run: kubectl --context functional-873823 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:352: "busybox-mount" [3af15ee1-ffc4-486d-82c3-53d3e880a10b] Pending
helpers_test.go:352: "busybox-mount" [3af15ee1-ffc4-486d-82c3-53d3e880a10b] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:352: "busybox-mount" [3af15ee1-ffc4-486d-82c3-53d3e880a10b] Running
helpers_test.go:352: "busybox-mount" [3af15ee1-ffc4-486d-82c3-53d3e880a10b] Running / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:352: "busybox-mount" [3af15ee1-ffc4-486d-82c3-53d3e880a10b] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 15.003402013s
functional_test_mount_test.go:169: (dbg) Run: kubectl --context functional-873823 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-873823 /tmp/TestFunctionalparallelMountCmdany-port3929741472/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (18.11s)
=== RUN TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short
=== CONT TestFunctional/parallel/Version/short
functional_test.go:2261: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 version --short
--- PASS: TestFunctional/parallel/Version/short (0.05s)
=== RUN TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components
=== CONT TestFunctional/parallel/Version/components
functional_test.go:2275: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 version -o=json --components
--- PASS: TestFunctional/parallel/Version/components (0.55s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort
=== CONT TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:276: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image ls --format short --alsologtostderr
functional_test.go:281: (dbg) Stdout: out/minikube-linux-amd64 -p functional-873823 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.10.1
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.34.1
registry.k8s.io/kube-proxy:v1.34.1
registry.k8s.io/kube-controller-manager:v1.34.1
registry.k8s.io/kube-apiserver:v1.34.1
registry.k8s.io/etcd:3.6.4-0
registry.k8s.io/coredns/coredns:v1.12.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/mysql:5.7
docker.io/library/minikube-local-cache-test:functional-873823
docker.io/kindest/kindnetd:v20250512-df8de77b
docker.io/kicbase/echo-server:functional-873823
functional_test.go:284: (dbg) Stderr: out/minikube-linux-amd64 -p functional-873823 image ls --format short --alsologtostderr:
I1002 20:24:16.357654 185180 out.go:360] Setting OutFile to fd 1 ...
I1002 20:24:16.357973 185180 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:24:16.357985 185180 out.go:374] Setting ErrFile to fd 2...
I1002 20:24:16.357989 185180 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:24:16.358283 185180 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:24:16.358976 185180 config.go:182] Loaded profile config "functional-873823": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:24:16.359088 185180 config.go:182] Loaded profile config "functional-873823": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:24:16.359496 185180 cli_runner.go:164] Run: docker container inspect functional-873823 --format={{.State.Status}}
I1002 20:24:16.381753 185180 ssh_runner.go:195] Run: systemctl --version
I1002 20:24:16.381810 185180 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-873823
I1002 20:24:16.401984 185180 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32903 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/functional-873823/id_rsa Username:docker}
I1002 20:24:16.520649 185180 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.25s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable
=== CONT TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:276: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image ls --format table --alsologtostderr
functional_test.go:281: (dbg) Stdout: out/minikube-linux-amd64 -p functional-873823 image ls --format table --alsologtostderr:
┌─────────────────────────────────────────────┬────────────────────┬───────────────┬────────┐
│ IMAGE │ TAG │ IMAGE ID │ SIZE │
├─────────────────────────────────────────────┼────────────────────┼───────────────┼────────┤
│ docker.io/library/minikube-local-cache-test │ functional-873823 │ sha256:5ca4c4 │ 990B │
│ gcr.io/k8s-minikube/busybox │ 1.28.4-glibc │ sha256:56cc51 │ 2.4MB │
│ registry.k8s.io/kube-apiserver │ v1.34.1 │ sha256:c3994b │ 27.1MB │
│ registry.k8s.io/pause │ 3.10.1 │ sha256:cd073f │ 320kB │
│ registry.k8s.io/pause │ latest │ sha256:350b16 │ 72.3kB │
│ docker.io/kicbase/echo-server │ functional-873823 │ sha256:9056ab │ 2.37MB │
│ docker.io/kindest/kindnetd │ v20250512-df8de77b │ sha256:409467 │ 44.4MB │
│ docker.io/library/nginx │ alpine │ sha256:4a8601 │ 22.5MB │
│ registry.k8s.io/kube-scheduler │ v1.34.1 │ sha256:7dd6aa │ 17.4MB │
│ registry.k8s.io/pause │ 3.1 │ sha256:da86e6 │ 315kB │
│ docker.io/library/nginx │ latest │ sha256:203ad0 │ 72.3MB │
│ gcr.io/k8s-minikube/storage-provisioner │ v5 │ sha256:6e38f4 │ 9.06MB │
│ registry.k8s.io/kube-proxy │ v1.34.1 │ sha256:fc2517 │ 26MB │
│ registry.k8s.io/pause │ 3.3 │ sha256:0184c1 │ 298kB │
│ docker.io/library/mysql │ 5.7 │ sha256:510733 │ 138MB │
│ registry.k8s.io/coredns/coredns │ v1.12.1 │ sha256:52546a │ 22.4MB │
│ registry.k8s.io/etcd │ 3.6.4-0 │ sha256:5f1f52 │ 74.3MB │
│ registry.k8s.io/kube-controller-manager │ v1.34.1 │ sha256:c80c8d │ 22.8MB │
└─────────────────────────────────────────────┴────────────────────┴───────────────┴────────┘
functional_test.go:284: (dbg) Stderr: out/minikube-linux-amd64 -p functional-873823 image ls --format table --alsologtostderr:
I1002 20:24:17.106427 185573 out.go:360] Setting OutFile to fd 1 ...
I1002 20:24:17.106741 185573 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:24:17.106755 185573 out.go:374] Setting ErrFile to fd 2...
I1002 20:24:17.106763 185573 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:24:17.107115 185573 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:24:17.108038 185573 config.go:182] Loaded profile config "functional-873823": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:24:17.108186 185573 config.go:182] Loaded profile config "functional-873823": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:24:17.108740 185573 cli_runner.go:164] Run: docker container inspect functional-873823 --format={{.State.Status}}
I1002 20:24:17.133312 185573 ssh_runner.go:195] Run: systemctl --version
I1002 20:24:17.133365 185573 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-873823
I1002 20:24:17.155257 185573 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32903 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/functional-873823/id_rsa Username:docker}
I1002 20:24:17.266025 185573 ssh_runner.go:195] Run: sudo crictl images --output json
2025/10/02 20:24:18 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.26s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson
=== CONT TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:276: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image ls --format json --alsologtostderr
functional_test.go:281: (dbg) Stdout: out/minikube-linux-amd64 -p functional-873823 image ls --format json --alsologtostderr:
[{"id":"sha256:da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"315399"},{"id":"sha256:350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"72306"},{"id":"sha256:9056ab77afb8e18e04303f11000a9d31b3f16b74c59475b899ae1b342d328d30","repoDigests":[],"repoTags":["docker.io/kicbase/echo-server:functional-873823"],"size":"2372971"},{"id":"sha256:5107333e08a87b836d48ff7528b1e84b9c86781cc9f1748bbc1b8c42a870d933","repoDigests":["docker.io/library/mysql@sha256:4bc6bc963e6d8443453676cae56536f4b8156d78bae03c0145cbe47c2aad73bb"],"repoTags":["docker.io/library/mysql:5.7"],"size":"137909886"},{"id":"sha256:4a86014ec6994761b7f3118cf47e4b4fd6bac15fc6fa262c4f356386bbc0e9d9","repoDigests":["docker.io/library/nginx@sha256:42a516af16b852e33b7682d5ef8acbd5d13fe08fecadc7ed98605ba5e3b26ab8"],"repoTags":["docker.io/library/nginx:alpine"],"size":"22477192"},{"id":"sh
a256:52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969","repoDigests":["registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c"],"repoTags":["registry.k8s.io/coredns/coredns:v1.12.1"],"size":"22384805"},{"id":"sha256:c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:2bf47c1b01f51e8963bf2327390883c9fa4ed03ea1b284500a2cba17ce303e89"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.34.1"],"size":"22820214"},{"id":"sha256:fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7","repoDigests":["registry.k8s.io/kube-proxy@sha256:913cc83ca0b5588a81d86ce8eedeb3ed1e9c1326e81852a1ea4f622b74ff749a"],"repoTags":["registry.k8s.io/kube-proxy:v1.34.1"],"size":"25963718"},{"id":"sha256:0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"297686"},{"id":"sha256:c3994bc6961024917ec0aeee02e628
28108c21a52d87648e30f3080d9cbadc97","repoDigests":["registry.k8s.io/kube-apiserver@sha256:b9d7c117f8ac52bed4b13aeed973dc5198f9d93a926e6fe9e0b384f155baa902"],"repoTags":["registry.k8s.io/kube-apiserver:v1.34.1"],"size":"27061991"},{"id":"sha256:07655ddf2eebe5d250f7a72c25f638b27126805d61779741b4e62e69ba080558","repoDigests":["docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93"],"repoTags":[],"size":"75788960"},{"id":"sha256:203ad09fc1566a329c1d2af8d1f219b28fd2c00b69e743bd572b7f662365432d","repoDigests":["docker.io/library/nginx@sha256:8adbdcb969e2676478ee2c7ad333956f0c8e0e4c5a7463f4611d7a2e7a7ff5dc"],"repoTags":["docker.io/library/nginx:latest"],"size":"72319283"},{"id":"sha256:56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"2395207"},{"id":"sha256:6e38f40d628db
3002f5617342c8872c935de530d867d0f709a2fbda1a302a562","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"9058936"},{"id":"sha256:7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813","repoDigests":["registry.k8s.io/kube-scheduler@sha256:6e9fbc4e25a576483e6a233976353a66e4d77eb5d0530e9118e94b7d46fb3500"],"repoTags":["registry.k8s.io/kube-scheduler:v1.34.1"],"size":"17385568"},{"id":"sha256:cd073f4c5f6a8e9dc6f3125ba00cf60819cae95c1ec84a1f146ee4a9cf9e803f","repoDigests":["registry.k8s.io/pause@sha256:278fb9dbcca9518083ad1e11276933a2e96f23de604a3a08cc3c80002767d24c"],"repoTags":["registry.k8s.io/pause:3.10.1"],"size":"320448"},{"id":"sha256:409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c","repoDigests":["docker.io/kindest/kindnetd@sha256:07a4b3fe0077a0ae606cc0a200fc25a28fa64dcc30b8d311b461089969449f9a"],"repoTags":["docker.io/kindest/kindnetd:v
20250512-df8de77b"],"size":"44375501"},{"id":"sha256:5ca4c4359f9b441697b037f5856f16601be15aea79284aa9ea24229bba775d78","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-873823"],"size":"990"},{"id":"sha256:5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115","repoDigests":["registry.k8s.io/etcd@sha256:e36c081683425b5b3bc1425bc508b37e7107bb65dfa9367bf5a80125d431fa19"],"repoTags":["registry.k8s.io/etcd:3.6.4-0"],"size":"74311308"}]
functional_test.go:284: (dbg) Stderr: out/minikube-linux-amd64 -p functional-873823 image ls --format json --alsologtostderr:
I1002 20:24:16.846682 185470 out.go:360] Setting OutFile to fd 1 ...
I1002 20:24:16.846969 185470 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:24:16.846980 185470 out.go:374] Setting ErrFile to fd 2...
I1002 20:24:16.846984 185470 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:24:16.847189 185470 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:24:16.847840 185470 config.go:182] Loaded profile config "functional-873823": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:24:16.847941 185470 config.go:182] Loaded profile config "functional-873823": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:24:16.848316 185470 cli_runner.go:164] Run: docker container inspect functional-873823 --format={{.State.Status}}
I1002 20:24:16.869954 185470 ssh_runner.go:195] Run: systemctl --version
I1002 20:24:16.870009 185470 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-873823
I1002 20:24:16.890789 185470 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32903 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/functional-873823/id_rsa Username:docker}
I1002 20:24:17.001690 185470 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.25s)
=== RUN TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml
=== CONT TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:276: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image ls --format yaml --alsologtostderr
functional_test.go:281: (dbg) Stdout: out/minikube-linux-amd64 -p functional-873823 image ls --format yaml --alsologtostderr:
- id: sha256:fc25172553d79197ecd840ec8dba1fba68330079355e974b04c1a441e6a4a0b7
repoDigests:
- registry.k8s.io/kube-proxy@sha256:913cc83ca0b5588a81d86ce8eedeb3ed1e9c1326e81852a1ea4f622b74ff749a
repoTags:
- registry.k8s.io/kube-proxy:v1.34.1
size: "25963718"
- id: sha256:da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "315399"
- id: sha256:350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "72306"
- id: sha256:9056ab77afb8e18e04303f11000a9d31b3f16b74c59475b899ae1b342d328d30
repoDigests: []
repoTags:
- docker.io/kicbase/echo-server:functional-873823
size: "2372971"
- id: sha256:203ad09fc1566a329c1d2af8d1f219b28fd2c00b69e743bd572b7f662365432d
repoDigests:
- docker.io/library/nginx@sha256:8adbdcb969e2676478ee2c7ad333956f0c8e0e4c5a7463f4611d7a2e7a7ff5dc
repoTags:
- docker.io/library/nginx:latest
size: "72319283"
- id: sha256:56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "2395207"
- id: sha256:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "9058936"
- id: sha256:52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c
repoTags:
- registry.k8s.io/coredns/coredns:v1.12.1
size: "22384805"
- id: sha256:0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "297686"
- id: sha256:4a86014ec6994761b7f3118cf47e4b4fd6bac15fc6fa262c4f356386bbc0e9d9
repoDigests:
- docker.io/library/nginx@sha256:42a516af16b852e33b7682d5ef8acbd5d13fe08fecadc7ed98605ba5e3b26ab8
repoTags:
- docker.io/library/nginx:alpine
size: "22477192"
- id: sha256:5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115
repoDigests:
- registry.k8s.io/etcd@sha256:e36c081683425b5b3bc1425bc508b37e7107bb65dfa9367bf5a80125d431fa19
repoTags:
- registry.k8s.io/etcd:3.6.4-0
size: "74311308"
- id: sha256:c3994bc6961024917ec0aeee02e62828108c21a52d87648e30f3080d9cbadc97
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:b9d7c117f8ac52bed4b13aeed973dc5198f9d93a926e6fe9e0b384f155baa902
repoTags:
- registry.k8s.io/kube-apiserver:v1.34.1
size: "27061991"
- id: sha256:c80c8dbafe7dd71fc21527912a6dd20ccd1b71f3e561a5c28337388d0619538f
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:2bf47c1b01f51e8963bf2327390883c9fa4ed03ea1b284500a2cba17ce303e89
repoTags:
- registry.k8s.io/kube-controller-manager:v1.34.1
size: "22820214"
- id: sha256:7dd6aaa1717ab7eaae4578503e4c4d9965fcf5a249e8155fe16379ee9b6cb813
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:6e9fbc4e25a576483e6a233976353a66e4d77eb5d0530e9118e94b7d46fb3500
repoTags:
- registry.k8s.io/kube-scheduler:v1.34.1
size: "17385568"
- id: sha256:cd073f4c5f6a8e9dc6f3125ba00cf60819cae95c1ec84a1f146ee4a9cf9e803f
repoDigests:
- registry.k8s.io/pause@sha256:278fb9dbcca9518083ad1e11276933a2e96f23de604a3a08cc3c80002767d24c
repoTags:
- registry.k8s.io/pause:3.10.1
size: "320448"
- id: sha256:409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c
repoDigests:
- docker.io/kindest/kindnetd@sha256:07a4b3fe0077a0ae606cc0a200fc25a28fa64dcc30b8d311b461089969449f9a
repoTags:
- docker.io/kindest/kindnetd:v20250512-df8de77b
size: "44375501"
- id: sha256:07655ddf2eebe5d250f7a72c25f638b27126805d61779741b4e62e69ba080558
repoDigests:
- docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93
repoTags: []
size: "75788960"
- id: sha256:5ca4c4359f9b441697b037f5856f16601be15aea79284aa9ea24229bba775d78
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-873823
size: "990"
- id: sha256:5107333e08a87b836d48ff7528b1e84b9c86781cc9f1748bbc1b8c42a870d933
repoDigests:
- docker.io/library/mysql@sha256:4bc6bc963e6d8443453676cae56536f4b8156d78bae03c0145cbe47c2aad73bb
repoTags:
- docker.io/library/mysql:5.7
size: "137909886"
functional_test.go:284: (dbg) Stderr: out/minikube-linux-amd64 -p functional-873823 image ls --format yaml --alsologtostderr:
I1002 20:24:16.610927 185324 out.go:360] Setting OutFile to fd 1 ...
I1002 20:24:16.611255 185324 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:24:16.611268 185324 out.go:374] Setting ErrFile to fd 2...
I1002 20:24:16.611273 185324 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:24:16.611578 185324 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:24:16.612357 185324 config.go:182] Loaded profile config "functional-873823": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:24:16.612483 185324 config.go:182] Loaded profile config "functional-873823": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:24:16.613054 185324 cli_runner.go:164] Run: docker container inspect functional-873823 --format={{.State.Status}}
I1002 20:24:16.633995 185324 ssh_runner.go:195] Run: systemctl --version
I1002 20:24:16.634064 185324 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-873823
I1002 20:24:16.654933 185324 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32903 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/functional-873823/id_rsa Username:docker}
I1002 20:24:16.761052 185324 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.24s)
=== RUN TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild
=== CONT TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:323: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh pgrep buildkitd
functional_test.go:323: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-873823 ssh pgrep buildkitd: exit status 1 (279.694462ms)
** stderr **
ssh: Process exited with status 1
** /stderr **
functional_test.go:330: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image build -t localhost/my-image:functional-873823 testdata/build --alsologtostderr
functional_test.go:330: (dbg) Done: out/minikube-linux-amd64 -p functional-873823 image build -t localhost/my-image:functional-873823 testdata/build --alsologtostderr: (3.161473782s)
functional_test.go:338: (dbg) Stderr: out/minikube-linux-amd64 -p functional-873823 image build -t localhost/my-image:functional-873823 testdata/build --alsologtostderr:
I1002 20:24:16.871529 185481 out.go:360] Setting OutFile to fd 1 ...
I1002 20:24:16.871889 185481 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:24:16.871905 185481 out.go:374] Setting ErrFile to fd 2...
I1002 20:24:16.871915 185481 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:24:16.872142 185481 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:24:16.872745 185481 config.go:182] Loaded profile config "functional-873823": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:24:16.873437 185481 config.go:182] Loaded profile config "functional-873823": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:24:16.873927 185481 cli_runner.go:164] Run: docker container inspect functional-873823 --format={{.State.Status}}
I1002 20:24:16.894356 185481 ssh_runner.go:195] Run: systemctl --version
I1002 20:24:16.894434 185481 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-873823
I1002 20:24:16.917953 185481 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32903 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/functional-873823/id_rsa Username:docker}
I1002 20:24:17.030280 185481 build_images.go:161] Building image from path: /tmp/build.3287317353.tar
I1002 20:24:17.030378 185481 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I1002 20:24:17.041972 185481 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.3287317353.tar
I1002 20:24:17.046973 185481 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.3287317353.tar: stat -c "%s %y" /var/lib/minikube/build/build.3287317353.tar: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/build/build.3287317353.tar': No such file or directory
I1002 20:24:17.047008 185481 ssh_runner.go:362] scp /tmp/build.3287317353.tar --> /var/lib/minikube/build/build.3287317353.tar (3072 bytes)
I1002 20:24:17.072586 185481 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.3287317353
I1002 20:24:17.084490 185481 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.3287317353 -xf /var/lib/minikube/build/build.3287317353.tar
I1002 20:24:17.095887 185481 containerd.go:394] Building image: /var/lib/minikube/build/build.3287317353
I1002 20:24:17.095971 185481 ssh_runner.go:195] Run: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.3287317353 --local dockerfile=/var/lib/minikube/build/build.3287317353 --output type=image,name=localhost/my-image:functional-873823
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 97B done
#1 DONE 0.0s
#2 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#2 DONE 1.6s
#3 [internal] load .dockerignore
#3 transferring context: 2B done
#3 DONE 0.0s
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s
#5 [1/3] FROM gcr.io/k8s-minikube/busybox:latest@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox:latest@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa 0B / 772.79kB 0.2s
#5 sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa 772.79kB / 772.79kB 0.3s done
#5 extracting sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa 0.1s done
#5 DONE 0.4s
#6 [2/3] RUN true
#6 DONE 0.6s
#7 [3/3] ADD content.txt /
#7 DONE 0.0s
#8 exporting to image
#8 exporting layers 0.1s done
#8 exporting manifest sha256:1069404631d3f41e35f886bf5c48a6378aa2945cf9449f8baf6404aab8855357 done
#8 exporting config sha256:10b192f621afaf253eb2c6462b0115563eca74ea16622403dffba87e702f6b3a done
#8 naming to localhost/my-image:functional-873823 done
#8 DONE 0.1s
I1002 20:24:19.953361 185481 ssh_runner.go:235] Completed: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.3287317353 --local dockerfile=/var/lib/minikube/build/build.3287317353 --output type=image,name=localhost/my-image:functional-873823: (2.857358429s)
I1002 20:24:19.953434 185481 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.3287317353
I1002 20:24:19.962242 185481 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.3287317353.tar
I1002 20:24:19.970332 185481 build_images.go:217] Built localhost/my-image:functional-873823 from /tmp/build.3287317353.tar
I1002 20:24:19.970366 185481 build_images.go:133] succeeded building to: functional-873823
I1002 20:24:19.970371 185481 build_images.go:134] failed building to:
functional_test.go:466: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (3.67s)
=== RUN TestFunctional/parallel/ImageCommands/Setup
functional_test.go:357: (dbg) Run: docker pull kicbase/echo-server:1.0
functional_test.go:357: (dbg) Done: docker pull kicbase/echo-server:1.0: (1.531568824s)
functional_test.go:362: (dbg) Run: docker tag kicbase/echo-server:1.0 kicbase/echo-server:functional-873823
--- PASS: TestFunctional/parallel/ImageCommands/Setup (1.55s)
=== RUN TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:370: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image load --daemon kicbase/echo-server:functional-873823 --alsologtostderr
functional_test.go:466: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.07s)
=== RUN TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:380: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image load --daemon kicbase/echo-server:functional-873823 --alsologtostderr
functional_test.go:466: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.09s)
=== RUN TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:250: (dbg) Run: docker pull kicbase/echo-server:latest
E1002 20:23:59.916734 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
functional_test.go:250: (dbg) Done: docker pull kicbase/echo-server:latest: (1.10664874s)
functional_test.go:255: (dbg) Run: docker tag kicbase/echo-server:latest kicbase/echo-server:functional-873823
functional_test.go:260: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image load --daemon kicbase/echo-server:functional-873823 --alsologtostderr
functional_test.go:466: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (2.35s)
=== RUN TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:395: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image save kicbase/echo-server:functional-873823 /home/jenkins/workspace/Docker_Linux_containerd_integration/echo-server-save.tar --alsologtostderr
I1002 20:24:02.097490 134834 detect.go:223] nested VM detected
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.41s)
=== RUN TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:407: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image rm kicbase/echo-server:functional-873823 --alsologtostderr
functional_test.go:466: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.52s)
=== RUN TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:424: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image load /home/jenkins/workspace/Docker_Linux_containerd_integration/echo-server-save.tar --alsologtostderr
functional_test.go:466: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.66s)
=== RUN TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:434: (dbg) Run: docker rmi kicbase/echo-server:functional-873823
functional_test.go:439: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 image save --daemon kicbase/echo-server:functional-873823 --alsologtostderr
functional_test.go:447: (dbg) Run: docker image inspect kicbase/echo-server:functional-873823
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.43s)
=== RUN TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-873823 /tmp/TestFunctionalparallelMountCmdspecific-port1444894670/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-873823 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (319.870463ms)
** stderr **
ssh: Process exited with status 1
** /stderr **
I1002 20:24:12.938064 134834 retry.go:31] will retry after 745.682278ms: exit status 1
functional_test_mount_test.go:243: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-873823 /tmp/TestFunctionalparallelMountCmdspecific-port1444894670/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-873823 ssh "sudo umount -f /mount-9p": exit status 1 (293.392531ms)
-- stdout --
umount: /mount-9p: not mounted.
-- /stdout --
** stderr **
ssh: Process exited with status 32
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-amd64 -p functional-873823 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-873823 /tmp/TestFunctionalparallelMountCmdspecific-port1444894670/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.19s)
=== RUN TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-873823 /tmp/TestFunctionalparallelMountCmdVerifyCleanup274221737/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-873823 /tmp/TestFunctionalparallelMountCmdVerifyCleanup274221737/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-873823 /tmp/TestFunctionalparallelMountCmdVerifyCleanup274221737/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-873823 ssh "findmnt -T" /mount1: exit status 1 (364.281629ms)
** stderr **
ssh: Process exited with status 1
** /stderr **
I1002 20:24:15.169188 134834 retry.go:31] will retry after 395.258902ms: exit status 1
functional_test_mount_test.go:325: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run: out/minikube-linux-amd64 -p functional-873823 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run: out/minikube-linux-amd64 mount -p functional-873823 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-873823 /tmp/TestFunctionalparallelMountCmdVerifyCleanup274221737/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:507: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-873823 /tmp/TestFunctionalparallelMountCmdVerifyCleanup274221737/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:507: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-873823 /tmp/TestFunctionalparallelMountCmdVerifyCleanup274221737/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:507: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (1.74s)
=== RUN TestFunctional/delete_echo-server_images
functional_test.go:205: (dbg) Run: docker rmi -f kicbase/echo-server:1.0
functional_test.go:205: (dbg) Run: docker rmi -f kicbase/echo-server:functional-873823
--- PASS: TestFunctional/delete_echo-server_images (0.04s)
=== RUN TestFunctional/delete_my-image_image
functional_test.go:213: (dbg) Run: docker rmi -f localhost/my-image:functional-873823
--- PASS: TestFunctional/delete_my-image_image (0.02s)
=== RUN TestFunctional/delete_minikube_cached_images
functional_test.go:221: (dbg) Run: docker rmi -f minikube-local-cache-test:functional-873823
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)
=== RUN TestMultiControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 start --ha --memory 3072 --wait true --alsologtostderr -v 5 --driver=docker --container-runtime=containerd
E1002 20:24:40.880041 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:26:02.802010 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
ha_test.go:101: (dbg) Done: out/minikube-linux-amd64 -p ha-193617 start --ha --memory 3072 --wait true --alsologtostderr -v 5 --driver=docker --container-runtime=containerd: (2m13.68295173s)
ha_test.go:107: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 status --alsologtostderr -v 5
--- PASS: TestMultiControlPlane/serial/StartCluster (134.45s)
=== RUN TestMultiControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:133: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- rollout status deployment/busybox
ha_test.go:133: (dbg) Done: out/minikube-linux-amd64 -p ha-193617 kubectl -- rollout status deployment/busybox: (3.525761562s)
ha_test.go:140: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:163: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:171: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- exec busybox-7b57f96db7-652v2 -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- exec busybox-7b57f96db7-88hz7 -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- exec busybox-7b57f96db7-vc9ct -- nslookup kubernetes.io
ha_test.go:181: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- exec busybox-7b57f96db7-652v2 -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- exec busybox-7b57f96db7-88hz7 -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- exec busybox-7b57f96db7-vc9ct -- nslookup kubernetes.default
ha_test.go:189: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- exec busybox-7b57f96db7-652v2 -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- exec busybox-7b57f96db7-88hz7 -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- exec busybox-7b57f96db7-vc9ct -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiControlPlane/serial/DeployApp (5.69s)
=== RUN TestMultiControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:207: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- exec busybox-7b57f96db7-652v2 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- exec busybox-7b57f96db7-652v2 -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- exec busybox-7b57f96db7-88hz7 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- exec busybox-7b57f96db7-88hz7 -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- exec busybox-7b57f96db7-vc9ct -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 kubectl -- exec busybox-7b57f96db7-vc9ct -- sh -c "ping -c 1 192.168.49.1"
--- PASS: TestMultiControlPlane/serial/PingHostFromPods (1.15s)
=== RUN TestMultiControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 node add --alsologtostderr -v 5
ha_test.go:228: (dbg) Done: out/minikube-linux-amd64 -p ha-193617 node add --alsologtostderr -v 5: (24.499895967s)
ha_test.go:234: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 status --alsologtostderr -v 5
--- PASS: TestMultiControlPlane/serial/AddWorkerNode (25.42s)
=== RUN TestMultiControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run: kubectl --context ha-193617 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiControlPlane/serial/NodeLabels (0.07s)
=== RUN TestMultiControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterClusterStart (0.95s)
=== RUN TestMultiControlPlane/serial/CopyFile
ha_test.go:328: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 status --output json --alsologtostderr -v 5
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp testdata/cp-test.txt ha-193617:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1612471971/001/cp-test_ha-193617.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617:/home/docker/cp-test.txt ha-193617-m02:/home/docker/cp-test_ha-193617_ha-193617-m02.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m02 "sudo cat /home/docker/cp-test_ha-193617_ha-193617-m02.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617:/home/docker/cp-test.txt ha-193617-m03:/home/docker/cp-test_ha-193617_ha-193617-m03.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m03 "sudo cat /home/docker/cp-test_ha-193617_ha-193617-m03.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617:/home/docker/cp-test.txt ha-193617-m04:/home/docker/cp-test_ha-193617_ha-193617-m04.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m04 "sudo cat /home/docker/cp-test_ha-193617_ha-193617-m04.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp testdata/cp-test.txt ha-193617-m02:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617-m02:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1612471971/001/cp-test_ha-193617-m02.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617-m02:/home/docker/cp-test.txt ha-193617:/home/docker/cp-test_ha-193617-m02_ha-193617.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617 "sudo cat /home/docker/cp-test_ha-193617-m02_ha-193617.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617-m02:/home/docker/cp-test.txt ha-193617-m03:/home/docker/cp-test_ha-193617-m02_ha-193617-m03.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m03 "sudo cat /home/docker/cp-test_ha-193617-m02_ha-193617-m03.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617-m02:/home/docker/cp-test.txt ha-193617-m04:/home/docker/cp-test_ha-193617-m02_ha-193617-m04.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m04 "sudo cat /home/docker/cp-test_ha-193617-m02_ha-193617-m04.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp testdata/cp-test.txt ha-193617-m03:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617-m03:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1612471971/001/cp-test_ha-193617-m03.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617-m03:/home/docker/cp-test.txt ha-193617:/home/docker/cp-test_ha-193617-m03_ha-193617.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617 "sudo cat /home/docker/cp-test_ha-193617-m03_ha-193617.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617-m03:/home/docker/cp-test.txt ha-193617-m02:/home/docker/cp-test_ha-193617-m03_ha-193617-m02.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m02 "sudo cat /home/docker/cp-test_ha-193617-m03_ha-193617-m02.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617-m03:/home/docker/cp-test.txt ha-193617-m04:/home/docker/cp-test_ha-193617-m03_ha-193617-m04.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m04 "sudo cat /home/docker/cp-test_ha-193617-m03_ha-193617-m04.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp testdata/cp-test.txt ha-193617-m04:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1612471971/001/cp-test_ha-193617-m04.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617-m04:/home/docker/cp-test.txt ha-193617:/home/docker/cp-test_ha-193617-m04_ha-193617.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617 "sudo cat /home/docker/cp-test_ha-193617-m04_ha-193617.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617-m04:/home/docker/cp-test.txt ha-193617-m02:/home/docker/cp-test_ha-193617-m04_ha-193617-m02.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m02 "sudo cat /home/docker/cp-test_ha-193617-m04_ha-193617-m02.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 cp ha-193617-m04:/home/docker/cp-test.txt ha-193617-m03:/home/docker/cp-test_ha-193617-m04_ha-193617-m03.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 ssh -n ha-193617-m03 "sudo cat /home/docker/cp-test_ha-193617-m04_ha-193617-m03.txt"
--- PASS: TestMultiControlPlane/serial/CopyFile (17.67s)
=== RUN TestMultiControlPlane/serial/StopSecondaryNode
ha_test.go:365: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 node stop m02 --alsologtostderr -v 5
ha_test.go:365: (dbg) Done: out/minikube-linux-amd64 -p ha-193617 node stop m02 --alsologtostderr -v 5: (11.97971322s)
ha_test.go:371: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 status --alsologtostderr -v 5
ha_test.go:371: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-193617 status --alsologtostderr -v 5: exit status 7 (739.102852ms)
-- stdout --
ha-193617
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-193617-m02
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
ha-193617-m03
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
ha-193617-m04
type: Worker
host: Running
kubelet: Running
-- /stdout --
** stderr **
I1002 20:27:41.340474 206639 out.go:360] Setting OutFile to fd 1 ...
I1002 20:27:41.340769 206639 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:27:41.340781 206639 out.go:374] Setting ErrFile to fd 2...
I1002 20:27:41.340785 206639 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:27:41.341036 206639 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:27:41.341215 206639 out.go:368] Setting JSON to false
I1002 20:27:41.341242 206639 mustload.go:65] Loading cluster: ha-193617
I1002 20:27:41.341343 206639 notify.go:220] Checking for updates...
I1002 20:27:41.341674 206639 config.go:182] Loaded profile config "ha-193617": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:27:41.341691 206639 status.go:174] checking status of ha-193617 ...
I1002 20:27:41.342169 206639 cli_runner.go:164] Run: docker container inspect ha-193617 --format={{.State.Status}}
I1002 20:27:41.363034 206639 status.go:371] ha-193617 host status = "Running" (err=<nil>)
I1002 20:27:41.363082 206639 host.go:66] Checking if "ha-193617" exists ...
I1002 20:27:41.363377 206639 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-193617
I1002 20:27:41.383395 206639 host.go:66] Checking if "ha-193617" exists ...
I1002 20:27:41.383683 206639 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1002 20:27:41.383739 206639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-193617
I1002 20:27:41.405513 206639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32908 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/ha-193617/id_rsa Username:docker}
I1002 20:27:41.509946 206639 ssh_runner.go:195] Run: systemctl --version
I1002 20:27:41.517363 206639 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1002 20:27:41.531379 206639 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 20:27:41.590450 206639 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-10-02 20:27:41.578453335 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1041-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652174848 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-2 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:b98a3aace656320842a23f4a392a33f46af97866 Expected:} RuncCommit:{ID:v1.3.0-0-g4ca628d1 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.29.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.4] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v0.1.40] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1002 20:27:41.591017 206639 kubeconfig.go:125] found "ha-193617" server: "https://192.168.49.254:8443"
I1002 20:27:41.591047 206639 api_server.go:166] Checking apiserver status ...
I1002 20:27:41.591086 206639 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1002 20:27:41.604420 206639 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1375/cgroup
W1002 20:27:41.614147 206639 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1375/cgroup: Process exited with status 1
stdout:
stderr:
I1002 20:27:41.614209 206639 ssh_runner.go:195] Run: ls
I1002 20:27:41.619180 206639 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
I1002 20:27:41.623547 206639 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
ok
I1002 20:27:41.623573 206639 status.go:463] ha-193617 apiserver status = Running (err=<nil>)
I1002 20:27:41.623584 206639 status.go:176] ha-193617 status: &{Name:ha-193617 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1002 20:27:41.623601 206639 status.go:174] checking status of ha-193617-m02 ...
I1002 20:27:41.623871 206639 cli_runner.go:164] Run: docker container inspect ha-193617-m02 --format={{.State.Status}}
I1002 20:27:41.644367 206639 status.go:371] ha-193617-m02 host status = "Stopped" (err=<nil>)
I1002 20:27:41.644424 206639 status.go:384] host is not running, skipping remaining checks
I1002 20:27:41.644437 206639 status.go:176] ha-193617-m02 status: &{Name:ha-193617-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1002 20:27:41.644457 206639 status.go:174] checking status of ha-193617-m03 ...
I1002 20:27:41.644699 206639 cli_runner.go:164] Run: docker container inspect ha-193617-m03 --format={{.State.Status}}
I1002 20:27:41.664040 206639 status.go:371] ha-193617-m03 host status = "Running" (err=<nil>)
I1002 20:27:41.664072 206639 host.go:66] Checking if "ha-193617-m03" exists ...
I1002 20:27:41.664395 206639 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-193617-m03
I1002 20:27:41.683506 206639 host.go:66] Checking if "ha-193617-m03" exists ...
I1002 20:27:41.683837 206639 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1002 20:27:41.683909 206639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-193617-m03
I1002 20:27:41.703068 206639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32918 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/ha-193617-m03/id_rsa Username:docker}
I1002 20:27:41.805627 206639 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1002 20:27:41.820044 206639 kubeconfig.go:125] found "ha-193617" server: "https://192.168.49.254:8443"
I1002 20:27:41.820075 206639 api_server.go:166] Checking apiserver status ...
I1002 20:27:41.820114 206639 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1002 20:27:41.833565 206639 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1336/cgroup
W1002 20:27:41.843143 206639 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1336/cgroup: Process exited with status 1
stdout:
stderr:
I1002 20:27:41.843202 206639 ssh_runner.go:195] Run: ls
I1002 20:27:41.847285 206639 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
I1002 20:27:41.851533 206639 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
ok
I1002 20:27:41.851560 206639 status.go:463] ha-193617-m03 apiserver status = Running (err=<nil>)
I1002 20:27:41.851569 206639 status.go:176] ha-193617-m03 status: &{Name:ha-193617-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1002 20:27:41.851584 206639 status.go:174] checking status of ha-193617-m04 ...
I1002 20:27:41.851855 206639 cli_runner.go:164] Run: docker container inspect ha-193617-m04 --format={{.State.Status}}
I1002 20:27:41.871711 206639 status.go:371] ha-193617-m04 host status = "Running" (err=<nil>)
I1002 20:27:41.871744 206639 host.go:66] Checking if "ha-193617-m04" exists ...
I1002 20:27:41.872032 206639 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-193617-m04
I1002 20:27:41.891404 206639 host.go:66] Checking if "ha-193617-m04" exists ...
I1002 20:27:41.891787 206639 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1002 20:27:41.891863 206639 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-193617-m04
I1002 20:27:41.911962 206639 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32923 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/ha-193617-m04/id_rsa Username:docker}
I1002 20:27:42.012721 206639 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1002 20:27:42.026727 206639 status.go:176] ha-193617-m04 status: &{Name:ha-193617-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopSecondaryNode (12.72s)
=== RUN TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:392: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.77s)
=== RUN TestMultiControlPlane/serial/RestartSecondaryNode
ha_test.go:422: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 node start m02 --alsologtostderr -v 5
ha_test.go:422: (dbg) Done: out/minikube-linux-amd64 -p ha-193617 node start m02 --alsologtostderr -v 5: (9.09391246s)
ha_test.go:430: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 status --alsologtostderr -v 5
ha_test.go:450: (dbg) Run: kubectl get nodes
--- PASS: TestMultiControlPlane/serial/RestartSecondaryNode (10.10s)
=== RUN TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.94s)
=== RUN TestMultiControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:458: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 node list --alsologtostderr -v 5
ha_test.go:464: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 stop --alsologtostderr -v 5
E1002 20:28:18.942104 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
ha_test.go:464: (dbg) Done: out/minikube-linux-amd64 -p ha-193617 stop --alsologtostderr -v 5: (37.140613614s)
ha_test.go:469: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 start --wait true --alsologtostderr -v 5
E1002 20:28:42.085043 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:28:42.091558 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:28:42.103164 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:28:42.124711 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:28:42.166761 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:28:42.248240 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:28:42.410113 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:28:42.732225 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:28:43.374138 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:28:44.656137 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:28:46.644119 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:28:47.217810 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:28:52.339428 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:29:02.581499 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:29:23.063041 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
ha_test.go:469: (dbg) Done: out/minikube-linux-amd64 -p ha-193617 start --wait true --alsologtostderr -v 5: (58.53688178s)
ha_test.go:474: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 node list --alsologtostderr -v 5
--- PASS: TestMultiControlPlane/serial/RestartClusterKeepsNodes (95.79s)
=== RUN TestMultiControlPlane/serial/DeleteSecondaryNode
ha_test.go:489: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 node delete m03 --alsologtostderr -v 5
ha_test.go:489: (dbg) Done: out/minikube-linux-amd64 -p ha-193617 node delete m03 --alsologtostderr -v 5: (8.471372439s)
ha_test.go:495: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 status --alsologtostderr -v 5
ha_test.go:513: (dbg) Run: kubectl get nodes
ha_test.go:521: (dbg) Run: kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/DeleteSecondaryNode (9.31s)
=== RUN TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:392: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.74s)
=== RUN TestMultiControlPlane/serial/StopCluster
ha_test.go:533: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 stop --alsologtostderr -v 5
E1002 20:30:04.025099 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
ha_test.go:533: (dbg) Done: out/minikube-linux-amd64 -p ha-193617 stop --alsologtostderr -v 5: (35.849569116s)
ha_test.go:539: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 status --alsologtostderr -v 5
ha_test.go:539: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-193617 status --alsologtostderr -v 5: exit status 7 (114.078295ms)
-- stdout --
ha-193617
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
ha-193617-m02
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
ha-193617-m04
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
** stderr **
I1002 20:30:15.571569 223264 out.go:360] Setting OutFile to fd 1 ...
I1002 20:30:15.571818 223264 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:30:15.571826 223264 out.go:374] Setting ErrFile to fd 2...
I1002 20:30:15.571831 223264 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:30:15.572060 223264 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:30:15.572264 223264 out.go:368] Setting JSON to false
I1002 20:30:15.572294 223264 mustload.go:65] Loading cluster: ha-193617
I1002 20:30:15.572530 223264 notify.go:220] Checking for updates...
I1002 20:30:15.572677 223264 config.go:182] Loaded profile config "ha-193617": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:30:15.572692 223264 status.go:174] checking status of ha-193617 ...
I1002 20:30:15.573148 223264 cli_runner.go:164] Run: docker container inspect ha-193617 --format={{.State.Status}}
I1002 20:30:15.593386 223264 status.go:371] ha-193617 host status = "Stopped" (err=<nil>)
I1002 20:30:15.593415 223264 status.go:384] host is not running, skipping remaining checks
I1002 20:30:15.593421 223264 status.go:176] ha-193617 status: &{Name:ha-193617 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1002 20:30:15.593445 223264 status.go:174] checking status of ha-193617-m02 ...
I1002 20:30:15.593777 223264 cli_runner.go:164] Run: docker container inspect ha-193617-m02 --format={{.State.Status}}
I1002 20:30:15.614531 223264 status.go:371] ha-193617-m02 host status = "Stopped" (err=<nil>)
I1002 20:30:15.614560 223264 status.go:384] host is not running, skipping remaining checks
I1002 20:30:15.614566 223264 status.go:176] ha-193617-m02 status: &{Name:ha-193617-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1002 20:30:15.614604 223264 status.go:174] checking status of ha-193617-m04 ...
I1002 20:30:15.614899 223264 cli_runner.go:164] Run: docker container inspect ha-193617-m04 --format={{.State.Status}}
I1002 20:30:15.635174 223264 status.go:371] ha-193617-m04 host status = "Stopped" (err=<nil>)
I1002 20:30:15.635204 223264 status.go:384] host is not running, skipping remaining checks
I1002 20:30:15.635210 223264 status.go:176] ha-193617-m04 status: &{Name:ha-193617-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopCluster (35.96s)
=== RUN TestMultiControlPlane/serial/RestartCluster
ha_test.go:562: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 start --wait true --alsologtostderr -v 5 --driver=docker --container-runtime=containerd
ha_test.go:562: (dbg) Done: out/minikube-linux-amd64 -p ha-193617 start --wait true --alsologtostderr -v 5 --driver=docker --container-runtime=containerd: (55.627288668s)
ha_test.go:568: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 status --alsologtostderr -v 5
ha_test.go:586: (dbg) Run: kubectl get nodes
ha_test.go:594: (dbg) Run: kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiControlPlane/serial/RestartCluster (56.49s)
=== RUN TestMultiControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:392: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterClusterRestart (0.74s)
=== RUN TestMultiControlPlane/serial/AddSecondaryNode
ha_test.go:607: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 node add --control-plane --alsologtostderr -v 5
E1002 20:31:25.948548 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
ha_test.go:607: (dbg) Done: out/minikube-linux-amd64 -p ha-193617 node add --control-plane --alsologtostderr -v 5: (36.868190521s)
ha_test.go:613: (dbg) Run: out/minikube-linux-amd64 -p ha-193617 status --alsologtostderr -v 5
--- PASS: TestMultiControlPlane/serial/AddSecondaryNode (37.80s)
=== RUN TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.94s)
=== RUN TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 start -p json-output-079179 --output=json --user=testUser --memory=3072 --wait=true --driver=docker --container-runtime=containerd
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 start -p json-output-079179 --output=json --user=testUser --memory=3072 --wait=true --driver=docker --container-runtime=containerd: (38.825660051s)
--- PASS: TestJSONOutput/start/Command (38.83s)
=== RUN TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)
=== RUN TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 pause -p json-output-079179 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.77s)
=== RUN TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)
=== RUN TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 unpause -p json-output-079179 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.63s)
=== RUN TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)
=== RUN TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run: out/minikube-linux-amd64 stop -p json-output-079179 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 stop -p json-output-079179 --output=json --user=testUser: (5.790715768s)
--- PASS: TestJSONOutput/stop/Command (5.79s)
=== RUN TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)
=== RUN TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== CONT TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)
=== RUN TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== CONT TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)
=== RUN TestErrorJSONOutput
json_output_test.go:160: (dbg) Run: out/minikube-linux-amd64 start -p json-output-error-826441 --memory=3072 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p json-output-error-826441 --memory=3072 --output=json --wait=true --driver=fail: exit status 56 (75.464046ms)
-- stdout --
{"specversion":"1.0","id":"6e1293dc-1ad8-4955-b612-77d4471c843c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-826441] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
{"specversion":"1.0","id":"38f6462d-e1fc-47a5-a5ff-d03c490cfbc3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=21682"}}
{"specversion":"1.0","id":"18e40e9b-daf6-40bf-8069-46ef5a981b1f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
{"specversion":"1.0","id":"d448826d-03bd-463f-98e4-ebdb07e0b4ad","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/21682-131316/kubeconfig"}}
{"specversion":"1.0","id":"4c6f5c1a-0c7b-41ae-89aa-9435654ecb8d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/21682-131316/.minikube"}}
{"specversion":"1.0","id":"9119d958-63d4-4ded-962b-f5586a2ab1e2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
{"specversion":"1.0","id":"03c5e6ea-5eb1-4358-be4c-1e0517244e89","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
{"specversion":"1.0","id":"ba66da80-952c-40d7-bab7-34c8f3b2d775","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-826441" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p json-output-error-826441
--- PASS: TestErrorJSONOutput (0.23s)
=== RUN TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run: out/minikube-linux-amd64 start -p docker-network-654579 --network=
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-654579 --network=: (26.904389183s)
kic_custom_network_test.go:150: (dbg) Run: docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-654579" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p docker-network-654579
E1002 20:33:18.937413 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-654579: (2.168943768s)
--- PASS: TestKicCustomNetwork/create_custom_network (29.09s)
=== RUN TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run: out/minikube-linux-amd64 start -p docker-network-533214 --network=bridge
E1002 20:33:42.086085 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-533214 --network=bridge: (23.507895159s)
kic_custom_network_test.go:150: (dbg) Run: docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-533214" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p docker-network-533214
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-533214: (1.986726289s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (25.52s)
=== RUN TestKicExistingNetwork
I1002 20:33:45.837285 134834 cli_runner.go:164] Run: docker network inspect existing-network --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W1002 20:33:45.856028 134834 cli_runner.go:211] docker network inspect existing-network --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I1002 20:33:45.856124 134834 network_create.go:284] running [docker network inspect existing-network] to gather additional debugging logs...
I1002 20:33:45.856165 134834 cli_runner.go:164] Run: docker network inspect existing-network
W1002 20:33:45.874255 134834 cli_runner.go:211] docker network inspect existing-network returned with exit code 1
I1002 20:33:45.874288 134834 network_create.go:287] error running [docker network inspect existing-network]: docker network inspect existing-network: exit status 1
stdout:
[]
stderr:
Error response from daemon: network existing-network not found
I1002 20:33:45.874302 134834 network_create.go:289] output of [docker network inspect existing-network]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network existing-network not found
** /stderr **
I1002 20:33:45.874431 134834 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1002 20:33:45.894239 134834 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-bf5fd6aece25 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:06:db:7e:8b:fe:e0} reservation:<nil>}
I1002 20:33:45.894589 134834 network.go:206] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0019c1640}
I1002 20:33:45.894624 134834 network_create.go:124] attempt to create docker network existing-network 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I1002 20:33:45.894684 134834 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=existing-network existing-network
I1002 20:33:45.956659 134834 network_create.go:108] docker network existing-network 192.168.58.0/24 created
kic_custom_network_test.go:150: (dbg) Run: docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run: out/minikube-linux-amd64 start -p existing-network-689181 --network=existing-network
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-amd64 start -p existing-network-689181 --network=existing-network: (23.21509727s)
helpers_test.go:175: Cleaning up "existing-network-689181" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p existing-network-689181
E1002 20:34:09.790135 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p existing-network-689181: (1.992198418s)
I1002 20:34:11.183508 134834 cli_runner.go:164] Run: docker network ls --filter=label=existing-network --format {{.Name}}
--- PASS: TestKicExistingNetwork (25.36s)
=== RUN TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p custom-subnet-518997 --subnet=192.168.60.0/24
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p custom-subnet-518997 --subnet=192.168.60.0/24: (22.937303354s)
kic_custom_network_test.go:161: (dbg) Run: docker network inspect custom-subnet-518997 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-518997" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p custom-subnet-518997
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p custom-subnet-518997: (2.166489805s)
--- PASS: TestKicCustomSubnet (25.12s)
=== RUN TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run: out/minikube-linux-amd64 start -p static-ip-408328 --static-ip=192.168.200.200
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-amd64 start -p static-ip-408328 --static-ip=192.168.200.200: (24.37105559s)
kic_custom_network_test.go:138: (dbg) Run: out/minikube-linux-amd64 -p static-ip-408328 ip
helpers_test.go:175: Cleaning up "static-ip-408328" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p static-ip-408328
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p static-ip-408328: (2.135654335s)
--- PASS: TestKicStaticIP (26.65s)
=== RUN TestMainNoArgs
main_test.go:70: (dbg) Run: out/minikube-linux-amd64
--- PASS: TestMainNoArgs (0.05s)
=== RUN TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run: out/minikube-linux-amd64 start -p first-006025 --driver=docker --container-runtime=containerd
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p first-006025 --driver=docker --container-runtime=containerd: (24.506722787s)
minikube_profile_test.go:44: (dbg) Run: out/minikube-linux-amd64 start -p second-020920 --driver=docker --container-runtime=containerd
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p second-020920 --driver=docker --container-runtime=containerd: (21.281187692s)
minikube_profile_test.go:51: (dbg) Run: out/minikube-linux-amd64 profile first-006025
minikube_profile_test.go:55: (dbg) Run: out/minikube-linux-amd64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run: out/minikube-linux-amd64 profile second-020920
minikube_profile_test.go:55: (dbg) Run: out/minikube-linux-amd64 profile list -ojson
helpers_test.go:175: Cleaning up "second-020920" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p second-020920
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p second-020920: (2.333259039s)
helpers_test.go:175: Cleaning up "first-006025" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p first-006025
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p first-006025: (2.400032136s)
--- PASS: TestMinikubeProfile (51.79s)
=== RUN TestMountStart/serial/StartWithMountFirst
mount_start_test.go:118: (dbg) Run: out/minikube-linux-amd64 start -p mount-start-1-188752 --memory=3072 --mount-string /tmp/TestMountStartserial672053764/001:/minikube-host --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker --container-runtime=containerd
mount_start_test.go:118: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-1-188752 --memory=3072 --mount-string /tmp/TestMountStartserial672053764/001:/minikube-host --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker --container-runtime=containerd: (4.599005433s)
--- PASS: TestMountStart/serial/StartWithMountFirst (5.60s)
=== RUN TestMountStart/serial/VerifyMountFirst
mount_start_test.go:134: (dbg) Run: out/minikube-linux-amd64 -p mount-start-1-188752 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.28s)
=== RUN TestMountStart/serial/StartWithMountSecond
mount_start_test.go:118: (dbg) Run: out/minikube-linux-amd64 start -p mount-start-2-205791 --memory=3072 --mount-string /tmp/TestMountStartserial672053764/001:/minikube-host --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker --container-runtime=containerd
mount_start_test.go:118: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-205791 --memory=3072 --mount-string /tmp/TestMountStartserial672053764/001:/minikube-host --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker --container-runtime=containerd: (4.988589054s)
--- PASS: TestMountStart/serial/StartWithMountSecond (5.99s)
=== RUN TestMountStart/serial/VerifyMountSecond
mount_start_test.go:134: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-205791 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.28s)
=== RUN TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run: out/minikube-linux-amd64 delete -p mount-start-1-188752 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-amd64 delete -p mount-start-1-188752 --alsologtostderr -v=5: (1.680690808s)
--- PASS: TestMountStart/serial/DeleteFirst (1.68s)
=== RUN TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:134: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-205791 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.28s)
=== RUN TestMountStart/serial/Stop
mount_start_test.go:196: (dbg) Run: out/minikube-linux-amd64 stop -p mount-start-2-205791
mount_start_test.go:196: (dbg) Done: out/minikube-linux-amd64 stop -p mount-start-2-205791: (1.209297728s)
--- PASS: TestMountStart/serial/Stop (1.21s)
=== RUN TestMountStart/serial/RestartStopped
mount_start_test.go:207: (dbg) Run: out/minikube-linux-amd64 start -p mount-start-2-205791
mount_start_test.go:207: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-205791: (6.380991048s)
--- PASS: TestMountStart/serial/RestartStopped (7.38s)
=== RUN TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:134: (dbg) Run: out/minikube-linux-amd64 -p mount-start-2-205791 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.28s)
=== RUN TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run: out/minikube-linux-amd64 start -p multinode-269236 --wait=true --memory=3072 --nodes=2 -v=5 --alsologtostderr --driver=docker --container-runtime=containerd
multinode_test.go:96: (dbg) Done: out/minikube-linux-amd64 start -p multinode-269236 --wait=true --memory=3072 --nodes=2 -v=5 --alsologtostderr --driver=docker --container-runtime=containerd: (1m31.095772164s)
multinode_test.go:102: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (91.60s)
=== RUN TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-269236 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:498: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-269236 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Done: out/minikube-linux-amd64 kubectl -p multinode-269236 -- rollout status deployment/busybox: (3.152214433s)
multinode_test.go:505: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-269236 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:528: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-269236 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:536: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-269236 -- exec busybox-7b57f96db7-gdvtp -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-269236 -- exec busybox-7b57f96db7-gnp5h -- nslookup kubernetes.io
multinode_test.go:546: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-269236 -- exec busybox-7b57f96db7-gdvtp -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-269236 -- exec busybox-7b57f96db7-gnp5h -- nslookup kubernetes.default
multinode_test.go:554: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-269236 -- exec busybox-7b57f96db7-gdvtp -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-269236 -- exec busybox-7b57f96db7-gnp5h -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (4.73s)
=== RUN TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-269236 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:572: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-269236 -- exec busybox-7b57f96db7-gdvtp -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-269236 -- exec busybox-7b57f96db7-gdvtp -- sh -c "ping -c 1 192.168.67.1"
multinode_test.go:572: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-269236 -- exec busybox-7b57f96db7-gnp5h -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run: out/minikube-linux-amd64 kubectl -p multinode-269236 -- exec busybox-7b57f96db7-gnp5h -- sh -c "ping -c 1 192.168.67.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (0.77s)
=== RUN TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run: out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.68s)
=== RUN TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 status --output json --alsologtostderr
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 cp testdata/cp-test.txt multinode-269236:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 cp multinode-269236:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2296824348/001/cp-test_multinode-269236.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 cp multinode-269236:/home/docker/cp-test.txt multinode-269236-m02:/home/docker/cp-test_multinode-269236_multinode-269236-m02.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236-m02 "sudo cat /home/docker/cp-test_multinode-269236_multinode-269236-m02.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 cp multinode-269236:/home/docker/cp-test.txt multinode-269236-m03:/home/docker/cp-test_multinode-269236_multinode-269236-m03.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236-m03 "sudo cat /home/docker/cp-test_multinode-269236_multinode-269236-m03.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 cp testdata/cp-test.txt multinode-269236-m02:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 cp multinode-269236-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2296824348/001/cp-test_multinode-269236-m02.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 cp multinode-269236-m02:/home/docker/cp-test.txt multinode-269236:/home/docker/cp-test_multinode-269236-m02_multinode-269236.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236 "sudo cat /home/docker/cp-test_multinode-269236-m02_multinode-269236.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 cp multinode-269236-m02:/home/docker/cp-test.txt multinode-269236-m03:/home/docker/cp-test_multinode-269236-m02_multinode-269236-m03.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236-m03 "sudo cat /home/docker/cp-test_multinode-269236-m02_multinode-269236-m03.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 cp testdata/cp-test.txt multinode-269236-m03:/home/docker/cp-test.txt
E1002 20:38:18.937361 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 cp multinode-269236-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2296824348/001/cp-test_multinode-269236-m03.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 cp multinode-269236-m03:/home/docker/cp-test.txt multinode-269236:/home/docker/cp-test_multinode-269236-m03_multinode-269236.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236 "sudo cat /home/docker/cp-test_multinode-269236-m03_multinode-269236.txt"
helpers_test.go:573: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 cp multinode-269236-m03:/home/docker/cp-test.txt multinode-269236-m02:/home/docker/cp-test_multinode-269236-m03_multinode-269236-m02.txt
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 ssh -n multinode-269236-m02 "sudo cat /home/docker/cp-test_multinode-269236-m03_multinode-269236-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (10.01s)
=== RUN TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 node stop m03
multinode_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p multinode-269236 node stop m03: (1.254231837s)
multinode_test.go:254: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-269236 status: exit status 7 (514.741271ms)
-- stdout --
multinode-269236
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
multinode-269236-m02
type: Worker
host: Running
kubelet: Running
multinode-269236-m03
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
multinode_test.go:261: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-269236 status --alsologtostderr: exit status 7 (510.353121ms)
-- stdout --
multinode-269236
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured
multinode-269236-m02
type: Worker
host: Running
kubelet: Running
multinode-269236-m03
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
** stderr **
I1002 20:38:23.855043 286360 out.go:360] Setting OutFile to fd 1 ...
I1002 20:38:23.855164 286360 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:38:23.855172 286360 out.go:374] Setting ErrFile to fd 2...
I1002 20:38:23.855178 286360 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:38:23.855408 286360 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:38:23.855602 286360 out.go:368] Setting JSON to false
I1002 20:38:23.855636 286360 mustload.go:65] Loading cluster: multinode-269236
I1002 20:38:23.855774 286360 notify.go:220] Checking for updates...
I1002 20:38:23.856103 286360 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:38:23.856123 286360 status.go:174] checking status of multinode-269236 ...
I1002 20:38:23.856586 286360 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:38:23.876389 286360 status.go:371] multinode-269236 host status = "Running" (err=<nil>)
I1002 20:38:23.876420 286360 host.go:66] Checking if "multinode-269236" exists ...
I1002 20:38:23.876685 286360 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236
I1002 20:38:23.895403 286360 host.go:66] Checking if "multinode-269236" exists ...
I1002 20:38:23.895739 286360 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1002 20:38:23.895779 286360 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236
I1002 20:38:23.915764 286360 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33029 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236/id_rsa Username:docker}
I1002 20:38:24.016523 286360 ssh_runner.go:195] Run: systemctl --version
I1002 20:38:24.023402 286360 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1002 20:38:24.037859 286360 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 20:38:24.095217 286360 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:51 OomKillDisable:false NGoroutines:65 SystemTime:2025-10-02 20:38:24.084407487 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1041-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652174848 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-2 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:b98a3aace656320842a23f4a392a33f46af97866 Expected:} RuncCommit:{ID:v1.3.0-0-g4ca628d1 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.29.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.4] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v0.1.40] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1002 20:38:24.095710 286360 kubeconfig.go:125] found "multinode-269236" server: "https://192.168.67.2:8443"
I1002 20:38:24.095739 286360 api_server.go:166] Checking apiserver status ...
I1002 20:38:24.095775 286360 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1002 20:38:24.108192 286360 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1374/cgroup
W1002 20:38:24.117566 286360 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1374/cgroup: Process exited with status 1
stdout:
stderr:
I1002 20:38:24.117629 286360 ssh_runner.go:195] Run: ls
I1002 20:38:24.122096 286360 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
I1002 20:38:24.126375 286360 api_server.go:279] https://192.168.67.2:8443/healthz returned 200:
ok
I1002 20:38:24.126406 286360 status.go:463] multinode-269236 apiserver status = Running (err=<nil>)
I1002 20:38:24.126438 286360 status.go:176] multinode-269236 status: &{Name:multinode-269236 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1002 20:38:24.126467 286360 status.go:174] checking status of multinode-269236-m02 ...
I1002 20:38:24.126736 286360 cli_runner.go:164] Run: docker container inspect multinode-269236-m02 --format={{.State.Status}}
I1002 20:38:24.144870 286360 status.go:371] multinode-269236-m02 host status = "Running" (err=<nil>)
I1002 20:38:24.144897 286360 host.go:66] Checking if "multinode-269236-m02" exists ...
I1002 20:38:24.145135 286360 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-269236-m02
I1002 20:38:24.164163 286360 host.go:66] Checking if "multinode-269236-m02" exists ...
I1002 20:38:24.164502 286360 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1002 20:38:24.164544 286360 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-269236-m02
I1002 20:38:24.183749 286360 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33034 SSHKeyPath:/home/jenkins/minikube-integration/21682-131316/.minikube/machines/multinode-269236-m02/id_rsa Username:docker}
I1002 20:38:24.283186 286360 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1002 20:38:24.296105 286360 status.go:176] multinode-269236-m02 status: &{Name:multinode-269236-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
I1002 20:38:24.296149 286360 status.go:174] checking status of multinode-269236-m03 ...
I1002 20:38:24.296414 286360 cli_runner.go:164] Run: docker container inspect multinode-269236-m03 --format={{.State.Status}}
I1002 20:38:24.314745 286360 status.go:371] multinode-269236-m03 host status = "Stopped" (err=<nil>)
I1002 20:38:24.314766 286360 status.go:384] host is not running, skipping remaining checks
I1002 20:38:24.314772 286360 status.go:176] multinode-269236-m03 status: &{Name:multinode-269236-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.28s)
=== RUN TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 node start m03 -v=5 --alsologtostderr
multinode_test.go:282: (dbg) Done: out/minikube-linux-amd64 -p multinode-269236 node start m03 -v=5 --alsologtostderr: (6.430243485s)
multinode_test.go:290: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 status -v=5 --alsologtostderr
multinode_test.go:306: (dbg) Run: kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (7.16s)
=== RUN TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run: out/minikube-linux-amd64 node list -p multinode-269236
multinode_test.go:321: (dbg) Run: out/minikube-linux-amd64 stop -p multinode-269236
E1002 20:38:42.085030 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
multinode_test.go:321: (dbg) Done: out/minikube-linux-amd64 stop -p multinode-269236: (24.96502891s)
multinode_test.go:326: (dbg) Run: out/minikube-linux-amd64 start -p multinode-269236 --wait=true -v=5 --alsologtostderr
E1002 20:39:42.006243 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
multinode_test.go:326: (dbg) Done: out/minikube-linux-amd64 start -p multinode-269236 --wait=true -v=5 --alsologtostderr: (45.963528649s)
multinode_test.go:331: (dbg) Run: out/minikube-linux-amd64 node list -p multinode-269236
--- PASS: TestMultiNode/serial/RestartKeepsNodes (71.03s)
=== RUN TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 node delete m03
multinode_test.go:416: (dbg) Done: out/minikube-linux-amd64 -p multinode-269236 node delete m03: (4.628582404s)
multinode_test.go:422: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 status --alsologtostderr
multinode_test.go:436: (dbg) Run: kubectl get nodes
multinode_test.go:444: (dbg) Run: kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.24s)
=== RUN TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 stop
multinode_test.go:345: (dbg) Done: out/minikube-linux-amd64 -p multinode-269236 stop: (23.77234488s)
multinode_test.go:351: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-269236 status: exit status 7 (96.661248ms)
-- stdout --
multinode-269236
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
multinode-269236-m02
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
multinode_test.go:358: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-269236 status --alsologtostderr: exit status 7 (96.416615ms)
-- stdout --
multinode-269236
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
multinode-269236-m02
type: Worker
host: Stopped
kubelet: Stopped
-- /stdout --
** stderr **
I1002 20:40:11.666797 296069 out.go:360] Setting OutFile to fd 1 ...
I1002 20:40:11.667081 296069 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:40:11.667092 296069 out.go:374] Setting ErrFile to fd 2...
I1002 20:40:11.667097 296069 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:40:11.667310 296069 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:40:11.667489 296069 out.go:368] Setting JSON to false
I1002 20:40:11.667516 296069 mustload.go:65] Loading cluster: multinode-269236
I1002 20:40:11.667669 296069 notify.go:220] Checking for updates...
I1002 20:40:11.668024 296069 config.go:182] Loaded profile config "multinode-269236": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:40:11.668044 296069 status.go:174] checking status of multinode-269236 ...
I1002 20:40:11.668563 296069 cli_runner.go:164] Run: docker container inspect multinode-269236 --format={{.State.Status}}
I1002 20:40:11.691217 296069 status.go:371] multinode-269236 host status = "Stopped" (err=<nil>)
I1002 20:40:11.691242 296069 status.go:384] host is not running, skipping remaining checks
I1002 20:40:11.691249 296069 status.go:176] multinode-269236 status: &{Name:multinode-269236 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
I1002 20:40:11.691293 296069 status.go:174] checking status of multinode-269236-m02 ...
I1002 20:40:11.691537 296069 cli_runner.go:164] Run: docker container inspect multinode-269236-m02 --format={{.State.Status}}
I1002 20:40:11.713465 296069 status.go:371] multinode-269236-m02 host status = "Stopped" (err=<nil>)
I1002 20:40:11.713490 296069 status.go:384] host is not running, skipping remaining checks
I1002 20:40:11.713496 296069 status.go:176] multinode-269236-m02 status: &{Name:multinode-269236-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (23.97s)
=== RUN TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run: out/minikube-linux-amd64 start -p multinode-269236 --wait=true -v=5 --alsologtostderr --driver=docker --container-runtime=containerd
multinode_test.go:376: (dbg) Done: out/minikube-linux-amd64 start -p multinode-269236 --wait=true -v=5 --alsologtostderr --driver=docker --container-runtime=containerd: (47.203394699s)
multinode_test.go:382: (dbg) Run: out/minikube-linux-amd64 -p multinode-269236 status --alsologtostderr
multinode_test.go:396: (dbg) Run: kubectl get nodes
multinode_test.go:404: (dbg) Run: kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (47.82s)
=== RUN TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run: out/minikube-linux-amd64 node list -p multinode-269236
multinode_test.go:464: (dbg) Run: out/minikube-linux-amd64 start -p multinode-269236-m02 --driver=docker --container-runtime=containerd
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p multinode-269236-m02 --driver=docker --container-runtime=containerd: exit status 14 (70.185965ms)
-- stdout --
* [multinode-269236-m02] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
- MINIKUBE_LOCATION=21682
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/21682-131316/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/21682-131316/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
-- /stdout --
** stderr **
! Profile name 'multinode-269236-m02' is duplicated with machine name 'multinode-269236-m02' in profile 'multinode-269236'
X Exiting due to MK_USAGE: Profile name should be unique
** /stderr **
multinode_test.go:472: (dbg) Run: out/minikube-linux-amd64 start -p multinode-269236-m03 --driver=docker --container-runtime=containerd
multinode_test.go:472: (dbg) Done: out/minikube-linux-amd64 start -p multinode-269236-m03 --driver=docker --container-runtime=containerd: (21.630013111s)
multinode_test.go:479: (dbg) Run: out/minikube-linux-amd64 node add -p multinode-269236
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-linux-amd64 node add -p multinode-269236: exit status 80 (293.314441ms)
-- stdout --
* Adding node m03 to cluster multinode-269236 as [worker]
-- /stdout --
** stderr **
X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-269236-m03 already exists in multinode-269236-m03 profile
*
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ * Please also attach the following file to the GitHub issue: │
│ * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
** /stderr **
multinode_test.go:484: (dbg) Run: out/minikube-linux-amd64 delete -p multinode-269236-m03
multinode_test.go:484: (dbg) Done: out/minikube-linux-amd64 delete -p multinode-269236-m03: (1.960881221s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (24.01s)
=== RUN TestPreload
preload_test.go:43: (dbg) Run: out/minikube-linux-amd64 start -p test-preload-305546 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.32.0
preload_test.go:43: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-305546 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.32.0: (47.381276053s)
preload_test.go:51: (dbg) Run: out/minikube-linux-amd64 -p test-preload-305546 image pull gcr.io/k8s-minikube/busybox
preload_test.go:51: (dbg) Done: out/minikube-linux-amd64 -p test-preload-305546 image pull gcr.io/k8s-minikube/busybox: (2.385347286s)
preload_test.go:57: (dbg) Run: out/minikube-linux-amd64 stop -p test-preload-305546
preload_test.go:57: (dbg) Done: out/minikube-linux-amd64 stop -p test-preload-305546: (6.612552163s)
preload_test.go:65: (dbg) Run: out/minikube-linux-amd64 start -p test-preload-305546 --memory=3072 --alsologtostderr -v=1 --wait=true --driver=docker --container-runtime=containerd
E1002 20:43:18.937560 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
preload_test.go:65: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-305546 --memory=3072 --alsologtostderr -v=1 --wait=true --driver=docker --container-runtime=containerd: (53.432197558s)
preload_test.go:70: (dbg) Run: out/minikube-linux-amd64 -p test-preload-305546 image list
helpers_test.go:175: Cleaning up "test-preload-305546" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p test-preload-305546
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p test-preload-305546: (2.48813561s)
--- PASS: TestPreload (112.53s)
=== RUN TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run: out/minikube-linux-amd64 start -p scheduled-stop-235849 --memory=3072 --driver=docker --container-runtime=containerd
E1002 20:43:42.086298 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-amd64 start -p scheduled-stop-235849 --memory=3072 --driver=docker --container-runtime=containerd: (21.06658173s)
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-235849 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run: out/minikube-linux-amd64 status --format={{.TimeToStop}} -p scheduled-stop-235849 -n scheduled-stop-235849
scheduled_stop_test.go:169: signal error was: <nil>
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-235849 --schedule 15s
scheduled_stop_test.go:169: signal error was: os: process already finished
I1002 20:43:43.774362 134834 retry.go:31] will retry after 97.14µs: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
I1002 20:43:43.775530 134834 retry.go:31] will retry after 187.559µs: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
I1002 20:43:43.776705 134834 retry.go:31] will retry after 113.789µs: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
I1002 20:43:43.777865 134834 retry.go:31] will retry after 429.978µs: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
I1002 20:43:43.778982 134834 retry.go:31] will retry after 684.523µs: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
I1002 20:43:43.780112 134834 retry.go:31] will retry after 440.06µs: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
I1002 20:43:43.781254 134834 retry.go:31] will retry after 1.192616ms: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
I1002 20:43:43.783471 134834 retry.go:31] will retry after 2.240775ms: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
I1002 20:43:43.786733 134834 retry.go:31] will retry after 1.905012ms: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
I1002 20:43:43.789005 134834 retry.go:31] will retry after 3.236966ms: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
I1002 20:43:43.793234 134834 retry.go:31] will retry after 6.752518ms: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
I1002 20:43:43.800497 134834 retry.go:31] will retry after 6.70714ms: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
I1002 20:43:43.808117 134834 retry.go:31] will retry after 13.872343ms: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
I1002 20:43:43.822395 134834 retry.go:31] will retry after 16.910099ms: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
I1002 20:43:43.839691 134834 retry.go:31] will retry after 17.62708ms: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
I1002 20:43:43.858013 134834 retry.go:31] will retry after 44.392779ms: open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/scheduled-stop-235849/pid: no such file or directory
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-235849 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-235849 -n scheduled-stop-235849
scheduled_stop_test.go:205: (dbg) Run: out/minikube-linux-amd64 status -p scheduled-stop-235849
scheduled_stop_test.go:137: (dbg) Run: out/minikube-linux-amd64 stop -p scheduled-stop-235849 --schedule 15s
scheduled_stop_test.go:169: signal error was: os: process already finished
scheduled_stop_test.go:205: (dbg) Run: out/minikube-linux-amd64 status -p scheduled-stop-235849
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p scheduled-stop-235849: exit status 7 (72.114847ms)
-- stdout --
scheduled-stop-235849
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-235849 -n scheduled-stop-235849
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-235849 -n scheduled-stop-235849: exit status 7 (69.424905ms)
-- stdout --
Stopped
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-235849" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p scheduled-stop-235849
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p scheduled-stop-235849: (4.413313609s)
--- PASS: TestScheduledStopUnix (96.94s)
=== RUN TestInsufficientStorage
status_test.go:50: (dbg) Run: out/minikube-linux-amd64 start -p insufficient-storage-580570 --memory=3072 --output=json --wait=true --driver=docker --container-runtime=containerd
E1002 20:45:05.153064 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p insufficient-storage-580570 --memory=3072 --output=json --wait=true --driver=docker --container-runtime=containerd: exit status 26 (7.28224706s)
-- stdout --
{"specversion":"1.0","id":"ab131ee3-ce64-4556-b7a4-57354c77a303","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-580570] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
{"specversion":"1.0","id":"a125bfc6-f38b-4953-8d94-82ce5e7d7a3e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=21682"}}
{"specversion":"1.0","id":"f03bb2a4-96c4-4fb8-b438-f95198fda5bd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
{"specversion":"1.0","id":"aa61bf3d-17a2-464c-a9f5-29f87b628a06","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/21682-131316/kubeconfig"}}
{"specversion":"1.0","id":"3cc55129-0b5b-4a76-838e-aaa8982637cc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/21682-131316/.minikube"}}
{"specversion":"1.0","id":"75ddd995-6c6e-4edd-b3f6-19f56e419546","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
{"specversion":"1.0","id":"7c17f9d5-5b70-4993-ac67-3a8d4af21439","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
{"specversion":"1.0","id":"4d36518c-a72b-40fc-b8eb-b08c84ff9eb1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
{"specversion":"1.0","id":"f71365fb-9b97-4283-be9b-8cfdc3cb802e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
{"specversion":"1.0","id":"88bbaa66-7a38-46fb-9086-e5482d694886","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
{"specversion":"1.0","id":"3906e6c2-acc4-4955-9415-7878c02516f1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
{"specversion":"1.0","id":"362f1502-aa98-46ed-b14f-2e4d472550af","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"insufficient-storage-580570\" primary control-plane node in \"insufficient-storage-580570\" cluster","name":"Starting Node","totalsteps":"19"}}
{"specversion":"1.0","id":"e9ff95eb-6554-4a03-af1c-e561a71b58fc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image v0.0.48-1759382731-21643 ...","name":"Pulling Base Image","totalsteps":"19"}}
{"specversion":"1.0","id":"a02e1376-8336-4f31-964d-7c076b704d03","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=3072MB) ...","name":"Creating Container","totalsteps":"19"}}
{"specversion":"1.0","id":"211638f0-0768-4880-ab7d-d4328e25e7e8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}
-- /stdout --
status_test.go:76: (dbg) Run: out/minikube-linux-amd64 status -p insufficient-storage-580570 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-580570 --output=json --layout=cluster: exit status 7 (293.590268ms)
-- stdout --
{"Name":"insufficient-storage-580570","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=3072MB) ...","BinaryVersion":"v1.37.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-580570","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}
-- /stdout --
** stderr **
E1002 20:45:06.779690 318429 status.go:458] kubeconfig endpoint: get endpoint: "insufficient-storage-580570" does not appear in /home/jenkins/minikube-integration/21682-131316/kubeconfig
** /stderr **
status_test.go:76: (dbg) Run: out/minikube-linux-amd64 status -p insufficient-storage-580570 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-580570 --output=json --layout=cluster: exit status 7 (295.757145ms)
-- stdout --
{"Name":"insufficient-storage-580570","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.37.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-580570","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}
-- /stdout --
** stderr **
E1002 20:45:07.076156 318536 status.go:458] kubeconfig endpoint: get endpoint: "insufficient-storage-580570" does not appear in /home/jenkins/minikube-integration/21682-131316/kubeconfig
E1002 20:45:07.086872 318536 status.go:258] unable to read event log: stat: stat /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/insufficient-storage-580570/events.json: no such file or directory
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-580570" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p insufficient-storage-580570
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p insufficient-storage-580570: (1.903391606s)
--- PASS: TestInsufficientStorage (9.78s)
=== RUN TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade
=== CONT TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run: /tmp/minikube-v1.32.0.4121421800 start -p running-upgrade-099918 --memory=3072 --vm-driver=docker --container-runtime=containerd
version_upgrade_test.go:120: (dbg) Done: /tmp/minikube-v1.32.0.4121421800 start -p running-upgrade-099918 --memory=3072 --vm-driver=docker --container-runtime=containerd: (21.302067442s)
version_upgrade_test.go:130: (dbg) Run: out/minikube-linux-amd64 start -p running-upgrade-099918 --memory=3072 --alsologtostderr -v=1 --driver=docker --container-runtime=containerd
version_upgrade_test.go:130: (dbg) Done: out/minikube-linux-amd64 start -p running-upgrade-099918 --memory=3072 --alsologtostderr -v=1 --driver=docker --container-runtime=containerd: (21.482244245s)
helpers_test.go:175: Cleaning up "running-upgrade-099918" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p running-upgrade-099918
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p running-upgrade-099918: (1.995718707s)
--- PASS: TestRunningBinaryUpgrade (45.33s)
=== RUN TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade
=== CONT TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-818734 --memory=3072 --kubernetes-version=v1.28.0 --alsologtostderr -v=1 --driver=docker --container-runtime=containerd
version_upgrade_test.go:222: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-818734 --memory=3072 --kubernetes-version=v1.28.0 --alsologtostderr -v=1 --driver=docker --container-runtime=containerd: (24.709829056s)
version_upgrade_test.go:227: (dbg) Run: out/minikube-linux-amd64 stop -p kubernetes-upgrade-818734
version_upgrade_test.go:227: (dbg) Done: out/minikube-linux-amd64 stop -p kubernetes-upgrade-818734: (3.333684922s)
version_upgrade_test.go:232: (dbg) Run: out/minikube-linux-amd64 -p kubernetes-upgrade-818734 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-linux-amd64 -p kubernetes-upgrade-818734 status --format={{.Host}}: exit status 7 (93.196428ms)
-- stdout --
Stopped
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-818734 --memory=3072 --kubernetes-version=v1.34.1 --alsologtostderr -v=1 --driver=docker --container-runtime=containerd
version_upgrade_test.go:243: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-818734 --memory=3072 --kubernetes-version=v1.34.1 --alsologtostderr -v=1 --driver=docker --container-runtime=containerd: (4m39.30754593s)
version_upgrade_test.go:248: (dbg) Run: kubectl --context kubernetes-upgrade-818734 version --output=json
version_upgrade_test.go:267: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:269: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-818734 --memory=3072 --kubernetes-version=v1.28.0 --driver=docker --container-runtime=containerd
version_upgrade_test.go:269: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p kubernetes-upgrade-818734 --memory=3072 --kubernetes-version=v1.28.0 --driver=docker --container-runtime=containerd: exit status 106 (82.9872ms)
-- stdout --
* [kubernetes-upgrade-818734] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
- MINIKUBE_LOCATION=21682
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/21682-131316/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/21682-131316/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
-- /stdout --
** stderr **
X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.34.1 cluster to v1.28.0
* Suggestion:
1) Recreate the cluster with Kubernetes 1.28.0, by running:
minikube delete -p kubernetes-upgrade-818734
minikube start -p kubernetes-upgrade-818734 --kubernetes-version=v1.28.0
2) Create a second cluster with Kubernetes 1.28.0, by running:
minikube start -p kubernetes-upgrade-8187342 --kubernetes-version=v1.28.0
3) Use the existing cluster at version Kubernetes 1.34.1, by running:
minikube start -p kubernetes-upgrade-818734 --kubernetes-version=v1.34.1
** /stderr **
version_upgrade_test.go:273: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:275: (dbg) Run: out/minikube-linux-amd64 start -p kubernetes-upgrade-818734 --memory=3072 --kubernetes-version=v1.34.1 --alsologtostderr -v=1 --driver=docker --container-runtime=containerd
version_upgrade_test.go:275: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-818734 --memory=3072 --kubernetes-version=v1.34.1 --alsologtostderr -v=1 --driver=docker --container-runtime=containerd: (12.59562887s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-818734" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p kubernetes-upgrade-818734
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p kubernetes-upgrade-818734: (2.839232682s)
--- PASS: TestKubernetesUpgrade (323.03s)
=== RUN TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade
=== CONT TestMissingContainerUpgrade
version_upgrade_test.go:309: (dbg) Run: /tmp/minikube-v1.32.0.980089241 start -p missing-upgrade-421853 --memory=3072 --driver=docker --container-runtime=containerd
version_upgrade_test.go:309: (dbg) Done: /tmp/minikube-v1.32.0.980089241 start -p missing-upgrade-421853 --memory=3072 --driver=docker --container-runtime=containerd: (22.162309482s)
version_upgrade_test.go:318: (dbg) Run: docker stop missing-upgrade-421853
version_upgrade_test.go:318: (dbg) Done: docker stop missing-upgrade-421853: (1.763676922s)
version_upgrade_test.go:323: (dbg) Run: docker rm missing-upgrade-421853
version_upgrade_test.go:329: (dbg) Run: out/minikube-linux-amd64 start -p missing-upgrade-421853 --memory=3072 --alsologtostderr -v=1 --driver=docker --container-runtime=containerd
version_upgrade_test.go:329: (dbg) Done: out/minikube-linux-amd64 start -p missing-upgrade-421853 --memory=3072 --alsologtostderr -v=1 --driver=docker --container-runtime=containerd: (1m9.143865833s)
helpers_test.go:175: Cleaning up "missing-upgrade-421853" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p missing-upgrade-421853
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p missing-upgrade-421853: (2.046419014s)
--- PASS: TestMissingContainerUpgrade (95.64s)
=== RUN TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:85: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-986118 --no-kubernetes --kubernetes-version=v1.28.0 --driver=docker --container-runtime=containerd
no_kubernetes_test.go:85: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p NoKubernetes-986118 --no-kubernetes --kubernetes-version=v1.28.0 --driver=docker --container-runtime=containerd: exit status 14 (95.165342ms)
-- stdout --
* [NoKubernetes-986118] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
- MINIKUBE_LOCATION=21682
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/21682-131316/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/21682-131316/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
-- /stdout --
** stderr **
X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
to unset a global config run:
$ minikube config unset kubernetes-version
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.10s)
=== RUN TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (1.14s)
=== RUN TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:97: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-986118 --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=containerd
no_kubernetes_test.go:97: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-986118 --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=containerd: (36.765362183s)
no_kubernetes_test.go:202: (dbg) Run: out/minikube-linux-amd64 -p NoKubernetes-986118 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (37.30s)
=== RUN TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run: /tmp/minikube-v1.32.0.1435328300 start -p stopped-upgrade-110542 --memory=3072 --vm-driver=docker --container-runtime=containerd
version_upgrade_test.go:183: (dbg) Done: /tmp/minikube-v1.32.0.1435328300 start -p stopped-upgrade-110542 --memory=3072 --vm-driver=docker --container-runtime=containerd: (43.032396316s)
version_upgrade_test.go:192: (dbg) Run: /tmp/minikube-v1.32.0.1435328300 -p stopped-upgrade-110542 stop
version_upgrade_test.go:192: (dbg) Done: /tmp/minikube-v1.32.0.1435328300 -p stopped-upgrade-110542 stop: (3.307097836s)
version_upgrade_test.go:198: (dbg) Run: out/minikube-linux-amd64 start -p stopped-upgrade-110542 --memory=3072 --alsologtostderr -v=1 --driver=docker --container-runtime=containerd
version_upgrade_test.go:198: (dbg) Done: out/minikube-linux-amd64 start -p stopped-upgrade-110542 --memory=3072 --alsologtostderr -v=1 --driver=docker --container-runtime=containerd: (27.616597171s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (73.96s)
=== RUN TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:114: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-986118 --no-kubernetes --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=containerd
no_kubernetes_test.go:114: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-986118 --no-kubernetes --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=containerd: (21.576229584s)
no_kubernetes_test.go:202: (dbg) Run: out/minikube-linux-amd64 -p NoKubernetes-986118 status -o json
no_kubernetes_test.go:202: (dbg) Non-zero exit: out/minikube-linux-amd64 -p NoKubernetes-986118 status -o json: exit status 2 (310.628792ms)
-- stdout --
{"Name":"NoKubernetes-986118","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}
-- /stdout --
no_kubernetes_test.go:126: (dbg) Run: out/minikube-linux-amd64 delete -p NoKubernetes-986118
no_kubernetes_test.go:126: (dbg) Done: out/minikube-linux-amd64 delete -p NoKubernetes-986118: (2.046568475s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (23.93s)
=== RUN TestNoKubernetes/serial/Start
no_kubernetes_test.go:138: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-986118 --no-kubernetes --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=containerd
no_kubernetes_test.go:138: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-986118 --no-kubernetes --memory=3072 --alsologtostderr -v=5 --driver=docker --container-runtime=containerd: (4.717370324s)
--- PASS: TestNoKubernetes/serial/Start (4.72s)
=== RUN TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:149: (dbg) Run: out/minikube-linux-amd64 ssh -p NoKubernetes-986118 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:149: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-986118 "sudo systemctl is-active --quiet service kubelet": exit status 1 (285.464809ms)
** stderr **
ssh: Process exited with status 3
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.29s)
=== RUN TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:171: (dbg) Run: out/minikube-linux-amd64 profile list
no_kubernetes_test.go:181: (dbg) Run: out/minikube-linux-amd64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (1.14s)
=== RUN TestNoKubernetes/serial/Stop
no_kubernetes_test.go:160: (dbg) Run: out/minikube-linux-amd64 stop -p NoKubernetes-986118
no_kubernetes_test.go:160: (dbg) Done: out/minikube-linux-amd64 stop -p NoKubernetes-986118: (2.06737155s)
--- PASS: TestNoKubernetes/serial/Stop (2.07s)
=== RUN TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:193: (dbg) Run: out/minikube-linux-amd64 start -p NoKubernetes-986118 --driver=docker --container-runtime=containerd
no_kubernetes_test.go:193: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-986118 --driver=docker --container-runtime=containerd: (6.745369988s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (6.75s)
=== RUN TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run: out/minikube-linux-amd64 logs -p stopped-upgrade-110542
version_upgrade_test.go:206: (dbg) Done: out/minikube-linux-amd64 logs -p stopped-upgrade-110542: (1.281394657s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.28s)
=== RUN TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:149: (dbg) Run: out/minikube-linux-amd64 ssh -p NoKubernetes-986118 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:149: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-986118 "sudo systemctl is-active --quiet service kubelet": exit status 1 (300.117919ms)
** stderr **
ssh: Process exited with status 3
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.30s)
=== RUN TestNetworkPlugins/group/false
net_test.go:246: (dbg) Run: out/minikube-linux-amd64 start -p false-193808 --memory=3072 --alsologtostderr --cni=false --driver=docker --container-runtime=containerd
net_test.go:246: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p false-193808 --memory=3072 --alsologtostderr --cni=false --driver=docker --container-runtime=containerd: exit status 14 (917.938525ms)
-- stdout --
* [false-193808] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
- MINIKUBE_LOCATION=21682
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/21682-131316/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/21682-131316/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
- MINIKUBE_FORCE_SYSTEMD=
* Using the docker driver based on user configuration
-- /stdout --
** stderr **
I1002 20:46:31.312043 345219 out.go:360] Setting OutFile to fd 1 ...
I1002 20:46:31.312304 345219 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:46:31.312313 345219 out.go:374] Setting ErrFile to fd 2...
I1002 20:46:31.312318 345219 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1002 20:46:31.312556 345219 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21682-131316/.minikube/bin
I1002 20:46:31.313065 345219 out.go:368] Setting JSON to false
I1002 20:46:31.314176 345219 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-2","uptime":5340,"bootTime":1759432651,"procs":254,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1041-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1002 20:46:31.314270 345219 start.go:140] virtualization: kvm guest
I1002 20:46:31.344051 345219 out.go:179] * [false-193808] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
I1002 20:46:31.424219 345219 notify.go:220] Checking for updates...
I1002 20:46:31.424265 345219 out.go:179] - MINIKUBE_LOCATION=21682
I1002 20:46:31.486878 345219 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1002 20:46:31.522714 345219 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21682-131316/kubeconfig
I1002 20:46:31.527434 345219 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21682-131316/.minikube
I1002 20:46:31.680983 345219 out.go:179] - MINIKUBE_BIN=out/minikube-linux-amd64
I1002 20:46:31.687242 345219 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1002 20:46:31.691907 345219 config.go:182] Loaded profile config "cert-expiration-008968": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
I1002 20:46:31.692044 345219 config.go:182] Loaded profile config "kubernetes-upgrade-818734": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.0
I1002 20:46:31.692116 345219 config.go:182] Loaded profile config "missing-upgrade-421853": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.28.3
I1002 20:46:31.692208 345219 driver.go:421] Setting default libvirt URI to qemu:///system
I1002 20:46:31.716676 345219 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
I1002 20:46:31.716798 345219 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1002 20:46:31.773788 345219 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:43 OomKillDisable:false NGoroutines:63 SystemTime:2025-10-02 20:46:31.763562574 +0000 UTC LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:6.8.0-1041-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652174848 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-2 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:b98a3aace656320842a23f4a392a33f46af97866 Expected:} RuncCommit:{ID:v1.3.0-0-g4ca628d1 Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.29.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.4] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner Vendor:Docker Inc. Version:v0.1.40] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I1002 20:46:31.773943 345219 docker.go:318] overlay module found
I1002 20:46:31.783405 345219 out.go:179] * Using the docker driver based on user configuration
I1002 20:46:31.874644 345219 start.go:304] selected driver: docker
I1002 20:46:31.874671 345219 start.go:924] validating driver "docker" against <nil>
I1002 20:46:31.874689 345219 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1002 20:46:31.938211 345219 out.go:203]
W1002 20:46:31.958342 345219 out.go:285] X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
I1002 20:46:32.074761 345219 out.go:203]
** /stderr **
net_test.go:88:
----------------------- debugLogs start: false-193808 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: false-193808
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: false-193808
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: false-193808
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: false-193808
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: false-193808
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: false-193808
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: false-193808
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: false-193808
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: false-193808
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: false-193808
>>> host: /etc/nsswitch.conf:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: /etc/hosts:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: /etc/resolv.conf:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: false-193808
>>> host: crictl pods:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: crictl containers:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> k8s: describe netcat deployment:
error: context "false-193808" does not exist
>>> k8s: describe netcat pod(s):
error: context "false-193808" does not exist
>>> k8s: netcat logs:
error: context "false-193808" does not exist
>>> k8s: describe coredns deployment:
error: context "false-193808" does not exist
>>> k8s: describe coredns pods:
error: context "false-193808" does not exist
>>> k8s: coredns logs:
error: context "false-193808" does not exist
>>> k8s: describe api server pod(s):
error: context "false-193808" does not exist
>>> k8s: api server logs:
error: context "false-193808" does not exist
>>> host: /etc/cni:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: ip a s:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: ip r s:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: iptables-save:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: iptables table nat:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> k8s: describe kube-proxy daemon set:
error: context "false-193808" does not exist
>>> k8s: describe kube-proxy pod(s):
error: context "false-193808" does not exist
>>> k8s: kube-proxy logs:
error: context "false-193808" does not exist
>>> host: kubelet daemon status:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: kubelet daemon config:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> k8s: kubelet logs:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: /var/lib/kubelet/config.yaml:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 02 Oct 2025 20:46:10 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: cluster_info
server: https://192.168.76.2:8443
name: missing-upgrade-421853
contexts:
- context:
cluster: missing-upgrade-421853
extensions:
- extension:
last-update: Thu, 02 Oct 2025 20:46:10 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: context_info
namespace: default
user: missing-upgrade-421853
name: missing-upgrade-421853
current-context: ""
kind: Config
users:
- name: missing-upgrade-421853
user:
client-certificate: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/missing-upgrade-421853/client.crt
client-key: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/missing-upgrade-421853/client.key
>>> k8s: cms:
Error in configuration: context was not found for specified context: false-193808
>>> host: docker daemon status:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: docker daemon config:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: /etc/docker/daemon.json:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: docker system info:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: cri-docker daemon status:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: cri-docker daemon config:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: cri-dockerd version:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: containerd daemon status:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: containerd daemon config:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: /lib/systemd/system/containerd.service:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: /etc/containerd/config.toml:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: containerd config dump:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: crio daemon status:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: crio daemon config:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: /etc/crio:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
>>> host: crio config:
* Profile "false-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-193808"
----------------------- debugLogs end: false-193808 [took: 4.107430395s] --------------------------------
helpers_test.go:175: Cleaning up "false-193808" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p false-193808
--- PASS: TestNetworkPlugins/group/false (5.21s)
=== RUN TestPause/serial/Start
pause_test.go:80: (dbg) Run: out/minikube-linux-amd64 start -p pause-682877 --memory=3072 --install-addons=false --wait=all --driver=docker --container-runtime=containerd
pause_test.go:80: (dbg) Done: out/minikube-linux-amd64 start -p pause-682877 --memory=3072 --install-addons=false --wait=all --driver=docker --container-runtime=containerd: (41.649591494s)
--- PASS: TestPause/serial/Start (41.65s)
=== RUN TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run: out/minikube-linux-amd64 start -p pause-682877 --alsologtostderr -v=1 --driver=docker --container-runtime=containerd
pause_test.go:92: (dbg) Done: out/minikube-linux-amd64 start -p pause-682877 --alsologtostderr -v=1 --driver=docker --container-runtime=containerd: (6.086169835s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (6.10s)
=== RUN TestPause/serial/Pause
pause_test.go:110: (dbg) Run: out/minikube-linux-amd64 pause -p pause-682877 --alsologtostderr -v=5
--- PASS: TestPause/serial/Pause (0.72s)
=== RUN TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run: out/minikube-linux-amd64 status -p pause-682877 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p pause-682877 --output=json --layout=cluster: exit status 2 (361.987864ms)
-- stdout --
{"Name":"pause-682877","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 7 containers in: kube-system, kubernetes-dashboard, istio-operator","BinaryVersion":"v1.37.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-682877","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.36s)
=== RUN TestPause/serial/Unpause
pause_test.go:121: (dbg) Run: out/minikube-linux-amd64 unpause -p pause-682877 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.74s)
=== RUN TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run: out/minikube-linux-amd64 pause -p pause-682877 --alsologtostderr -v=5
--- PASS: TestPause/serial/PauseAgain (0.81s)
=== RUN TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run: out/minikube-linux-amd64 delete -p pause-682877 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-amd64 delete -p pause-682877 --alsologtostderr -v=5: (2.848462068s)
--- PASS: TestPause/serial/DeletePaused (2.85s)
=== RUN TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run: out/minikube-linux-amd64 profile list --output json
E1002 20:48:18.938086 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
pause_test.go:142: (dbg) Done: out/minikube-linux-amd64 profile list --output json: (14.777886261s)
pause_test.go:168: (dbg) Run: docker ps -a
pause_test.go:173: (dbg) Run: docker volume inspect pause-682877
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-682877: exit status 1 (18.836521ms)
-- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: get pause-682877: no such volume
** /stderr **
pause_test.go:178: (dbg) Run: docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (14.84s)
=== RUN TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p auto-193808 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p auto-193808 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker --container-runtime=containerd: (40.391473548s)
--- PASS: TestNetworkPlugins/group/auto/Start (40.39s)
=== RUN TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p kindnet-193808 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker --container-runtime=containerd
E1002 20:48:42.083594 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p kindnet-193808 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker --container-runtime=containerd: (39.26063926s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (39.26s)
=== RUN TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p auto-193808 "pgrep -a kubelet"
I1002 20:49:03.948320 134834 config.go:182] Loaded profile config "auto-193808": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.32s)
=== RUN TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context auto-193808 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-8wmqw" [a331bb76-b272-4d19-b462-835a3eee568b] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-8wmqw" [a331bb76-b272-4d19-b462-835a3eee568b] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 9.003800374s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (9.23s)
=== RUN TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:352: "kindnet-n52zd" [376e6062-f07b-4984-a915-dcc1dd5607fc] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 6.003238122s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)
=== RUN TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run: kubectl --context auto-193808 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.14s)
=== RUN TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run: kubectl --context auto-193808 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.11s)
=== RUN TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run: kubectl --context auto-193808 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.11s)
=== RUN TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p kindnet-193808 "pgrep -a kubelet"
I1002 20:49:18.378952 134834 config.go:182] Loaded profile config "kindnet-193808": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.31s)
=== RUN TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context kindnet-193808 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-5w4rm" [47b7ef6c-6538-4a23-bb22-9fa82982dd6f] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-5w4rm" [47b7ef6c-6538-4a23-bb22-9fa82982dd6f] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 9.002860005s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (9.22s)
=== RUN TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run: kubectl --context kindnet-193808 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.14s)
=== RUN TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run: kubectl --context kindnet-193808 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.12s)
=== RUN TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run: kubectl --context kindnet-193808 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.12s)
=== RUN TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p calico-193808 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p calico-193808 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker --container-runtime=containerd: (52.531159253s)
--- PASS: TestNetworkPlugins/group/calico/Start (52.53s)
=== RUN TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p custom-flannel-193808 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p custom-flannel-193808 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker --container-runtime=containerd: (1m0.889186405s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (60.89s)
=== RUN TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p enable-default-cni-193808 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p enable-default-cni-193808 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker --container-runtime=containerd: (1m5.904932837s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (65.91s)
=== RUN TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:352: "calico-node-9f2mn" [a72135da-84c2-442d-bba5-e14332ca2c97] Running / Ready:ContainersNotReady (containers with unready status: [calico-node]) / ContainersReady:ContainersNotReady (containers with unready status: [calico-node])
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 6.004318196s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (6.01s)
=== RUN TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p calico-193808 "pgrep -a kubelet"
I1002 20:50:31.820630 134834 config.go:182] Loaded profile config "calico-193808": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.31s)
=== RUN TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context calico-193808 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-rwjkt" [629c5093-7820-4a6d-9eb7-bb122e2893aa] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-rwjkt" [629c5093-7820-4a6d-9eb7-bb122e2893aa] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 8.004861557s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (8.18s)
=== RUN TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run: kubectl --context calico-193808 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.13s)
=== RUN TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run: kubectl --context calico-193808 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.11s)
=== RUN TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run: kubectl --context calico-193808 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.11s)
=== RUN TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p custom-flannel-193808 "pgrep -a kubelet"
I1002 20:50:49.700392 134834 config.go:182] Loaded profile config "custom-flannel-193808": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.33s)
=== RUN TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context custom-flannel-193808 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-sdjs4" [6d4ceab1-4dbb-408f-8252-675044d50731] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-sdjs4" [6d4ceab1-4dbb-408f-8252-675044d50731] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 8.004670258s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (8.24s)
=== RUN TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run: kubectl --context custom-flannel-193808 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.15s)
=== RUN TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run: kubectl --context custom-flannel-193808 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.12s)
=== RUN TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run: kubectl --context custom-flannel-193808 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.12s)
=== RUN TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p flannel-193808 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p flannel-193808 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker --container-runtime=containerd: (54.596511752s)
--- PASS: TestNetworkPlugins/group/flannel/Start (54.60s)
=== RUN TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p enable-default-cni-193808 "pgrep -a kubelet"
I1002 20:51:10.206806 134834 config.go:182] Loaded profile config "enable-default-cni-193808": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.36s)
=== RUN TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context enable-default-cni-193808 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-4vnkb" [dc514a57-9b70-4707-a981-e1ddf4a8c55c] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-4vnkb" [dc514a57-9b70-4707-a981-e1ddf4a8c55c] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 8.006088646s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (8.27s)
=== RUN TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run: kubectl --context enable-default-cni-193808 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.18s)
=== RUN TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run: kubectl --context enable-default-cni-193808 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.16s)
=== RUN TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run: kubectl --context enable-default-cni-193808 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.18s)
=== RUN TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run: out/minikube-linux-amd64 start -p bridge-193808 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p bridge-193808 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker --container-runtime=containerd: (1m5.964622167s)
--- PASS: TestNetworkPlugins/group/bridge/Start (65.96s)
=== RUN TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-876962 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.28.0
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-876962 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.28.0: (53.3729435s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (53.37s)
=== RUN TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p no-preload-516940 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-516940 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1: (52.110894648s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (52.11s)
=== RUN TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:352: "kube-flannel-ds-vrk7n" [c41a9ec5-b68e-422b-b221-c5151f709b11] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 6.004311211s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (6.01s)
=== RUN TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p flannel-193808 "pgrep -a kubelet"
I1002 20:52:01.612079 134834 config.go:182] Loaded profile config "flannel-193808": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.30s)
=== RUN TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context flannel-193808 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-rbdbf" [6de62a7c-a304-4d99-9b41-ee048b0c4801] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-rbdbf" [6de62a7c-a304-4d99-9b41-ee048b0c4801] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 9.003781281s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (9.19s)
=== RUN TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run: kubectl --context flannel-193808 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.14s)
=== RUN TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run: kubectl --context flannel-193808 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.14s)
=== RUN TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run: kubectl --context flannel-193808 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.12s)
=== RUN TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run: out/minikube-linux-amd64 ssh -p bridge-193808 "pgrep -a kubelet"
I1002 20:52:28.180979 134834 config.go:182] Loaded profile config "bridge-193808": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.34.1
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.34s)
=== RUN TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run: kubectl --context bridge-193808 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-sttch" [a5d48f65-9049-4836-ae27-aaca44409476] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-sttch" [a5d48f65-9049-4836-ae27-aaca44409476] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 8.004498619s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (8.22s)
=== RUN TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run: kubectl --context old-k8s-version-876962 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:352: "busybox" [5793fff3-3982-49ef-8c41-84969f244631] Pending
helpers_test.go:352: "busybox" [5793fff3-3982-49ef-8c41-84969f244631] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "busybox" [5793fff3-3982-49ef-8c41-84969f244631] Running
start_stop_delete_test.go:194: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 10.003442176s
start_stop_delete_test.go:194: (dbg) Run: kubectl --context old-k8s-version-876962 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (10.34s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p default-k8s-diff-port-089961 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-diff-port-089961 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1: (40.667640935s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (40.67s)
=== RUN TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run: kubectl --context no-preload-516940 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:352: "busybox" [d168ec3d-51e6-484c-b1ca-71eeaba479ff] Pending
helpers_test.go:352: "busybox" [d168ec3d-51e6-484c-b1ca-71eeaba479ff] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "busybox" [d168ec3d-51e6-484c-b1ca-71eeaba479ff] Running
start_stop_delete_test.go:194: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 9.004791934s
start_stop_delete_test.go:194: (dbg) Run: kubectl --context no-preload-516940 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (9.40s)
=== RUN TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run: kubectl --context bridge-193808 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.14s)
=== RUN TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run: kubectl --context bridge-193808 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.12s)
=== RUN TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run: kubectl --context bridge-193808 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.14s)
=== RUN TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p old-k8s-version-876962 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:213: (dbg) Run: kubectl --context old-k8s-version-876962 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.98s)
=== RUN TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:226: (dbg) Run: out/minikube-linux-amd64 stop -p old-k8s-version-876962 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-amd64 stop -p old-k8s-version-876962 --alsologtostderr -v=3: (12.065827351s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (12.07s)
=== RUN TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p no-preload-516940 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:213: (dbg) Run: kubectl --context no-preload-516940 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.95s)
=== RUN TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:226: (dbg) Run: out/minikube-linux-amd64 stop -p no-preload-516940 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-amd64 stop -p no-preload-516940 --alsologtostderr -v=3: (12.886725086s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (12.89s)
=== RUN TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-876962 -n old-k8s-version-876962
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-876962 -n old-k8s-version-876962: exit status 7 (78.556134ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p old-k8s-version-876962 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.20s)
=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run: out/minikube-linux-amd64 start -p old-k8s-version-876962 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.28.0
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-876962 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.28.0: (49.998955625s)
start_stop_delete_test.go:260: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-876962 -n old-k8s-version-876962
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (50.50s)
=== RUN TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p newest-cni-311599 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-311599 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1: (28.825336877s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (28.83s)
=== RUN TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-516940 -n no-preload-516940
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-516940 -n no-preload-516940: exit status 7 (96.474602ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p no-preload-516940 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.23s)
=== RUN TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run: out/minikube-linux-amd64 start -p no-preload-516940 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-516940 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1: (50.883425185s)
start_stop_delete_test.go:260: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-516940 -n no-preload-516940
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (51.28s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run: kubectl --context default-k8s-diff-port-089961 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:352: "busybox" [fcf64129-c046-4891-98e2-336d323ad78c] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "busybox" [fcf64129-c046-4891-98e2-336d323ad78c] Running
E1002 20:53:18.937167 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/addons-906277/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:194: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 8.004964264s
start_stop_delete_test.go:194: (dbg) Run: kubectl --context default-k8s-diff-port-089961 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.34s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-diff-port-089961 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:213: (dbg) Run: kubectl --context default-k8s-diff-port-089961 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.00s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:226: (dbg) Run: out/minikube-linux-amd64 stop -p default-k8s-diff-port-089961 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-amd64 stop -p default-k8s-diff-port-089961 --alsologtostderr -v=3: (12.05024141s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (12.05s)
=== RUN TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)
=== RUN TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-311599 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:209: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.88s)
=== RUN TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:226: (dbg) Run: out/minikube-linux-amd64 stop -p newest-cni-311599 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-amd64 stop -p newest-cni-311599 --alsologtostderr -v=3: (1.282538996s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (1.28s)
=== RUN TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-311599 -n newest-cni-311599
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-311599 -n newest-cni-311599: exit status 7 (75.169165ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p newest-cni-311599 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.18s)
=== RUN TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run: out/minikube-linux-amd64 start -p newest-cni-311599 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-311599 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1: (11.805360167s)
start_stop_delete_test.go:260: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-311599 -n newest-cni-311599
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (12.18s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-089961 -n default-k8s-diff-port-089961
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-089961 -n default-k8s-diff-port-089961: exit status 7 (75.311032ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p default-k8s-diff-port-089961 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.21s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run: out/minikube-linux-amd64 start -p default-k8s-diff-port-089961 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-diff-port-089961 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1: (44.55170077s)
start_stop_delete_test.go:260: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-089961 -n default-k8s-diff-port-089961
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (44.89s)
=== RUN TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:271: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)
=== RUN TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:282: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)
=== RUN TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run: out/minikube-linux-amd64 -p newest-cni-311599 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250512-df8de77b
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.26s)
=== RUN TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 pause -p newest-cni-311599 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-311599 -n newest-cni-311599
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-311599 -n newest-cni-311599: exit status 2 (389.255142ms)
-- stdout --
Paused
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-311599 -n newest-cni-311599
E1002 20:53:42.084325 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/functional-873823/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-311599 -n newest-cni-311599: exit status 2 (475.106969ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 unpause -p newest-cni-311599 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-311599 -n newest-cni-311599
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-311599 -n newest-cni-311599
--- PASS: TestStartStop/group/newest-cni/serial/Pause (3.43s)
=== RUN TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-8694d4445c-bk8nt" [14659dd9-c093-448c-9aab-247df094620e] Running
start_stop_delete_test.go:272: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004027814s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.01s)
=== RUN TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run: out/minikube-linux-amd64 start -p embed-certs-004186 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-004186 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1: (41.854716948s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (41.85s)
=== RUN TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-8694d4445c-bk8nt" [14659dd9-c093-448c-9aab-247df094620e] Running
start_stop_delete_test.go:285: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.00464714s
start_stop_delete_test.go:289: (dbg) Run: kubectl --context old-k8s-version-876962 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.09s)
=== RUN TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-77t7d" [7441dcc3-1c02-42d4-985d-d2a0dc1017fd] Running
start_stop_delete_test.go:272: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.00441812s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6.01s)
=== RUN TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run: out/minikube-linux-amd64 -p old-k8s-version-876962 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250512-df8de77b
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.27s)
=== RUN TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 pause -p old-k8s-version-876962 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-876962 -n old-k8s-version-876962
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-876962 -n old-k8s-version-876962: exit status 2 (392.140655ms)
-- stdout --
Paused
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-876962 -n old-k8s-version-876962
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-876962 -n old-k8s-version-876962: exit status 2 (373.170449ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 unpause -p old-k8s-version-876962 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-876962 -n old-k8s-version-876962
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-876962 -n old-k8s-version-876962
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (3.17s)
=== RUN TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-77t7d" [7441dcc3-1c02-42d4-985d-d2a0dc1017fd] Running
start_stop_delete_test.go:285: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.00360731s
start_stop_delete_test.go:289: (dbg) Run: kubectl --context no-preload-516940 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.07s)
=== RUN TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run: out/minikube-linux-amd64 -p no-preload-516940 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250512-df8de77b
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.25s)
=== RUN TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 pause -p no-preload-516940 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-516940 -n no-preload-516940
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-516940 -n no-preload-516940: exit status 2 (352.268852ms)
-- stdout --
Paused
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-516940 -n no-preload-516940
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-516940 -n no-preload-516940: exit status 2 (407.378659ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 unpause -p no-preload-516940 --alsologtostderr -v=1
E1002 20:54:04.166461 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/auto-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:54:04.172897 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/auto-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:54:04.184752 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/auto-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:54:04.206885 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/auto-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:54:04.249718 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/auto-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:54:04.331257 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/auto-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-516940 -n no-preload-516940
E1002 20:54:04.493078 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/auto-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:54:04.815366 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/auto-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-516940 -n no-preload-516940
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.13s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-2wqll" [c27a72fe-f885-4b70-bc24-6f7e52c49d9b] Running
E1002 20:54:22.323443 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/kindnet-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:54:24.666314 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/auto-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:272: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003398682s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.00s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-2wqll" [c27a72fe-f885-4b70-bc24-6f7e52c49d9b] Running
start_stop_delete_test.go:285: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.003531147s
start_stop_delete_test.go:289: (dbg) Run: kubectl --context default-k8s-diff-port-089961 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.07s)
=== RUN TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run: kubectl --context embed-certs-004186 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:352: "busybox" [3f2541cc-a23c-42f2-b46b-3f1cb9d334b3] Pending
helpers_test.go:352: "busybox" [3f2541cc-a23c-42f2-b46b-3f1cb9d334b3] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "busybox" [3f2541cc-a23c-42f2-b46b-3f1cb9d334b3] Running
start_stop_delete_test.go:194: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 8.004495009s
start_stop_delete_test.go:194: (dbg) Run: kubectl --context embed-certs-004186 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (8.24s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run: out/minikube-linux-amd64 -p default-k8s-diff-port-089961 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250512-df8de77b
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.24s)
=== RUN TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 pause -p default-k8s-diff-port-089961 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-089961 -n default-k8s-diff-port-089961
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-089961 -n default-k8s-diff-port-089961: exit status 2 (322.676415ms)
-- stdout --
Paused
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-089961 -n default-k8s-diff-port-089961
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-089961 -n default-k8s-diff-port-089961: exit status 2 (326.563247ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 unpause -p default-k8s-diff-port-089961 --alsologtostderr -v=1
E1002 20:54:32.565238 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/kindnet-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-089961 -n default-k8s-diff-port-089961
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-089961 -n default-k8s-diff-port-089961
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (2.80s)
=== RUN TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run: out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-004186 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:213: (dbg) Run: kubectl --context embed-certs-004186 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.84s)
=== RUN TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:226: (dbg) Run: out/minikube-linux-amd64 stop -p embed-certs-004186 --alsologtostderr -v=3
E1002 20:54:45.148467 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/auto-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-amd64 stop -p embed-certs-004186 --alsologtostderr -v=3: (11.995502361s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (12.00s)
=== RUN TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-004186 -n embed-certs-004186
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-004186 -n embed-certs-004186: exit status 7 (71.213591ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run: out/minikube-linux-amd64 addons enable dashboard -p embed-certs-004186 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.18s)
=== RUN TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run: out/minikube-linux-amd64 start -p embed-certs-004186 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1
E1002 20:54:53.047014 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/kindnet-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:25.502941 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/calico-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:25.509380 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/calico-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:25.520785 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/calico-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:25.542227 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/calico-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:25.583696 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/calico-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:25.665215 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/calico-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:25.826808 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/calico-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:26.110651 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/auto-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:26.148122 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/calico-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:26.790454 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/calico-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:28.072776 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/calico-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:30.634394 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/calico-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:34.009174 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/kindnet-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:35.755937 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/calico-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-004186 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker --container-runtime=containerd --kubernetes-version=v1.34.1: (49.738745096s)
start_stop_delete_test.go:260: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-004186 -n embed-certs-004186
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (50.08s)
=== RUN TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-9g2kp" [023f4e7d-63b8-43c4-b18d-cb0933797a11] Running
E1002 20:55:45.997697 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/calico-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:272: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003730748s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.00s)
=== RUN TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-9g2kp" [023f4e7d-63b8-43c4-b18d-cb0933797a11] Running
E1002 20:55:49.899261 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/custom-flannel-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:49.905774 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/custom-flannel-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:49.917188 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/custom-flannel-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:49.938729 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/custom-flannel-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:49.980178 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/custom-flannel-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:50.062263 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/custom-flannel-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:50.223820 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/custom-flannel-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E1002 20:55:50.545729 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/custom-flannel-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:285: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.003197044s
start_stop_delete_test.go:289: (dbg) Run: kubectl --context embed-certs-004186 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.07s)
=== RUN TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run: out/minikube-linux-amd64 -p embed-certs-004186 image list --format=json
E1002 20:55:51.187457 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/custom-flannel-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250512-df8de77b
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.23s)
=== RUN TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 pause -p embed-certs-004186 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-004186 -n embed-certs-004186
E1002 20:55:52.469101 134834 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/custom-flannel-193808/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-004186 -n embed-certs-004186: exit status 2 (315.859626ms)
-- stdout --
Paused
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-004186 -n embed-certs-004186
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-004186 -n embed-certs-004186: exit status 2 (319.302622ms)
-- stdout --
Stopped
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 unpause -p embed-certs-004186 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-004186 -n embed-certs-004186
start_stop_delete_test.go:309: (dbg) Run: out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-004186 -n embed-certs-004186
--- PASS: TestStartStop/group/embed-certs/serial/Pause (2.83s)
=== RUN TestDownloadOnly/v1.28.0/cached-images
aaa_download_only_test.go:128: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.28.0/cached-images (0.00s)
=== RUN TestDownloadOnly/v1.28.0/binaries
aaa_download_only_test.go:150: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.28.0/binaries (0.00s)
=== RUN TestDownloadOnly/v1.28.0/kubectl
aaa_download_only_test.go:166: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.28.0/kubectl (0.00s)
=== RUN TestDownloadOnly/v1.34.1/cached-images
aaa_download_only_test.go:128: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.34.1/cached-images (0.00s)
=== RUN TestDownloadOnly/v1.34.1/binaries
aaa_download_only_test.go:150: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.34.1/binaries (0.00s)
=== RUN TestDownloadOnly/v1.34.1/kubectl
aaa_download_only_test.go:166: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.34.1/kubectl (0.00s)
=== RUN TestAddons/serial/GCPAuth/RealCredentials
addons_test.go:763: skipping GCPAuth addon test until 'Permission "artifactregistry.repositories.downloadArtifacts" denied on resource "projects/k8s-minikube/locations/us/repositories/test-artifacts" (or it may not exist)' issue is resolved
--- SKIP: TestAddons/serial/GCPAuth/RealCredentials (0.00s)
=== RUN TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm
=== CONT TestAddons/parallel/Olm
addons_test.go:483: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)
=== RUN TestDockerFlags
docker_test.go:41: skipping: only runs with docker container runtime, currently testing containerd
--- SKIP: TestDockerFlags (0.00s)
=== RUN TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:114: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)
=== RUN TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:178: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)
=== RUN TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv
=== CONT TestFunctional/parallel/DockerEnv
functional_test.go:478: only validate docker env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)
=== RUN TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv
=== CONT TestFunctional/parallel/PodmanEnv
functional_test.go:565: only validate podman env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)
=== RUN TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)
=== RUN TestFunctionalNewestKubernetes
functional_test.go:82:
--- SKIP: TestFunctionalNewestKubernetes (0.00s)
=== RUN TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)
=== RUN TestImageBuild
image_test.go:33:
--- SKIP: TestImageBuild (0.00s)
=== RUN TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)
=== RUN TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)
=== RUN TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing containerd container runtime
--- SKIP: TestSkaffold (0.00s)
=== RUN TestNetworkPlugins/group/kubenet
net_test.go:93: Skipping the test as containerd container runtimes requires CNI
panic.go:636:
----------------------- debugLogs start: kubenet-193808 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-193808
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: kubenet-193808
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-193808
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: kubenet-193808
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: kubenet-193808
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: kubenet-193808
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: kubenet-193808
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: kubenet-193808
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: kubenet-193808
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: kubenet-193808
>>> host: /etc/nsswitch.conf:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: /etc/hosts:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: /etc/resolv.conf:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: kubenet-193808
>>> host: crictl pods:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: crictl containers:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> k8s: describe netcat deployment:
error: context "kubenet-193808" does not exist
>>> k8s: describe netcat pod(s):
error: context "kubenet-193808" does not exist
>>> k8s: netcat logs:
error: context "kubenet-193808" does not exist
>>> k8s: describe coredns deployment:
error: context "kubenet-193808" does not exist
>>> k8s: describe coredns pods:
error: context "kubenet-193808" does not exist
>>> k8s: coredns logs:
error: context "kubenet-193808" does not exist
>>> k8s: describe api server pod(s):
error: context "kubenet-193808" does not exist
>>> k8s: api server logs:
error: context "kubenet-193808" does not exist
>>> host: /etc/cni:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: ip a s:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: ip r s:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: iptables-save:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: iptables table nat:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> k8s: describe kube-proxy daemon set:
error: context "kubenet-193808" does not exist
>>> k8s: describe kube-proxy pod(s):
error: context "kubenet-193808" does not exist
>>> k8s: kube-proxy logs:
error: context "kubenet-193808" does not exist
>>> host: kubelet daemon status:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: kubelet daemon config:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> k8s: kubelet logs:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: /var/lib/kubelet/config.yaml:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 02 Oct 2025 20:46:10 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: cluster_info
server: https://192.168.76.2:8443
name: missing-upgrade-421853
contexts:
- context:
cluster: missing-upgrade-421853
extensions:
- extension:
last-update: Thu, 02 Oct 2025 20:46:10 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: context_info
namespace: default
user: missing-upgrade-421853
name: missing-upgrade-421853
current-context: ""
kind: Config
users:
- name: missing-upgrade-421853
user:
client-certificate: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/missing-upgrade-421853/client.crt
client-key: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/missing-upgrade-421853/client.key
>>> k8s: cms:
Error in configuration: context was not found for specified context: kubenet-193808
>>> host: docker daemon status:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: docker daemon config:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: /etc/docker/daemon.json:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: docker system info:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: cri-docker daemon status:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: cri-docker daemon config:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: cri-dockerd version:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: containerd daemon status:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: containerd daemon config:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: /lib/systemd/system/containerd.service:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: /etc/containerd/config.toml:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: containerd config dump:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: crio daemon status:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: crio daemon config:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: /etc/crio:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
>>> host: crio config:
* Profile "kubenet-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-193808"
----------------------- debugLogs end: kubenet-193808 [took: 3.627270582s] --------------------------------
helpers_test.go:175: Cleaning up "kubenet-193808" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p kubenet-193808
--- SKIP: TestNetworkPlugins/group/kubenet (3.83s)
=== RUN TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:636:
----------------------- debugLogs start: cilium-193808 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-193808
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-193808
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-193808
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-193808
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-193808
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-193808
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-193808
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-193808
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-193808
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-193808
>>> host: /etc/nsswitch.conf:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: /etc/hosts:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: /etc/resolv.conf:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-193808
>>> host: crictl pods:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: crictl containers:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> k8s: describe netcat deployment:
error: context "cilium-193808" does not exist
>>> k8s: describe netcat pod(s):
error: context "cilium-193808" does not exist
>>> k8s: netcat logs:
error: context "cilium-193808" does not exist
>>> k8s: describe coredns deployment:
error: context "cilium-193808" does not exist
>>> k8s: describe coredns pods:
error: context "cilium-193808" does not exist
>>> k8s: coredns logs:
error: context "cilium-193808" does not exist
>>> k8s: describe api server pod(s):
error: context "cilium-193808" does not exist
>>> k8s: api server logs:
error: context "cilium-193808" does not exist
>>> host: /etc/cni:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: ip a s:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: ip r s:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: iptables-save:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: iptables table nat:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-193808
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-193808
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-193808" does not exist
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-193808" does not exist
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-193808
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-193808
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-193808" does not exist
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-193808" does not exist
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-193808" does not exist
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-193808" does not exist
>>> k8s: kube-proxy logs:
error: context "cilium-193808" does not exist
>>> host: kubelet daemon status:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: kubelet daemon config:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> k8s: kubelet logs:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 02 Oct 2025 20:46:37 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: cluster_info
server: https://192.168.85.2:8443
name: kubernetes-upgrade-818734
- cluster:
certificate-authority: /home/jenkins/minikube-integration/21682-131316/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 02 Oct 2025 20:46:10 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: cluster_info
server: https://192.168.76.2:8443
name: missing-upgrade-421853
contexts:
- context:
cluster: kubernetes-upgrade-818734
extensions:
- extension:
last-update: Thu, 02 Oct 2025 20:46:37 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: context_info
namespace: default
user: kubernetes-upgrade-818734
name: kubernetes-upgrade-818734
- context:
cluster: missing-upgrade-421853
extensions:
- extension:
last-update: Thu, 02 Oct 2025 20:46:10 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: context_info
namespace: default
user: missing-upgrade-421853
name: missing-upgrade-421853
current-context: kubernetes-upgrade-818734
kind: Config
users:
- name: kubernetes-upgrade-818734
user:
client-certificate: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/kubernetes-upgrade-818734/client.crt
client-key: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/kubernetes-upgrade-818734/client.key
- name: missing-upgrade-421853
user:
client-certificate: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/missing-upgrade-421853/client.crt
client-key: /home/jenkins/minikube-integration/21682-131316/.minikube/profiles/missing-upgrade-421853/client.key
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-193808
>>> host: docker daemon status:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: docker daemon config:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: /etc/docker/daemon.json:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: docker system info:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: cri-docker daemon status:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: cri-docker daemon config:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: cri-dockerd version:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: containerd daemon status:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: containerd daemon config:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: /etc/containerd/config.toml:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: containerd config dump:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: crio daemon status:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: crio daemon config:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: /etc/crio:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
>>> host: crio config:
* Profile "cilium-193808" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-193808"
----------------------- debugLogs end: cilium-193808 [took: 5.594247232s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-193808" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p cilium-193808
--- SKIP: TestNetworkPlugins/group/cilium (5.80s)
=== RUN TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts
=== CONT TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:101: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-819720" profile ...
helpers_test.go:178: (dbg) Run: out/minikube-linux-amd64 delete -p disable-driver-mounts-819720
--- SKIP: TestStartStop/group/disable-driver-mounts (0.17s)