=== RUN TestMultiNode/serial/ValidateNameConflict
multinode_test.go:441: (dbg) Run: out/minikube-linux-amd64 node list -p multinode-20220630191425-10770
multinode_test.go:450: (dbg) Run: out/minikube-linux-amd64 start -p multinode-20220630191425-10770-m02 --driver=kvm2
multinode_test.go:450: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p multinode-20220630191425-10770-m02 --driver=kvm2 : exit status 14 (88.218787ms)
-- stdout --
* [multinode-20220630191425-10770-m02] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=14420
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
-- /stdout --
** stderr **
! Profile name 'multinode-20220630191425-10770-m02' is duplicated with machine name 'multinode-20220630191425-10770-m02' in profile 'multinode-20220630191425-10770'
X Exiting due to MK_USAGE: Profile name should be unique
** /stderr **
multinode_test.go:458: (dbg) Run: out/minikube-linux-amd64 start -p multinode-20220630191425-10770-m03 --driver=kvm2
E0630 19:44:06.543097 10770 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/profiles/ingress-addon-legacy-20220630190732-10770/client.crt: no such file or directory
multinode_test.go:458: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p multinode-20220630191425-10770-m03 --driver=kvm2 : signal: killed (30.565488439s)
-- stdout --
* [multinode-20220630191425-10770-m03] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
- MINIKUBE_LOCATION=14420
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube
- MINIKUBE_BIN=out/minikube-linux-amd64
* Using the kvm2 driver based on user configuration
* Starting control plane node multinode-20220630191425-10770-m03 in cluster multinode-20220630191425-10770-m03
* Creating kvm2 VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
-- /stdout --
multinode_test.go:460: failed to start profile. args "out/minikube-linux-amd64 start -p multinode-20220630191425-10770-m03 --driver=kvm2 " : signal: killed
multinode_test.go:465: (dbg) Run: out/minikube-linux-amd64 node add -p multinode-20220630191425-10770
multinode_test.go:465: (dbg) Non-zero exit: out/minikube-linux-amd64 node add -p multinode-20220630191425-10770: context deadline exceeded (1.407µs)
multinode_test.go:470: (dbg) Run: out/minikube-linux-amd64 delete -p multinode-20220630191425-10770-m03
multinode_test.go:470: (dbg) Non-zero exit: out/minikube-linux-amd64 delete -p multinode-20220630191425-10770-m03: context deadline exceeded (156ns)
multinode_test.go:472: failed to clean temporary profile. args "out/minikube-linux-amd64 delete -p multinode-20220630191425-10770-m03" : context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p multinode-20220630191425-10770 -n multinode-20220630191425-10770
helpers_test.go:244: <<< TestMultiNode/serial/ValidateNameConflict FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestMultiNode/serial/ValidateNameConflict]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p multinode-20220630191425-10770 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p multinode-20220630191425-10770 logs -n 25: (2.619859034s)
helpers_test.go:252: TestMultiNode/serial/ValidateNameConflict logs:
-- stdout --
*
* ==> Audit <==
* |---------|-----------------------------------------------------------------------------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|-----------------------------------------------------------------------------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
| cp | multinode-20220630191425-10770 cp multinode-20220630191425-10770-m02:/home/docker/cp-test.txt | minikube | jenkins | v1.26.0 | 30 Jun 22 19:18 UTC | 30 Jun 22 19:18 UTC |
| | multinode-20220630191425-10770-m03:/home/docker/cp-test_multinode-20220630191425-10770-m02_multinode-20220630191425-10770-m03.txt | | | | | |
| ssh | multinode-20220630191425-10770 | minikube | jenkins | v1.26.0 | 30 Jun 22 19:18 UTC | 30 Jun 22 19:18 UTC |
| | ssh -n | | | | | |
| | multinode-20220630191425-10770-m02 | | | | | |
| | sudo cat /home/docker/cp-test.txt | | | | | |
| ssh | multinode-20220630191425-10770 ssh -n multinode-20220630191425-10770-m03 sudo cat | minikube | jenkins | v1.26.0 | 30 Jun 22 19:18 UTC | 30 Jun 22 19:18 UTC |
| | /home/docker/cp-test_multinode-20220630191425-10770-m02_multinode-20220630191425-10770-m03.txt | | | | | |
| cp | multinode-20220630191425-10770 cp testdata/cp-test.txt | minikube | jenkins | v1.26.0 | 30 Jun 22 19:18 UTC | 30 Jun 22 19:18 UTC |
| | multinode-20220630191425-10770-m03:/home/docker/cp-test.txt | | | | | |
| ssh | multinode-20220630191425-10770 | minikube | jenkins | v1.26.0 | 30 Jun 22 19:18 UTC | 30 Jun 22 19:18 UTC |
| | ssh -n | | | | | |
| | multinode-20220630191425-10770-m03 | | | | | |
| | sudo cat /home/docker/cp-test.txt | | | | | |
| cp | multinode-20220630191425-10770 cp multinode-20220630191425-10770-m03:/home/docker/cp-test.txt | minikube | jenkins | v1.26.0 | 30 Jun 22 19:18 UTC | 30 Jun 22 19:18 UTC |
| | /tmp/TestMultiNodeserialCopyFile2931865923/001/cp-test_multinode-20220630191425-10770-m03.txt | | | | | |
| ssh | multinode-20220630191425-10770 | minikube | jenkins | v1.26.0 | 30 Jun 22 19:18 UTC | 30 Jun 22 19:18 UTC |
| | ssh -n | | | | | |
| | multinode-20220630191425-10770-m03 | | | | | |
| | sudo cat /home/docker/cp-test.txt | | | | | |
| cp | multinode-20220630191425-10770 cp multinode-20220630191425-10770-m03:/home/docker/cp-test.txt | minikube | jenkins | v1.26.0 | 30 Jun 22 19:18 UTC | 30 Jun 22 19:18 UTC |
| | multinode-20220630191425-10770:/home/docker/cp-test_multinode-20220630191425-10770-m03_multinode-20220630191425-10770.txt | | | | | |
| ssh | multinode-20220630191425-10770 | minikube | jenkins | v1.26.0 | 30 Jun 22 19:18 UTC | 30 Jun 22 19:18 UTC |
| | ssh -n | | | | | |
| | multinode-20220630191425-10770-m03 | | | | | |
| | sudo cat /home/docker/cp-test.txt | | | | | |
| ssh | multinode-20220630191425-10770 ssh -n multinode-20220630191425-10770 sudo cat | minikube | jenkins | v1.26.0 | 30 Jun 22 19:18 UTC | 30 Jun 22 19:18 UTC |
| | /home/docker/cp-test_multinode-20220630191425-10770-m03_multinode-20220630191425-10770.txt | | | | | |
| cp | multinode-20220630191425-10770 cp multinode-20220630191425-10770-m03:/home/docker/cp-test.txt | minikube | jenkins | v1.26.0 | 30 Jun 22 19:18 UTC | 30 Jun 22 19:18 UTC |
| | multinode-20220630191425-10770-m02:/home/docker/cp-test_multinode-20220630191425-10770-m03_multinode-20220630191425-10770-m02.txt | | | | | |
| ssh | multinode-20220630191425-10770 | minikube | jenkins | v1.26.0 | 30 Jun 22 19:18 UTC | 30 Jun 22 19:18 UTC |
| | ssh -n | | | | | |
| | multinode-20220630191425-10770-m03 | | | | | |
| | sudo cat /home/docker/cp-test.txt | | | | | |
| ssh | multinode-20220630191425-10770 ssh -n multinode-20220630191425-10770-m02 sudo cat | minikube | jenkins | v1.26.0 | 30 Jun 22 19:18 UTC | 30 Jun 22 19:18 UTC |
| | /home/docker/cp-test_multinode-20220630191425-10770-m03_multinode-20220630191425-10770-m02.txt | | | | | |
| node | multinode-20220630191425-10770 | minikube | jenkins | v1.26.0 | 30 Jun 22 19:18 UTC | 30 Jun 22 19:18 UTC |
| | node stop m03 | | | | | |
| node | multinode-20220630191425-10770 | minikube | jenkins | v1.26.0 | 30 Jun 22 19:18 UTC | 30 Jun 22 19:18 UTC |
| | node start m03 | | | | | |
| | --alsologtostderr | | | | | |
| node | list -p | minikube | jenkins | v1.26.0 | 30 Jun 22 19:19 UTC | |
| | multinode-20220630191425-10770 | | | | | |
| stop | -p | minikube | jenkins | v1.26.0 | 30 Jun 22 19:19 UTC | 30 Jun 22 19:19 UTC |
| | multinode-20220630191425-10770 | | | | | |
| start | -p | minikube | jenkins | v1.26.0 | 30 Jun 22 19:19 UTC | 30 Jun 22 19:33 UTC |
| | multinode-20220630191425-10770 | | | | | |
| | --wait=true -v=8 | | | | | |
| | --alsologtostderr | | | | | |
| node | list -p | minikube | jenkins | v1.26.0 | 30 Jun 22 19:33 UTC | |
| | multinode-20220630191425-10770 | | | | | |
| node | multinode-20220630191425-10770 | minikube | jenkins | v1.26.0 | 30 Jun 22 19:33 UTC | 30 Jun 22 19:33 UTC |
| | node delete m03 | | | | | |
| stop | multinode-20220630191425-10770 | minikube | jenkins | v1.26.0 | 30 Jun 22 19:33 UTC | 30 Jun 22 19:34 UTC |
| | stop | | | | | |
| start | -p | minikube | jenkins | v1.26.0 | 30 Jun 22 19:34 UTC | 30 Jun 22 19:43 UTC |
| | multinode-20220630191425-10770 | | | | | |
| | --wait=true -v=8 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=kvm2 | | | | | |
| node | list -p | minikube | jenkins | v1.26.0 | 30 Jun 22 19:43 UTC | |
| | multinode-20220630191425-10770 | | | | | |
| start | -p | minikube | jenkins | v1.26.0 | 30 Jun 22 19:43 UTC | |
| | multinode-20220630191425-10770-m02 | | | | | |
| | --driver=kvm2 | | | | | |
| start | -p | minikube | jenkins | v1.26.0 | 30 Jun 22 19:43 UTC | |
| | multinode-20220630191425-10770-m03 | | | | | |
| | --driver=kvm2 | | | | | |
|---------|-----------------------------------------------------------------------------------------------------------------------------------|----------|---------|---------|---------------------|---------------------|
*
* ==> Last Start <==
* Log file created at: 2022/06/30 19:43:55
Running on machine: ubuntu-20-agent-4
Binary: Built with gc go1.18.3 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0630 19:43:55.166474 22491 out.go:296] Setting OutFile to fd 1 ...
I0630 19:43:55.166573 22491 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0630 19:43:55.166576 22491 out.go:309] Setting ErrFile to fd 2...
I0630 19:43:55.166579 22491 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0630 19:43:55.166975 22491 root.go:329] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/bin
I0630 19:43:55.167213 22491 out.go:303] Setting JSON to false
I0630 19:43:55.167998 22491 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":5188,"bootTime":1656613047,"procs":190,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1012-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0630 19:43:55.168053 22491 start.go:125] virtualization: kvm guest
I0630 19:43:55.170981 22491 out.go:177] * [multinode-20220630191425-10770-m03] minikube v1.26.0 on Ubuntu 20.04 (kvm/amd64)
I0630 19:43:55.172588 22491 out.go:177] - MINIKUBE_LOCATION=14420
I0630 19:43:55.172501 22491 notify.go:193] Checking for updates...
I0630 19:43:55.175842 22491 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0630 19:43:55.177710 22491 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/kubeconfig
I0630 19:43:55.179452 22491 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube
I0630 19:43:55.181126 22491 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0630 19:43:55.183100 22491 config.go:178] Loaded profile config "multinode-20220630191425-10770": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.24.2
I0630 19:43:55.183144 22491 driver.go:360] Setting default libvirt URI to qemu:///system
I0630 19:43:55.218540 22491 out.go:177] * Using the kvm2 driver based on user configuration
I0630 19:43:55.219922 22491 start.go:284] selected driver: kvm2
I0630 19:43:55.219929 22491 start.go:808] validating driver "kvm2" against <nil>
I0630 19:43:55.219944 22491 start.go:819] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0630 19:43:55.220210 22491 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0630 19:43:55.220402 22491 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/bin:/home/jenkins/workspace/KVM_Linux_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0630 19:43:55.239873 22491 install.go:137] /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2 version is 1.26.0
I0630 19:43:55.239931 22491 start_flags.go:296] no existing cluster config was found, will generate one from the flags
I0630 19:43:55.240344 22491 start_flags.go:377] Using suggested 6000MB memory alloc based on sys=32103MB, container=0MB
I0630 19:43:55.240436 22491 start_flags.go:835] Wait components to verify : map[apiserver:true system_pods:true]
I0630 19:43:55.240450 22491 cni.go:95] Creating CNI manager for ""
I0630 19:43:55.240457 22491 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
I0630 19:43:55.240464 22491 start_flags.go:310] config:
{Name:multinode-20220630191425-10770-m03 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.2 ClusterName:multinode-20220630191425-10770-m03 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain
:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
I0630 19:43:55.240542 22491 iso.go:128] acquiring lock: {Name:mka7b691520aa1548b2a10e12a20cd7a66e73a1f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0630 19:43:55.243868 22491 out.go:177] * Starting control plane node multinode-20220630191425-10770-m03 in cluster multinode-20220630191425-10770-m03
I0630 19:43:55.245429 22491 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime docker
I0630 19:43:55.245474 22491 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-docker-overlay2-amd64.tar.lz4
I0630 19:43:55.245487 22491 cache.go:57] Caching tarball of preloaded images
I0630 19:43:55.245644 22491 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0630 19:43:55.245666 22491 cache.go:60] Finished verifying existence of preloaded tar for v1.24.2 on docker
I0630 19:43:55.245771 22491 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/profiles/multinode-20220630191425-10770-m03/config.json ...
I0630 19:43:55.245785 22491 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/profiles/multinode-20220630191425-10770-m03/config.json: {Name:mk2aa4caaddaaabc619198b6622c5a43b8d69483 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0630 19:43:55.245947 22491 cache.go:208] Successfully downloaded all kic artifacts
I0630 19:43:55.245969 22491 start.go:352] acquiring machines lock for multinode-20220630191425-10770-m03: {Name:mkd3357d49165653653345f4ebff1dfdf14279d1 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0630 19:43:55.246012 22491 start.go:356] acquired machines lock for "multinode-20220630191425-10770-m03" in 34.734µs
I0630 19:43:55.246026 22491 start.go:91] Provisioning new machine with config: &{Name:multinode-20220630191425-10770-m03 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.32-1656350719-14420@sha256:e7b7f38d1a2eba7828afc2c4c3d24e1d391db431976e47aa6dc5c7a6b038ca4e Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuberne
tesVersion:v1.24.2 ClusterName:multinode-20220630191425-10770-m03 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirr
or: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} &{Name: IP: Port:8443 KubernetesVersion:v1.24.2 ContainerRuntime:docker ControlPlane:true Worker:true}
I0630 19:43:55.246099 22491 start.go:131] createHost starting for "" (driver="kvm2")
I0630 19:43:55.248334 22491 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
I0630 19:43:55.248508 22491 main.go:134] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2
I0630 19:43:55.248551 22491 main.go:134] libmachine: Launching plugin server for driver kvm2
I0630 19:43:55.264289 22491 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:36027
I0630 19:43:55.264739 22491 main.go:134] libmachine: () Calling .GetVersion
I0630 19:43:55.265296 22491 main.go:134] libmachine: Using API Version 1
I0630 19:43:55.265315 22491 main.go:134] libmachine: () Calling .SetConfigRaw
I0630 19:43:55.265633 22491 main.go:134] libmachine: () Calling .GetMachineName
I0630 19:43:55.265790 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetMachineName
I0630 19:43:55.265937 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .DriverName
I0630 19:43:55.266062 22491 start.go:165] libmachine.API.Create for "multinode-20220630191425-10770-m03" (driver="kvm2")
I0630 19:43:55.266085 22491 client.go:168] LocalClient.Create starting
I0630 19:43:55.266111 22491 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/certs/ca.pem
I0630 19:43:55.266143 22491 main.go:134] libmachine: Decoding PEM data...
I0630 19:43:55.266156 22491 main.go:134] libmachine: Parsing certificate...
I0630 19:43:55.266203 22491 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/certs/cert.pem
I0630 19:43:55.266219 22491 main.go:134] libmachine: Decoding PEM data...
I0630 19:43:55.266227 22491 main.go:134] libmachine: Parsing certificate...
I0630 19:43:55.266240 22491 main.go:134] libmachine: Running pre-create checks...
I0630 19:43:55.266246 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .PreCreateCheck
I0630 19:43:55.266582 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetConfigRaw
I0630 19:43:55.266975 22491 main.go:134] libmachine: Creating machine...
I0630 19:43:55.266983 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .Create
I0630 19:43:55.267120 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Creating KVM machine...
I0630 19:43:55.268218 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found existing default KVM network
I0630 19:43:55.269036 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:43:55.268880 22514 network.go:240] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:c8:97:91}}
I0630 19:43:55.269701 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:43:55.269636 22514 network.go:288] reserving subnet 192.168.50.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.50.0:0xc0000a62e0] misses:0}
I0630 19:43:55.269715 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:43:55.269674 22514 network.go:235] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0630 19:43:55.275483 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | trying to create private KVM network mk-multinode-20220630191425-10770-m03 192.168.50.0/24...
I0630 19:43:55.344842 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | private KVM network mk-multinode-20220630191425-10770-m03 192.168.50.0/24 created
I0630 19:43:55.344970 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Setting up store path in /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/multinode-20220630191425-10770-m03 ...
I0630 19:43:55.344992 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:43:55.344944 22514 common.go:107] Making disk image using store path: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube
I0630 19:43:55.345004 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Building disk image from file:///home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/cache/iso/amd64/minikube-v1.26.0-amd64.iso
I0630 19:43:55.345148 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Downloading /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/cache/iso/amd64/minikube-v1.26.0-amd64.iso...
I0630 19:43:55.534374 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:43:55.534239 22514 common.go:114] Creating ssh key: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/multinode-20220630191425-10770-m03/id_rsa...
I0630 19:43:55.604120 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:43:55.604001 22514 common.go:120] Creating raw disk image: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/multinode-20220630191425-10770-m03/multinode-20220630191425-10770-m03.rawdisk...
I0630 19:43:55.604140 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | Writing magic tar header
I0630 19:43:55.604185 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | Writing SSH key tar header
I0630 19:43:55.604210 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:43:55.604121 22514 common.go:134] Fixing permissions on /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/multinode-20220630191425-10770-m03 ...
I0630 19:43:55.604244 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/multinode-20220630191425-10770-m03
I0630 19:43:55.604288 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/multinode-20220630191425-10770-m03 (perms=drwx------)
I0630 19:43:55.604298 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines
I0630 19:43:55.604312 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines (perms=drwxrwxr-x)
I0630 19:43:55.604326 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube (perms=drwxr-xr-x)
I0630 19:43:55.604334 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Setting executable bit set on /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd (perms=drwxrwxr-x)
I0630 19:43:55.604345 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)
I0630 19:43:55.604352 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)
I0630 19:43:55.604367 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Creating domain...
I0630 19:43:55.604382 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube
I0630 19:43:55.604424 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd
I0630 19:43:55.604447 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration
I0630 19:43:55.604462 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | Checking permissions on dir: /home/jenkins
I0630 19:43:55.604472 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | Checking permissions on dir: /home
I0630 19:43:55.604484 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | Skipping /home - not owner
I0630 19:43:55.605452 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) define libvirt domain using xml:
I0630 19:43:55.605464 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <domain type='kvm'>
I0630 19:43:55.605474 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <name>multinode-20220630191425-10770-m03</name>
I0630 19:43:55.605479 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <memory unit='MiB'>6000</memory>
I0630 19:43:55.605485 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <vcpu>2</vcpu>
I0630 19:43:55.605489 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <features>
I0630 19:43:55.605494 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <acpi/>
I0630 19:43:55.605499 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <apic/>
I0630 19:43:55.605504 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <pae/>
I0630 19:43:55.605509 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03)
I0630 19:43:55.605520 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) </features>
I0630 19:43:55.605528 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <cpu mode='host-passthrough'>
I0630 19:43:55.605537 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03)
I0630 19:43:55.605554 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) </cpu>
I0630 19:43:55.605565 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <os>
I0630 19:43:55.605579 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <type>hvm</type>
I0630 19:43:55.605590 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <boot dev='cdrom'/>
I0630 19:43:55.605597 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <boot dev='hd'/>
I0630 19:43:55.605605 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <bootmenu enable='no'/>
I0630 19:43:55.605613 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) </os>
I0630 19:43:55.605622 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <devices>
I0630 19:43:55.605631 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <disk type='file' device='cdrom'>
I0630 19:43:55.605655 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <source file='/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/multinode-20220630191425-10770-m03/boot2docker.iso'/>
I0630 19:43:55.605674 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <target dev='hdc' bus='scsi'/>
I0630 19:43:55.605682 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <readonly/>
I0630 19:43:55.605686 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) </disk>
I0630 19:43:55.605696 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <disk type='file' device='disk'>
I0630 19:43:55.605707 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <driver name='qemu' type='raw' cache='default' io='threads' />
I0630 19:43:55.605726 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <source file='/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/multinode-20220630191425-10770-m03/multinode-20220630191425-10770-m03.rawdisk'/>
I0630 19:43:55.605737 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <target dev='hda' bus='virtio'/>
I0630 19:43:55.605758 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) </disk>
I0630 19:43:55.605779 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <interface type='network'>
I0630 19:43:55.605792 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <source network='mk-multinode-20220630191425-10770-m03'/>
I0630 19:43:55.605801 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <model type='virtio'/>
I0630 19:43:55.605810 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) </interface>
I0630 19:43:55.605817 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <interface type='network'>
I0630 19:43:55.605824 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <source network='default'/>
I0630 19:43:55.605829 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <model type='virtio'/>
I0630 19:43:55.605835 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) </interface>
I0630 19:43:55.605844 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <serial type='pty'>
I0630 19:43:55.605854 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <target port='0'/>
I0630 19:43:55.605867 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) </serial>
I0630 19:43:55.605878 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <console type='pty'>
I0630 19:43:55.605887 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <target type='serial' port='0'/>
I0630 19:43:55.605895 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) </console>
I0630 19:43:55.605900 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <rng model='virtio'>
I0630 19:43:55.605906 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) <backend model='random'>/dev/random</backend>
I0630 19:43:55.605910 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) </rng>
I0630 19:43:55.605915 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03)
I0630 19:43:55.605921 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03)
I0630 19:43:55.605930 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) </devices>
I0630 19:43:55.605937 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) </domain>
I0630 19:43:55.605958 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03)
I0630 19:43:55.610599 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:c3:74:a1 in network default
I0630 19:43:55.611205 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Ensuring networks are active...
I0630 19:43:55.611220 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:55.611936 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Ensuring network default is active
I0630 19:43:55.612257 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Ensuring network mk-multinode-20220630191425-10770-m03 is active
I0630 19:43:55.612748 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Getting domain xml...
I0630 19:43:55.613515 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Creating domain...
I0630 19:43:55.987641 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Waiting to get IP...
I0630 19:43:55.988328 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:55.988697 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | unable to find current IP address of domain multinode-20220630191425-10770-m03 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:55.988741 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:43:55.988666 22514 retry.go:31] will retry after 263.082536ms: waiting for machine to come up
I0630 19:43:56.253058 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:56.253524 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | unable to find current IP address of domain multinode-20220630191425-10770-m03 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:56.253551 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:43:56.253470 22514 retry.go:31] will retry after 381.329545ms: waiting for machine to come up
I0630 19:43:56.635885 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:56.636348 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | unable to find current IP address of domain multinode-20220630191425-10770-m03 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:56.636364 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:43:56.636311 22514 retry.go:31] will retry after 422.765636ms: waiting for machine to come up
I0630 19:43:57.060873 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:57.061281 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | unable to find current IP address of domain multinode-20220630191425-10770-m03 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:57.061307 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:43:57.061226 22514 retry.go:31] will retry after 473.074753ms: waiting for machine to come up
I0630 19:43:57.536391 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:57.536902 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | unable to find current IP address of domain multinode-20220630191425-10770-m03 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:57.536925 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:43:57.536861 22514 retry.go:31] will retry after 587.352751ms: waiting for machine to come up
I0630 19:43:58.125603 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:58.126024 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | unable to find current IP address of domain multinode-20220630191425-10770-m03 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:58.126042 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:43:58.125989 22514 retry.go:31] will retry after 834.206799ms: waiting for machine to come up
I0630 19:43:58.962127 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:58.962608 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | unable to find current IP address of domain multinode-20220630191425-10770-m03 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:58.962626 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:43:58.962561 22514 retry.go:31] will retry after 746.553905ms: waiting for machine to come up
I0630 19:43:59.711035 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:59.711432 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | unable to find current IP address of domain multinode-20220630191425-10770-m03 in network mk-multinode-20220630191425-10770-m03
I0630 19:43:59.711461 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:43:59.711383 22514 retry.go:31] will retry after 987.362415ms: waiting for machine to come up
I0630 19:44:00.700398 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:00.700766 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | unable to find current IP address of domain multinode-20220630191425-10770-m03 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:00.700784 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:44:00.700743 22514 retry.go:31] will retry after 1.189835008s: waiting for machine to come up
I0630 19:44:01.892025 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:01.892509 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | unable to find current IP address of domain multinode-20220630191425-10770-m03 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:01.892529 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:44:01.892454 22514 retry.go:31] will retry after 1.677229867s: waiting for machine to come up
I0630 19:44:03.572411 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:03.572866 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | unable to find current IP address of domain multinode-20220630191425-10770-m03 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:03.572883 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:44:03.572838 22514 retry.go:31] will retry after 2.346016261s: waiting for machine to come up
I0630 19:44:05.920305 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:05.920718 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | unable to find current IP address of domain multinode-20220630191425-10770-m03 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:05.920742 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:44:05.920676 22514 retry.go:31] will retry after 3.36678925s: waiting for machine to come up
I0630 19:44:09.291411 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:09.292010 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | unable to find current IP address of domain multinode-20220630191425-10770-m03 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:09.292038 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:44:09.291951 22514 retry.go:31] will retry after 3.11822781s: waiting for machine to come up
I0630 19:44:12.413412 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:12.413928 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | unable to find current IP address of domain multinode-20220630191425-10770-m03 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:12.413948 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | I0630 19:44:12.413890 22514 retry.go:31] will retry after 4.276119362s: waiting for machine to come up
I0630 19:44:16.691318 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:16.691852 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Found IP for machine: 192.168.50.104
I0630 19:44:16.691867 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Reserving static IP address...
I0630 19:44:16.691881 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has current primary IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:16.692242 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | unable to find host DHCP lease matching {name: "multinode-20220630191425-10770-m03", mac: "52:54:00:de:c8:a7", ip: "192.168.50.104"} in network mk-multinode-20220630191425-10770-m03
I0630 19:44:16.766432 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Reserved static IP address: 192.168.50.104
I0630 19:44:16.766468 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | Getting to WaitForSSH function...
I0630 19:44:16.766478 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Waiting for SSH to be available...
I0630 19:44:16.770623 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:16.771047 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:minikube Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:16.771075 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:16.771191 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | Using SSH client type: external
I0630 19:44:16.771219 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/multinode-20220630191425-10770-m03/id_rsa (-rw-------)
I0630 19:44:16.771267 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.104 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/multinode-20220630191425-10770-m03/id_rsa -p 22] /usr/bin/ssh <nil>}
I0630 19:44:16.771281 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | About to run SSH command:
I0630 19:44:16.771293 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | exit 0
I0630 19:44:16.862197 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | SSH cmd err, output: <nil>:
I0630 19:44:16.862506 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) KVM machine creation complete!
I0630 19:44:16.862844 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetConfigRaw
I0630 19:44:16.863471 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .DriverName
I0630 19:44:16.863663 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .DriverName
I0630 19:44:16.863835 22491 main.go:134] libmachine: Waiting for machine to be running, this may take a few minutes...
I0630 19:44:16.863849 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetState
I0630 19:44:16.865276 22491 main.go:134] libmachine: Detecting operating system of created instance...
I0630 19:44:16.865292 22491 main.go:134] libmachine: Waiting for SSH to be available...
I0630 19:44:16.865297 22491 main.go:134] libmachine: Getting to WaitForSSH function...
I0630 19:44:16.865303 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHHostname
I0630 19:44:16.867566 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:16.868020 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:16.868050 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:16.868218 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHPort
I0630 19:44:16.868405 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:16.868613 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:16.868764 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHUsername
I0630 19:44:16.868937 22491 main.go:134] libmachine: Using SSH client type: native
I0630 19:44:16.869081 22491 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil> [] 0s} 192.168.50.104 22 <nil> <nil>}
I0630 19:44:16.869087 22491 main.go:134] libmachine: About to run SSH command:
exit 0
I0630 19:44:16.985621 22491 main.go:134] libmachine: SSH cmd err, output: <nil>:
I0630 19:44:16.985646 22491 main.go:134] libmachine: Detecting the provisioner...
I0630 19:44:16.985668 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHHostname
I0630 19:44:16.988395 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:16.988725 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:16.988750 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:16.988892 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHPort
I0630 19:44:16.989051 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:16.989197 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:16.989326 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHUsername
I0630 19:44:16.989537 22491 main.go:134] libmachine: Using SSH client type: native
I0630 19:44:16.989675 22491 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil> [] 0s} 192.168.50.104 22 <nil> <nil>}
I0630 19:44:16.989681 22491 main.go:134] libmachine: About to run SSH command:
cat /etc/os-release
I0630 19:44:17.110901 22491 main.go:134] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g14f2929-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I0630 19:44:17.110962 22491 main.go:134] libmachine: found compatible host: buildroot
I0630 19:44:17.110968 22491 main.go:134] libmachine: Provisioning with buildroot...
I0630 19:44:17.110975 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetMachineName
I0630 19:44:17.111192 22491 buildroot.go:166] provisioning hostname "multinode-20220630191425-10770-m03"
I0630 19:44:17.111211 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetMachineName
I0630 19:44:17.111417 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHHostname
I0630 19:44:17.113935 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.114365 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:17.114385 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.114581 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHPort
I0630 19:44:17.114762 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:17.114899 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:17.115022 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHUsername
I0630 19:44:17.115156 22491 main.go:134] libmachine: Using SSH client type: native
I0630 19:44:17.115285 22491 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil> [] 0s} 192.168.50.104 22 <nil> <nil>}
I0630 19:44:17.115298 22491 main.go:134] libmachine: About to run SSH command:
sudo hostname multinode-20220630191425-10770-m03 && echo "multinode-20220630191425-10770-m03" | sudo tee /etc/hostname
I0630 19:44:17.247557 22491 main.go:134] libmachine: SSH cmd err, output: <nil>: multinode-20220630191425-10770-m03
I0630 19:44:17.247574 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHHostname
I0630 19:44:17.250327 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.250669 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:17.250691 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.250909 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHPort
I0630 19:44:17.251109 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:17.251306 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:17.251444 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHUsername
I0630 19:44:17.251610 22491 main.go:134] libmachine: Using SSH client type: native
I0630 19:44:17.251736 22491 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil> [] 0s} 192.168.50.104 22 <nil> <nil>}
I0630 19:44:17.251749 22491 main.go:134] libmachine: About to run SSH command:
if ! grep -xq '.*\smultinode-20220630191425-10770-m03' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-20220630191425-10770-m03/g' /etc/hosts;
else
echo '127.0.1.1 multinode-20220630191425-10770-m03' | sudo tee -a /etc/hosts;
fi
fi
I0630 19:44:17.378499 22491 main.go:134] libmachine: SSH cmd err, output: <nil>:
I0630 19:44:17.378523 22491 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRem
otePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube}
I0630 19:44:17.378538 22491 buildroot.go:174] setting up certificates
I0630 19:44:17.378545 22491 provision.go:83] configureAuth start
I0630 19:44:17.378552 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetMachineName
I0630 19:44:17.378853 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetIP
I0630 19:44:17.381434 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.381758 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:17.381787 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.381949 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHHostname
I0630 19:44:17.384631 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.385054 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:17.385081 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.385380 22491 provision.go:138] copyHostCerts
I0630 19:44:17.385435 22491 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/cert.pem, removing ...
I0630 19:44:17.385444 22491 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/cert.pem
I0630 19:44:17.385528 22491 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/cert.pem (1123 bytes)
I0630 19:44:17.385602 22491 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/key.pem, removing ...
I0630 19:44:17.385606 22491 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/key.pem
I0630 19:44:17.385630 22491 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/key.pem (1675 bytes)
I0630 19:44:17.385670 22491 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/ca.pem, removing ...
I0630 19:44:17.385673 22491 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/ca.pem
I0630 19:44:17.385710 22491 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/ca.pem (1082 bytes)
I0630 19:44:17.385766 22491 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/certs/ca-key.pem org=jenkins.multinode-20220630191425-10770-m03 san=[192.168.50.104 192.168.50.104 localhost 127.0.0.1 minikube multinode-20220630191425-10770-m03]
I0630 19:44:17.477352 22491 provision.go:172] copyRemoteCerts
I0630 19:44:17.477394 22491 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0630 19:44:17.477414 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHHostname
I0630 19:44:17.480552 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.480923 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:17.480952 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.481119 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHPort
I0630 19:44:17.481310 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:17.481457 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHUsername
I0630 19:44:17.481579 22491 sshutil.go:53] new ssh client: &{IP:192.168.50.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/multinode-20220630191425-10770-m03/id_rsa Username:docker}
I0630 19:44:17.572917 22491 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0630 19:44:17.595636 22491 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/server.pem --> /etc/docker/server.pem (1273 bytes)
I0630 19:44:17.616960 22491 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0630 19:44:17.641579 22491 provision.go:86] duration metric: configureAuth took 263.020732ms
I0630 19:44:17.641601 22491 buildroot.go:189] setting minikube options for container-runtime
I0630 19:44:17.641823 22491 config.go:178] Loaded profile config "multinode-20220630191425-10770-m03": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.24.2
I0630 19:44:17.641843 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .DriverName
I0630 19:44:17.642153 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHHostname
I0630 19:44:17.644916 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.645292 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:17.645333 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.645505 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHPort
I0630 19:44:17.645721 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:17.645868 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:17.645990 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHUsername
I0630 19:44:17.646113 22491 main.go:134] libmachine: Using SSH client type: native
I0630 19:44:17.646298 22491 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil> [] 0s} 192.168.50.104 22 <nil> <nil>}
I0630 19:44:17.646308 22491 main.go:134] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0630 19:44:17.768115 22491 main.go:134] libmachine: SSH cmd err, output: <nil>: tmpfs
I0630 19:44:17.768126 22491 buildroot.go:70] root file system type: tmpfs
I0630 19:44:17.768256 22491 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0630 19:44:17.768274 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHHostname
I0630 19:44:17.770991 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.771382 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:17.771411 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.771533 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHPort
I0630 19:44:17.771746 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:17.771911 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:17.772035 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHUsername
I0630 19:44:17.772222 22491 main.go:134] libmachine: Using SSH client type: native
I0630 19:44:17.772349 22491 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil> [] 0s} 192.168.50.104 22 <nil> <nil>}
I0630 19:44:17.772402 22491 main.go:134] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0630 19:44:17.908616 22491 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0630 19:44:17.908649 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHHostname
I0630 19:44:17.911267 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.911671 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:17.911699 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:17.911859 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHPort
I0630 19:44:17.912047 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:17.912232 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:17.912362 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHUsername
I0630 19:44:17.912529 22491 main.go:134] libmachine: Using SSH client type: native
I0630 19:44:17.912710 22491 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil> [] 0s} 192.168.50.104 22 <nil> <nil>}
I0630 19:44:17.912730 22491 main.go:134] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0630 19:44:18.671428 22491 main.go:134] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I0630 19:44:18.671442 22491 main.go:134] libmachine: Checking connection to Docker...
I0630 19:44:18.671450 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetURL
I0630 19:44:18.672834 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | Using libvirt version 6000000
I0630 19:44:18.675309 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:18.675700 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:18.675728 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:18.675887 22491 main.go:134] libmachine: Docker is up and running!
I0630 19:44:18.675896 22491 main.go:134] libmachine: Reticulating splines...
I0630 19:44:18.675900 22491 client.go:171] LocalClient.Create took 23.409811213s
I0630 19:44:18.675915 22491 start.go:173] duration metric: libmachine.API.Create for "multinode-20220630191425-10770-m03" took 23.409855132s
I0630 19:44:18.675921 22491 start.go:306] post-start starting for "multinode-20220630191425-10770-m03" (driver="kvm2")
I0630 19:44:18.675924 22491 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0630 19:44:18.675941 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .DriverName
I0630 19:44:18.676174 22491 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0630 19:44:18.676192 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHHostname
I0630 19:44:18.678572 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:18.678914 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:18.678951 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:18.679092 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHPort
I0630 19:44:18.679268 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:18.679429 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHUsername
I0630 19:44:18.679575 22491 sshutil.go:53] new ssh client: &{IP:192.168.50.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/multinode-20220630191425-10770-m03/id_rsa Username:docker}
I0630 19:44:18.771404 22491 ssh_runner.go:195] Run: cat /etc/os-release
I0630 19:44:18.775309 22491 info.go:137] Remote host: Buildroot 2021.02.12
I0630 19:44:18.775325 22491 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/addons for local assets ...
I0630 19:44:18.775380 22491 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/files for local assets ...
I0630 19:44:18.775458 22491 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/files/etc/ssl/certs/107702.pem -> 107702.pem in /etc/ssl/certs
I0630 19:44:18.775532 22491 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0630 19:44:18.783517 22491 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/files/etc/ssl/certs/107702.pem --> /etc/ssl/certs/107702.pem (1708 bytes)
I0630 19:44:18.808830 22491 start.go:309] post-start completed in 132.89894ms
I0630 19:44:18.808872 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetConfigRaw
I0630 19:44:18.809511 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetIP
I0630 19:44:18.812569 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:18.812974 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:18.813014 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:18.813308 22491 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/profiles/multinode-20220630191425-10770-m03/config.json ...
I0630 19:44:18.813516 22491 start.go:134] duration metric: createHost completed in 23.567405516s
I0630 19:44:18.813536 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHHostname
I0630 19:44:18.815840 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:18.816166 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:18.816192 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:18.816339 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHPort
I0630 19:44:18.816523 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:18.816653 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:18.816787 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHUsername
I0630 19:44:18.816902 22491 main.go:134] libmachine: Using SSH client type: native
I0630 19:44:18.817032 22491 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7dae00] 0x7dde60 <nil> [] 0s} 192.168.50.104 22 <nil> <nil>}
I0630 19:44:18.817041 22491 main.go:134] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0630 19:44:18.939851 22491 main.go:134] libmachine: SSH cmd err, output: <nil>: 1656618258.910395661
I0630 19:44:18.939862 22491 fix.go:207] guest clock: 1656618258.910395661
I0630 19:44:18.939867 22491 fix.go:220] Guest: 2022-06-30 19:44:18.910395661 +0000 UTC Remote: 2022-06-30 19:44:18.813521994 +0000 UTC m=+23.702736336 (delta=96.873667ms)
I0630 19:44:18.939885 22491 fix.go:191] guest clock delta is within tolerance: 96.873667ms
I0630 19:44:18.939889 22491 start.go:81] releasing machines lock for "multinode-20220630191425-10770-m03", held for 23.693870332s
I0630 19:44:18.939929 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .DriverName
I0630 19:44:18.940203 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetIP
I0630 19:44:18.942807 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:18.943177 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:18.943196 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:18.943419 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .DriverName
I0630 19:44:18.943602 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .DriverName
I0630 19:44:18.943745 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .DriverName
I0630 19:44:18.944296 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .DriverName
I0630 19:44:18.944447 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .DriverName
I0630 19:44:18.944518 22491 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0630 19:44:18.944564 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHHostname
I0630 19:44:18.944707 22491 ssh_runner.go:195] Run: systemctl --version
I0630 19:44:18.944723 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHHostname
I0630 19:44:18.947407 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:18.947526 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:18.947770 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:18.947798 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:18.947869 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:de:c8:a7", ip: ""} in network mk-multinode-20220630191425-10770-m03: {Iface:virbr2 ExpiryTime:2022-06-30 20:44:09 +0000 UTC Type:0 Mac:52:54:00:de:c8:a7 Iaid: IPaddr:192.168.50.104 Prefix:24 Hostname:multinode-20220630191425-10770-m03 Clientid:01:52:54:00:de:c8:a7}
I0630 19:44:18.947889 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) DBG | domain multinode-20220630191425-10770-m03 has defined IP address 192.168.50.104 and MAC address 52:54:00:de:c8:a7 in network mk-multinode-20220630191425-10770-m03
I0630 19:44:18.947923 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHPort
I0630 19:44:18.948097 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:18.948098 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHPort
I0630 19:44:18.948277 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHKeyPath
I0630 19:44:18.948285 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHUsername
I0630 19:44:18.948440 22491 main.go:134] libmachine: (multinode-20220630191425-10770-m03) Calling .GetSSHUsername
I0630 19:44:18.948465 22491 sshutil.go:53] new ssh client: &{IP:192.168.50.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/multinode-20220630191425-10770-m03/id_rsa Username:docker}
I0630 19:44:18.948596 22491 sshutil.go:53] new ssh client: &{IP:192.168.50.104 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/machines/multinode-20220630191425-10770-m03/id_rsa Username:docker}
I0630 19:44:19.032479 22491 preload.go:132] Checking if preload exists for k8s version v1.24.2 and runtime docker
I0630 19:44:19.032550 22491 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0630 19:44:19.076268 22491 docker.go:602] Got preloaded images:
I0630 19:44:19.076280 22491 docker.go:608] k8s.gcr.io/kube-apiserver:v1.24.2 wasn't preloaded
I0630 19:44:19.076318 22491 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
I0630 19:44:19.087438 22491 ssh_runner.go:195] Run: which lz4
I0630 19:44:19.091445 22491 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0630 19:44:19.095544 22491 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I0630 19:44:19.095569 22491 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-kvm2--14420-3736-a1c71987949a080ebcb9d092f1fe4c348bd11abd/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.2-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (425551914 bytes)
I0630 19:44:20.899316 22491 docker.go:567] Took 1.807889 seconds to copy over tarball
I0630 19:44:20.899382 22491 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
I0630 19:44:23.669821 22491 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (2.770418891s)
I0630 19:44:23.669835 22491 ssh_runner.go:146] rm: /preloaded.tar.lz4
I0630 19:44:23.709787 22491 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
I0630 19:44:23.719795 22491 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2523 bytes)
I0630 19:44:23.737253 22491 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0630 19:44:23.844701 22491 ssh_runner.go:195] Run: sudo systemctl restart docker
*
* ==> Docker <==
* -- Journal begins at Thu 2022-06-30 19:34:11 UTC, ends at Thu 2022-06-30 19:44:28 UTC. --
Jun 30 19:34:38 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:38.139421201Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Jun 30 19:34:38 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:38.139495887Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Jun 30 19:34:38 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:38.139507948Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Jun 30 19:34:38 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:38.139666214Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/ce786f8c69d0ff9b99cedfab16ee6a150645024d1009ff147f5e02ed0cd612c5 pid=2033 runtime=io.containerd.runc.v2
Jun 30 19:34:38 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:38.281971275Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Jun 30 19:34:38 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:38.282184370Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Jun 30 19:34:38 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:38.282209661Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Jun 30 19:34:38 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:38.282424445Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/1860d77d60e95faecb27874a925cffefed04674819a914816bc4716810af2b48 pid=2059 runtime=io.containerd.runc.v2
Jun 30 19:34:38 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:38.378370242Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Jun 30 19:34:38 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:38.378534719Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Jun 30 19:34:38 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:38.378560285Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Jun 30 19:34:38 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:38.386392674Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/5077187169c15ad9e3a1581dcfcfd0e739c5066a99ccc0617a4e00bead22406f pid=2084 runtime=io.containerd.runc.v2
Jun 30 19:34:41 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:41.942355030Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Jun 30 19:34:41 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:41.942475010Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Jun 30 19:34:41 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:41.942486762Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Jun 30 19:34:41 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:34:41.943157587Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/f47e66fb504f7834f194fb50456f9c150d87758dbe9d22962af235083ee4f9a2 pid=2368 runtime=io.containerd.runc.v2
Jun 30 19:35:08 multinode-20220630191425-10770 dockerd[877]: time="2022-06-30T19:35:08.667361458Z" level=info msg="ignoring event" container=1860d77d60e95faecb27874a925cffefed04674819a914816bc4716810af2b48 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Jun 30 19:35:08 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:35:08.668887134Z" level=info msg="shim disconnected" id=1860d77d60e95faecb27874a925cffefed04674819a914816bc4716810af2b48
Jun 30 19:35:08 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:35:08.669246069Z" level=warning msg="cleaning up after shim disconnected" id=1860d77d60e95faecb27874a925cffefed04674819a914816bc4716810af2b48 namespace=moby
Jun 30 19:35:08 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:35:08.669263964Z" level=info msg="cleaning up dead shim"
Jun 30 19:35:08 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:35:08.682828603Z" level=warning msg="cleanup warnings time=\"2022-06-30T19:35:08Z\" level=info msg=\"starting signal loop\" namespace=moby pid=2778 runtime=io.containerd.runc.v2\n"
Jun 30 19:35:21 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:35:21.878707495Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Jun 30 19:35:21 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:35:21.879249724Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Jun 30 19:35:21 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:35:21.879402158Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Jun 30 19:35:21 multinode-20220630191425-10770 dockerd[884]: time="2022-06-30T19:35:21.879925714Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/90758f2fb7ba0c6478af880af87493aadd7c4e93de92349c1d6779ca0cdc2b4c pid=2956 runtime=io.containerd.runc.v2
*
* ==> container status <==
* CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID
90758f2fb7ba0 6e38f40d628db 9 minutes ago Running storage-provisioner 4 6233467af24d1
f47e66fb504f7 6fb66cd78abfe 9 minutes ago Running kindnet-cni 2 5077187169c15
1860d77d60e95 6e38f40d628db 9 minutes ago Exited storage-provisioner 3 6233467af24d1
ce786f8c69d0f a634548d10b03 9 minutes ago Running kube-proxy 2 afb1116b21f09
579f74669b69a 5d725196c1f47 9 minutes ago Running kube-scheduler 2 b21213710ed9a
d476d30152114 aebe758cef4cd 9 minutes ago Running etcd 2 e392b7b93f3ca
ba7886d8749a4 34cdf99b1bb3b 9 minutes ago Running kube-controller-manager 2 276f394a745ec
5ff7706c71e48 d3377ffb7177c 9 minutes ago Running kube-apiserver 2 2e5be637f0889
fe6354befea57 6fb66cd78abfe 24 minutes ago Exited kindnet-cni 1 2253f93f5dd52
008d149ef3d10 a634548d10b03 24 minutes ago Exited kube-proxy 1 85ebb78923e35
f78e04f1bae15 aebe758cef4cd 24 minutes ago Exited etcd 1 b2f9d1f9979ca
87b96d92debf3 5d725196c1f47 24 minutes ago Exited kube-scheduler 1 6c608c0ee8cb6
ea647b675c376 34cdf99b1bb3b 24 minutes ago Exited kube-controller-manager 1 85adc17292130
2c115a53584be d3377ffb7177c 24 minutes ago Exited kube-apiserver 1 217f8be340b93
8173857a1d9c8 gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12 27 minutes ago Exited busybox 0 cf4337142d5d8
7149d04c331b2 a4ca41631cc7a 28 minutes ago Exited coredns 0 bab855fc181af
*
* ==> coredns [7149d04c331b] <==
* .:53
[INFO] plugin/reload: Running configuration MD5 = 8f51b271a18f2ce6fcaee5f1cfda3ed0
CoreDNS-1.8.6
linux/amd64, go1.17.1, 13a9191
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
*
* ==> describe nodes <==
* Name: multinode-20220630191425-10770
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-20220630191425-10770
kubernetes.io/os=linux
minikube.k8s.io/commit=ee0bba430d460fb1f89fd42fd96e07581821dd6f
minikube.k8s.io/name=multinode-20220630191425-10770
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2022_06_30T19_15_20_0700
minikube.k8s.io/version=v1.26.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 30 Jun 2022 19:15:16 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: multinode-20220630191425-10770
AcquireTime: <unset>
RenewTime: Thu, 30 Jun 2022 19:44:27 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 30 Jun 2022 19:40:02 +0000 Thu, 30 Jun 2022 19:15:12 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 30 Jun 2022 19:40:02 +0000 Thu, 30 Jun 2022 19:15:12 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 30 Jun 2022 19:40:02 +0000 Thu, 30 Jun 2022 19:15:12 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 30 Jun 2022 19:40:02 +0000 Thu, 30 Jun 2022 19:34:56 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.6
Hostname: multinode-20220630191425-10770
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165916Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165916Ki
pods: 110
System Info:
Machine ID: b6ce9d2c3def4f43865628973c627300
System UUID: b6ce9d2c-3def-4f43-8656-28973c627300
Boot ID: f50c88ba-c354-41e5-ba15-ae7328cbe634
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://20.10.16
Kubelet Version: v1.24.2
Kube-Proxy Version: v1.24.2
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-d46db594c-6knvj 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 27m
kube-system coredns-6d4b75cb6d-pk4q6 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 28m
kube-system etcd-multinode-20220630191425-10770 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 29m
kube-system kindnet-n4lxr 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 28m
kube-system kube-apiserver-multinode-20220630191425-10770 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 29m
kube-system kube-controller-manager-multinode-20220630191425-10770 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 29m
kube-system kube-proxy-fpzxr 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 28m
kube-system kube-scheduler-multinode-20220630191425-10770 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 29m
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 28m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (42%!)(MISSING) 100m (5%!)(MISSING)
memory 220Mi (10%!)(MISSING) 220Mi (10%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 28m kube-proxy
Normal Starting 24m kube-proxy
Normal Starting 9m49s kube-proxy
Normal Starting 29m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 29m (x5 over 29m) kubelet Node multinode-20220630191425-10770 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 29m (x5 over 29m) kubelet Node multinode-20220630191425-10770 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 29m (x4 over 29m) kubelet Node multinode-20220630191425-10770 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 29m kubelet Updated Node Allocatable limit across pods
Normal Starting 29m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 29m kubelet Node multinode-20220630191425-10770 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 29m kubelet Node multinode-20220630191425-10770 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 29m kubelet Node multinode-20220630191425-10770 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 29m kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 28m node-controller Node multinode-20220630191425-10770 event: Registered Node multinode-20220630191425-10770 in Controller
Normal NodeReady 28m kubelet Node multinode-20220630191425-10770 status is now: NodeReady
Normal NodeAllocatableEnforced 24m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 24m (x8 over 24m) kubelet Node multinode-20220630191425-10770 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 24m (x8 over 24m) kubelet Node multinode-20220630191425-10770 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 24m (x7 over 24m) kubelet Node multinode-20220630191425-10770 status is now: NodeHasSufficientPID
Normal Starting 24m kubelet Starting kubelet.
Normal RegisteredNode 24m node-controller Node multinode-20220630191425-10770 event: Registered Node multinode-20220630191425-10770 in Controller
Normal Starting 10m kubelet Starting kubelet.
Normal NodeAllocatableEnforced 10m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 9m59s (x8 over 10m) kubelet Node multinode-20220630191425-10770 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m59s (x8 over 10m) kubelet Node multinode-20220630191425-10770 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m59s (x7 over 10m) kubelet Node multinode-20220630191425-10770 status is now: NodeHasSufficientPID
Normal RegisteredNode 9m40s node-controller Node multinode-20220630191425-10770 event: Registered Node multinode-20220630191425-10770 in Controller
Name: multinode-20220630191425-10770-m02
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-20220630191425-10770-m02
kubernetes.io/os=linux
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 30 Jun 2022 19:39:32 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: multinode-20220630191425-10770-m02
AcquireTime: <unset>
RenewTime: Thu, 30 Jun 2022 19:44:18 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 30 Jun 2022 19:39:52 +0000 Thu, 30 Jun 2022 19:39:32 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 30 Jun 2022 19:39:52 +0000 Thu, 30 Jun 2022 19:39:32 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 30 Jun 2022 19:39:52 +0000 Thu, 30 Jun 2022 19:39:32 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 30 Jun 2022 19:39:52 +0000 Thu, 30 Jun 2022 19:39:52 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.39.113
Hostname: multinode-20220630191425-10770-m02
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165916Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2165916Ki
pods: 110
System Info:
Machine ID: 309195e8ce404b288f0fdc14eb540096
System UUID: 309195e8-ce40-4b28-8f0f-dc14eb540096
Boot ID: 3fa57f5a-6783-4a5f-b4ee-5dcf16bc65ac
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://20.10.16
Kubelet Version: v1.24.2
Kube-Proxy Version: v1.24.2
PodCIDR: 10.244.1.0/24
PodCIDRs: 10.244.1.0/24
Non-terminated Pods: (3 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-d46db594c-z95jx 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 27m
kube-system kindnet-tk9kp 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 27m
kube-system kube-proxy-9mkb6 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 27m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (5%!)(MISSING) 100m (5%!)(MISSING)
memory 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 19m kube-proxy
Normal Starting 27m kube-proxy
Normal Starting 4m53s kube-proxy
Normal NodeHasNoDiskPressure 27m (x8 over 28m) kubelet Node multinode-20220630191425-10770-m02 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientMemory 27m (x8 over 28m) kubelet Node multinode-20220630191425-10770-m02 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 19m (x2 over 19m) kubelet Node multinode-20220630191425-10770-m02 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 19m (x2 over 19m) kubelet Node multinode-20220630191425-10770-m02 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 19m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 19m (x2 over 19m) kubelet Node multinode-20220630191425-10770-m02 status is now: NodeHasSufficientMemory
Normal Starting 19m kubelet Starting kubelet.
Normal NodeReady 19m kubelet Node multinode-20220630191425-10770-m02 status is now: NodeReady
Normal Starting 4m57s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 4m56s (x2 over 4m56s) kubelet Node multinode-20220630191425-10770-m02 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 4m56s (x2 over 4m56s) kubelet Node multinode-20220630191425-10770-m02 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 4m56s (x2 over 4m56s) kubelet Node multinode-20220630191425-10770-m02 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 4m56s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 4m36s kubelet Node multinode-20220630191425-10770-m02 status is now: NodeReady
*
* ==> dmesg <==
* [Jun30 19:34] You have booted with nomodeset. This means your GPU drivers are DISABLED
[ +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[ +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it
[ +0.069063] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +3.883921] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +3.025493] systemd-fstab-generator[114]: Ignoring "noauto" for root device
[ +0.130102] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +2.588055] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000021] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)
[ +5.762180] systemd-fstab-generator[509]: Ignoring "noauto" for root device
[ +0.122813] systemd-fstab-generator[520]: Ignoring "noauto" for root device
[ +1.124556] systemd-fstab-generator[790]: Ignoring "noauto" for root device
[ +0.316664] systemd-fstab-generator[846]: Ignoring "noauto" for root device
[ +0.107876] systemd-fstab-generator[857]: Ignoring "noauto" for root device
[ +0.104948] systemd-fstab-generator[868]: Ignoring "noauto" for root device
[ +1.663275] systemd-fstab-generator[1044]: Ignoring "noauto" for root device
[ +0.096351] systemd-fstab-generator[1055]: Ignoring "noauto" for root device
[ +5.060499] systemd-fstab-generator[1261]: Ignoring "noauto" for root device
[ +0.259387] kauditd_printk_skb: 67 callbacks suppressed
[ +10.223183] kauditd_printk_skb: 7 callbacks suppressed
*
* ==> etcd [d476d3015211] <==
* {"level":"info","ts":"2022-06-30T19:34:33.267Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"6f26d2d338759d80","local-member-attributes":"{Name:multinode-20220630191425-10770 ClientURLs:[https://192.168.39.6:2379]}","request-path":"/0/members/6f26d2d338759d80/attributes","cluster-id":"1a1020f766a5ac01","publish-timeout":"7s"}
{"level":"info","ts":"2022-06-30T19:34:33.268Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
{"level":"info","ts":"2022-06-30T19:34:33.269Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
{"level":"info","ts":"2022-06-30T19:34:33.268Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
{"level":"info","ts":"2022-06-30T19:34:33.273Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.39.6:2379"}
{"level":"info","ts":"2022-06-30T19:34:33.270Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2022-06-30T19:34:33.274Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2022-06-30T19:44:26.186Z","caller":"traceutil/trace.go:171","msg":"trace[2026423543] linearizableReadLoop","detail":"{readStateIndex:2824; appliedIndex:2824; }","duration":"246.706901ms","start":"2022-06-30T19:44:25.940Z","end":"2022-06-30T19:44:26.186Z","steps":["trace[2026423543] 'read index received' (duration: 246.687549ms)","trace[2026423543] 'applied index is now lower than readState.Index' (duration: 15.778µs)"],"step_count":2}
{"level":"warn","ts":"2022-06-30T19:44:26.293Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"225.873467ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2022-06-30T19:44:26.293Z","caller":"traceutil/trace.go:171","msg":"trace[1211445575] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:2413; }","duration":"226.131897ms","start":"2022-06-30T19:44:26.067Z","end":"2022-06-30T19:44:26.293Z","steps":["trace[1211445575] 'agreement among raft nodes before linearized reading' (duration: 119.64814ms)","trace[1211445575] 'range keys from in-memory index tree' (duration: 106.230635ms)"],"step_count":2}
{"level":"warn","ts":"2022-06-30T19:44:26.294Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"354.067392ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2022-06-30T19:44:26.294Z","caller":"traceutil/trace.go:171","msg":"trace[493267498] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:2413; }","duration":"354.152096ms","start":"2022-06-30T19:44:25.940Z","end":"2022-06-30T19:44:26.294Z","steps":["trace[493267498] 'agreement among raft nodes before linearized reading' (duration: 247.201755ms)","trace[493267498] 'range keys from in-memory index tree' (duration: 106.843892ms)"],"step_count":2}
{"level":"warn","ts":"2022-06-30T19:44:26.294Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-06-30T19:44:25.939Z","time spent":"354.317797ms","remote":"127.0.0.1:36312","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":27,"request content":"key:\"/registry/health\" "}
{"level":"warn","ts":"2022-06-30T19:44:27.538Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"339.499263ms","expected-duration":"100ms","prefix":"","request":"header:<ID:11349213680120993296 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/masterleases/192.168.39.6\" mod_revision:2405 > success:<request_put:<key:\"/registry/masterleases/192.168.39.6\" value_size:67 lease:2125841643266217486 >> failure:<request_range:<key:\"/registry/masterleases/192.168.39.6\" > >>","response":"size:16"}
{"level":"info","ts":"2022-06-30T19:44:27.538Z","caller":"traceutil/trace.go:171","msg":"trace[2010908684] transaction","detail":"{read_only:false; response_revision:2414; number_of_response:1; }","duration":"465.82782ms","start":"2022-06-30T19:44:27.072Z","end":"2022-06-30T19:44:27.538Z","steps":["trace[2010908684] 'process raft request' (duration: 124.779745ms)","trace[2010908684] 'compare' (duration: 339.334047ms)"],"step_count":2}
{"level":"warn","ts":"2022-06-30T19:44:27.538Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-06-30T19:44:27.072Z","time spent":"465.949236ms","remote":"127.0.0.1:36332","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":118,"response count":0,"response size":38,"request content":"compare:<target:MOD key:\"/registry/masterleases/192.168.39.6\" mod_revision:2405 > success:<request_put:<key:\"/registry/masterleases/192.168.39.6\" value_size:67 lease:2125841643266217486 >> failure:<request_range:<key:\"/registry/masterleases/192.168.39.6\" > >"}
{"level":"info","ts":"2022-06-30T19:44:27.539Z","caller":"traceutil/trace.go:171","msg":"trace[1858633870] transaction","detail":"{read_only:false; response_revision:2415; number_of_response:1; }","duration":"212.384577ms","start":"2022-06-30T19:44:27.326Z","end":"2022-06-30T19:44:27.538Z","steps":["trace[1858633870] 'process raft request' (duration: 212.03215ms)"],"step_count":1}
{"level":"info","ts":"2022-06-30T19:44:27.539Z","caller":"traceutil/trace.go:171","msg":"trace[1994085643] linearizableReadLoop","detail":"{readStateIndex:2826; appliedIndex:2825; }","duration":"405.258149ms","start":"2022-06-30T19:44:27.134Z","end":"2022-06-30T19:44:27.539Z","steps":["trace[1994085643] 'read index received' (duration: 62.950342ms)","trace[1994085643] 'applied index is now lower than readState.Index' (duration: 342.306694ms)"],"step_count":2}
{"level":"warn","ts":"2022-06-30T19:44:27.540Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"405.861839ms","expected-duration":"100ms","prefix":"read-only range ","request":"limit:1 keys_only:true ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2022-06-30T19:44:27.540Z","caller":"traceutil/trace.go:171","msg":"trace[2018152114] range","detail":"{range_begin:; range_end:; response_count:0; response_revision:2415; }","duration":"405.938004ms","start":"2022-06-30T19:44:27.134Z","end":"2022-06-30T19:44:27.540Z","steps":["trace[2018152114] 'agreement among raft nodes before linearized reading' (duration: 405.845514ms)"],"step_count":1}
{"level":"warn","ts":"2022-06-30T19:44:27.541Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"321.695523ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" ","response":"range_response_count:1 size:1133"}
{"level":"info","ts":"2022-06-30T19:44:27.541Z","caller":"traceutil/trace.go:171","msg":"trace[1603018137] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:1; response_revision:2415; }","duration":"321.787225ms","start":"2022-06-30T19:44:27.219Z","end":"2022-06-30T19:44:27.541Z","steps":["trace[1603018137] 'agreement among raft nodes before linearized reading' (duration: 321.673433ms)"],"step_count":1}
{"level":"warn","ts":"2022-06-30T19:44:27.541Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-06-30T19:44:27.219Z","time spent":"321.839286ms","remote":"127.0.0.1:36352","response type":"/etcdserverpb.KV/Range","request count":0,"request size":67,"response count":1,"response size":1155,"request content":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" "}
{"level":"warn","ts":"2022-06-30T19:44:27.544Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"206.95774ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/\" range_end:\"/registry/deployments0\" count_only:true ","response":"range_response_count:0 size:7"}
{"level":"info","ts":"2022-06-30T19:44:27.544Z","caller":"traceutil/trace.go:171","msg":"trace[1586157435] range","detail":"{range_begin:/registry/deployments/; range_end:/registry/deployments0; response_count:0; response_revision:2415; }","duration":"207.016765ms","start":"2022-06-30T19:44:27.337Z","end":"2022-06-30T19:44:27.544Z","steps":["trace[1586157435] 'agreement among raft nodes before linearized reading' (duration: 204.711444ms)"],"step_count":1}
*
* ==> etcd [f78e04f1bae1] <==
* {"level":"info","ts":"2022-06-30T19:19:49.521Z","caller":"etcdserver/server.go:752","msg":"starting initial election tick advance","election-ticks":10}
{"level":"info","ts":"2022-06-30T19:19:49.523Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"6f26d2d338759d80 switched to configuration voters=(8009320791952170368)"}
{"level":"info","ts":"2022-06-30T19:19:49.523Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"1a1020f766a5ac01","local-member-id":"6f26d2d338759d80","added-peer-id":"6f26d2d338759d80","added-peer-peer-urls":["https://192.168.39.6:2380"]}
{"level":"info","ts":"2022-06-30T19:19:49.524Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"1a1020f766a5ac01","local-member-id":"6f26d2d338759d80","cluster-version":"3.5"}
{"level":"info","ts":"2022-06-30T19:19:49.524Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2022-06-30T19:19:51.268Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"6f26d2d338759d80 is starting a new election at term 2"}
{"level":"info","ts":"2022-06-30T19:19:51.268Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"6f26d2d338759d80 became pre-candidate at term 2"}
{"level":"info","ts":"2022-06-30T19:19:51.269Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"6f26d2d338759d80 received MsgPreVoteResp from 6f26d2d338759d80 at term 2"}
{"level":"info","ts":"2022-06-30T19:19:51.269Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"6f26d2d338759d80 became candidate at term 3"}
{"level":"info","ts":"2022-06-30T19:19:51.269Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"6f26d2d338759d80 received MsgVoteResp from 6f26d2d338759d80 at term 3"}
{"level":"info","ts":"2022-06-30T19:19:51.269Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"6f26d2d338759d80 became leader at term 3"}
{"level":"info","ts":"2022-06-30T19:19:51.269Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 6f26d2d338759d80 elected leader 6f26d2d338759d80 at term 3"}
{"level":"info","ts":"2022-06-30T19:19:51.269Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"6f26d2d338759d80","local-member-attributes":"{Name:multinode-20220630191425-10770 ClientURLs:[https://192.168.39.6:2379]}","request-path":"/0/members/6f26d2d338759d80/attributes","cluster-id":"1a1020f766a5ac01","publish-timeout":"7s"}
{"level":"info","ts":"2022-06-30T19:19:51.269Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
{"level":"info","ts":"2022-06-30T19:19:51.270Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}
{"level":"info","ts":"2022-06-30T19:19:51.271Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2022-06-30T19:19:51.271Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2022-06-30T19:19:51.272Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
{"level":"info","ts":"2022-06-30T19:19:51.274Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.39.6:2379"}
{"level":"info","ts":"2022-06-30T19:29:51.297Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1130}
{"level":"info","ts":"2022-06-30T19:29:51.318Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":1130,"took":"20.587911ms"}
{"level":"info","ts":"2022-06-30T19:33:55.647Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}
{"level":"info","ts":"2022-06-30T19:33:55.648Z","caller":"embed/etcd.go:368","msg":"closing etcd server","name":"multinode-20220630191425-10770","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.39.6:2380"],"advertise-client-urls":["https://192.168.39.6:2379"]}
WARNING: 2022/06/30 19:33:55 [core] grpc: addrConn.createTransport failed to connect to {127.0.0.1:2379 127.0.0.1:2379 <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...
WARNING: 2022/06/30 19:33:55 [core] grpc: addrConn.createTransport failed to connect to {192.168.39.6:2379 192.168.39.6:2379 <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial tcp 192.168.39.6:2379: connect: connection refused". Reconnecting...
*
* ==> kernel <==
* 19:44:28 up 10 min, 0 users, load average: 0.20, 0.27, 0.14
Linux multinode-20220630191425-10770 5.10.57 #1 SMP Thu Jun 16 23:36:20 UTC 2022 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
*
* ==> kube-apiserver [2c115a53584b] <==
* I0630 19:19:53.745344 1 naming_controller.go:291] Starting NamingConditionController
I0630 19:19:53.745389 1 establishing_controller.go:76] Starting EstablishingController
I0630 19:19:53.745402 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0630 19:19:53.745683 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0630 19:19:53.745952 1 crd_finalizer.go:266] Starting CRDFinalizer
I0630 19:19:53.763305 1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"
I0630 19:19:53.775012 1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt"
I0630 19:19:53.844474 1 shared_informer.go:262] Caches are synced for crd-autoregister
I0630 19:19:53.899648 1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io
I0630 19:19:53.915065 1 shared_informer.go:262] Caches are synced for node_authorizer
I0630 19:19:53.917568 1 apf_controller.go:322] Running API Priority and Fairness config worker
I0630 19:19:53.922949 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0630 19:19:53.923862 1 shared_informer.go:262] Caches are synced for cluster_authentication_trust_controller
I0630 19:19:53.924480 1 cache.go:39] Caches are synced for AvailableConditionController controller
I0630 19:19:53.924800 1 cache.go:39] Caches are synced for autoregister controller
I0630 19:19:54.402572 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0630 19:19:54.725653 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0630 19:19:56.797565 1 controller.go:611] quota admission added evaluator for: daemonsets.apps
I0630 19:19:56.862211 1 controller.go:611] quota admission added evaluator for: events.events.k8s.io
I0630 19:19:57.053156 1 controller.go:611] quota admission added evaluator for: serviceaccounts
I0630 19:19:57.073391 1 controller.go:611] quota admission added evaluator for: deployments.apps
I0630 19:19:57.132139 1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0630 19:19:57.138748 1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0630 19:20:06.739812 1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0630 19:20:06.768809 1 controller.go:611] quota admission added evaluator for: endpoints
*
* ==> kube-apiserver [5ff7706c71e4] <==
* I0630 19:34:35.758614 1 establishing_controller.go:76] Starting EstablishingController
I0630 19:34:35.758669 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0630 19:34:35.758681 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0630 19:34:35.758697 1 crd_finalizer.go:266] Starting CRDFinalizer
I0630 19:34:35.779295 1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0630 19:34:35.779352 1 shared_informer.go:255] Waiting for caches to sync for crd-autoregister
I0630 19:34:35.854413 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0630 19:34:35.862916 1 cache.go:39] Caches are synced for autoregister controller
E0630 19:34:35.877221 1 controller.go:169] Error removing old endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
I0630 19:34:35.880058 1 shared_informer.go:262] Caches are synced for crd-autoregister
I0630 19:34:35.889934 1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io
I0630 19:34:35.912524 1 shared_informer.go:262] Caches are synced for node_authorizer
I0630 19:34:35.943375 1 shared_informer.go:262] Caches are synced for cluster_authentication_trust_controller
I0630 19:34:35.946047 1 cache.go:39] Caches are synced for AvailableConditionController controller
I0630 19:34:35.947630 1 apf_controller.go:322] Running API Priority and Fairness config worker
I0630 19:34:35.997249 1 controller.go:611] quota admission added evaluator for: events.events.k8s.io
I0630 19:34:36.430333 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0630 19:34:36.747067 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0630 19:34:38.719364 1 controller.go:611] quota admission added evaluator for: daemonsets.apps
I0630 19:34:38.891668 1 controller.go:611] quota admission added evaluator for: serviceaccounts
I0630 19:34:38.959637 1 controller.go:611] quota admission added evaluator for: deployments.apps
I0630 19:34:39.067733 1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0630 19:34:39.090059 1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0630 19:34:48.607171 1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0630 19:35:39.424544 1 controller.go:611] quota admission added evaluator for: endpoints
*
* ==> kube-controller-manager [ba7886d8749a] <==
* I0630 19:34:48.728643 1 shared_informer.go:262] Caches are synced for persistent volume
I0630 19:34:48.745162 1 shared_informer.go:262] Caches are synced for certificate-csrapproving
I0630 19:34:48.787197 1 shared_informer.go:262] Caches are synced for certificate-csrsigning-kubelet-serving
I0630 19:34:48.788600 1 shared_informer.go:262] Caches are synced for certificate-csrsigning-legacy-unknown
I0630 19:34:48.788612 1 shared_informer.go:262] Caches are synced for certificate-csrsigning-kube-apiserver-client
I0630 19:34:48.788623 1 shared_informer.go:262] Caches are synced for certificate-csrsigning-kubelet-client
I0630 19:34:49.180762 1 shared_informer.go:262] Caches are synced for garbage collector
I0630 19:34:49.180812 1 garbagecollector.go:158] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0630 19:34:49.202643 1 shared_informer.go:262] Caches are synced for garbage collector
W0630 19:34:56.129215 1 topologycache.go:199] Can't get CPU or zone information for multinode-20220630191425-10770-m02 node
I0630 19:34:58.533639 1 event.go:294] "Event occurred" object="default/busybox-d46db594c-6knvj" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod default/busybox-d46db594c-6knvj"
I0630 19:34:58.533682 1 event.go:294] "Event occurred" object="kube-system/storage-provisioner" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod kube-system/storage-provisioner"
I0630 19:34:58.533691 1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d-pk4q6" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod kube-system/coredns-6d4b75cb6d-pk4q6"
I0630 19:35:28.550320 1 event.go:294] "Event occurred" object="multinode-20220630191425-10770-m02" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="NodeNotReady" message="Node multinode-20220630191425-10770-m02 status is now: NodeNotReady"
I0630 19:35:28.560106 1 event.go:294] "Event occurred" object="kube-system/kindnet-tk9kp" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0630 19:35:28.582631 1 event.go:294] "Event occurred" object="kube-system/kube-proxy-9mkb6" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0630 19:35:48.518910 1 gc_controller.go:81] "PodGC is force deleting Pod" pod="kube-system/kindnet-vfl6g"
I0630 19:35:48.537505 1 gc_controller.go:239] "Forced deletion of orphaned Pod succeeded" pod="kube-system/kindnet-vfl6g"
I0630 19:35:48.538255 1 gc_controller.go:81] "PodGC is force deleting Pod" pod="kube-system/kube-proxy-rh8lz"
I0630 19:35:48.561168 1 gc_controller.go:239] "Forced deletion of orphaned Pod succeeded" pod="kube-system/kube-proxy-rh8lz"
W0630 19:39:32.160465 1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="multinode-20220630191425-10770-m02" does not exist
I0630 19:39:32.160765 1 event.go:294] "Event occurred" object="default/busybox-d46db594c-z95jx" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod default/busybox-d46db594c-z95jx"
I0630 19:39:32.173677 1 range_allocator.go:374] Set node multinode-20220630191425-10770-m02 PodCIDR to [10.244.1.0/24]
W0630 19:39:52.788746 1 topologycache.go:199] Can't get CPU or zone information for multinode-20220630191425-10770-m02 node
I0630 19:39:53.635101 1 event.go:294] "Event occurred" object="default/busybox-d46db594c-z95jx" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod default/busybox-d46db594c-z95jx"
*
* ==> kube-controller-manager [ea647b675c37] <==
* I0630 19:20:16.808169 1 event.go:294] "Event occurred" object="default/busybox-d46db594c-6knvj" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod default/busybox-d46db594c-6knvj"
I0630 19:20:16.808219 1 event.go:294] "Event occurred" object="kube-system/coredns-6d4b75cb6d-pk4q6" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod kube-system/coredns-6d4b75cb6d-pk4q6"
I0630 19:20:16.808239 1 event.go:294] "Event occurred" object="kube-system/storage-provisioner" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod kube-system/storage-provisioner"
W0630 19:20:46.826708 1 topologycache.go:199] Can't get CPU or zone information for multinode-20220630191425-10770-m02 node
I0630 19:20:46.828428 1 event.go:294] "Event occurred" object="multinode-20220630191425-10770-m03" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="NodeNotReady" message="Node multinode-20220630191425-10770-m03 status is now: NodeNotReady"
I0630 19:20:46.842844 1 event.go:294] "Event occurred" object="kube-system/kindnet-vfl6g" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0630 19:20:46.853176 1 event.go:294] "Event occurred" object="kube-system/kube-proxy-rh8lz" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0630 19:20:46.860723 1 event.go:294] "Event occurred" object="multinode-20220630191425-10770-m02" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="NodeNotReady" message="Node multinode-20220630191425-10770-m02 status is now: NodeNotReady"
I0630 19:20:46.870263 1 event.go:294] "Event occurred" object="kube-system/kube-proxy-9mkb6" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0630 19:20:46.894488 1 event.go:294] "Event occurred" object="kube-system/kindnet-tk9kp" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0630 19:20:46.903539 1 event.go:294] "Event occurred" object="default/busybox-d46db594c-z95jx" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0630 19:24:50.012440 1 event.go:294] "Event occurred" object="default/busybox-d46db594c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: busybox-d46db594c-w77cb"
W0630 19:24:52.908252 1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="multinode-20220630191425-10770-m02" does not exist
I0630 19:24:52.909863 1 event.go:294] "Event occurred" object="default/busybox-d46db594c-z95jx" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod default/busybox-d46db594c-z95jx"
I0630 19:24:52.923185 1 range_allocator.go:374] Set node multinode-20220630191425-10770-m02 PodCIDR to [10.244.1.0/24]
W0630 19:25:03.247442 1 topologycache.go:199] Can't get CPU or zone information for multinode-20220630191425-10770-m02 node
I0630 19:25:06.962579 1 event.go:294] "Event occurred" object="default/busybox-d46db594c-z95jx" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod default/busybox-d46db594c-z95jx"
W0630 19:29:27.484547 1 topologycache.go:199] Can't get CPU or zone information for multinode-20220630191425-10770-m02 node
W0630 19:29:28.397630 1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="multinode-20220630191425-10770-m03" does not exist
W0630 19:29:28.399222 1 topologycache.go:199] Can't get CPU or zone information for multinode-20220630191425-10770-m02 node
I0630 19:29:28.424172 1 range_allocator.go:374] Set node multinode-20220630191425-10770-m03 PodCIDR to [10.244.2.0/24]
W0630 19:29:48.592274 1 topologycache.go:199] Can't get CPU or zone information for multinode-20220630191425-10770-m02 node
I0630 19:29:52.024490 1 event.go:294] "Event occurred" object="default/busybox-d46db594c-w77cb" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod default/busybox-d46db594c-w77cb"
I0630 19:33:51.141758 1 event.go:294] "Event occurred" object="default/busybox-d46db594c" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: busybox-d46db594c-r4mhw"
W0630 19:33:54.152876 1 topologycache.go:199] Can't get CPU or zone information for multinode-20220630191425-10770-m02 node
*
* ==> kube-proxy [008d149ef3d1] <==
* I0630 19:19:56.751346 1 node.go:163] Successfully retrieved node IP: 192.168.39.6
I0630 19:19:56.751399 1 server_others.go:138] "Detected node IP" address="192.168.39.6"
I0630 19:19:56.751511 1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""
I0630 19:19:56.851299 1 server_others.go:199] "kube-proxy running in single-stack mode, this ipFamily is not supported" ipFamily=IPv6
I0630 19:19:56.851316 1 server_others.go:206] "Using iptables Proxier"
I0630 19:19:56.851969 1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
I0630 19:19:56.853136 1 server.go:661] "Version info" version="v1.24.2"
I0630 19:19:56.853149 1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0630 19:19:56.854806 1 config.go:317] "Starting service config controller"
I0630 19:19:56.856342 1 shared_informer.go:255] Waiting for caches to sync for service config
I0630 19:19:56.856375 1 config.go:226] "Starting endpoint slice config controller"
I0630 19:19:56.856381 1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
I0630 19:19:56.860750 1 config.go:444] "Starting node config controller"
I0630 19:19:56.860761 1 shared_informer.go:255] Waiting for caches to sync for node config
I0630 19:19:56.956579 1 shared_informer.go:262] Caches are synced for endpoint slice config
I0630 19:19:56.956592 1 shared_informer.go:262] Caches are synced for service config
I0630 19:19:56.961100 1 shared_informer.go:262] Caches are synced for node config
*
* ==> kube-proxy [ce786f8c69d0] <==
* I0630 19:34:38.753785 1 node.go:163] Successfully retrieved node IP: 192.168.39.6
I0630 19:34:38.755780 1 server_others.go:138] "Detected node IP" address="192.168.39.6"
I0630 19:34:38.755843 1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""
I0630 19:34:38.869714 1 server_others.go:199] "kube-proxy running in single-stack mode, this ipFamily is not supported" ipFamily=IPv6
I0630 19:34:38.870089 1 server_others.go:206] "Using iptables Proxier"
I0630 19:34:38.871143 1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
I0630 19:34:38.883277 1 server.go:661] "Version info" version="v1.24.2"
I0630 19:34:38.883320 1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0630 19:34:38.899792 1 config.go:317] "Starting service config controller"
I0630 19:34:38.911390 1 shared_informer.go:255] Waiting for caches to sync for service config
I0630 19:34:38.908810 1 config.go:444] "Starting node config controller"
I0630 19:34:38.911446 1 shared_informer.go:255] Waiting for caches to sync for node config
I0630 19:34:38.911540 1 config.go:226] "Starting endpoint slice config controller"
I0630 19:34:38.911547 1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
I0630 19:34:39.012667 1 shared_informer.go:262] Caches are synced for endpoint slice config
I0630 19:34:39.012707 1 shared_informer.go:262] Caches are synced for service config
I0630 19:34:39.013339 1 shared_informer.go:262] Caches are synced for node config
*
* ==> kube-scheduler [579f74669b69] <==
* I0630 19:34:32.497717 1 serving.go:348] Generated self-signed cert in-memory
W0630 19:34:35.801116 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0630 19:34:35.801263 1 authentication.go:346] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0630 19:34:35.801277 1 authentication.go:347] Continuing without authentication configuration. This may treat all requests as anonymous.
W0630 19:34:35.801286 1 authentication.go:348] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0630 19:34:35.881094 1 server.go:147] "Starting Kubernetes Scheduler" version="v1.24.2"
I0630 19:34:35.881137 1 server.go:149] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0630 19:34:35.890727 1 secure_serving.go:210] Serving securely on 127.0.0.1:10259
I0630 19:34:35.890921 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0630 19:34:35.890941 1 shared_informer.go:255] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0630 19:34:35.890956 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0630 19:34:35.992176 1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
E0630 19:39:52.829913 1 event_broadcaster.go:253] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"busybox-d46db594c-r4mhw.16fd7d1143cb9f4d", GenerateName:"", Namespace:"default", SelfLink:"", UID:"c63fc9bf-dabf-425e-9691-23f9e4a14d53", ResourceVersion:"1939", Generation:0, CreationTimestamp:time.Date(2022, time.June, 30, 19, 35, 51, 0, time.Local), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ZZZ_DeprecatedClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kube-scheduler", Operation:"Update", APIVersion:"events.k8s.io/v1", Time:time.Date(2022, time.June, 30, 19, 35, 51, 0, time.Local), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc000aae588), Subresource:""}}}, EventTime:time.Date(2022, time.June, 30, 19, 35, 51, 47538876, time.Local), Series
:(*v1.EventSeries)(0xc00074e4e0), ReportingController:"default-scheduler", ReportingInstance:"default-scheduler-multinode-20220630191425-10770", Action:"Scheduling", Reason:"FailedScheduling", Regarding:v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"busybox-d46db594c-r4mhw", UID:"0db33313-37a2-47f9-aeed-2a51cfebedf8", APIVersion:"v1", ResourceVersion:"1935", FieldPath:""}, Related:(*v1.ObjectReference)(nil), Note:"0/2 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/unreachable: }, 2 node(s) didn't match pod anti-affinity rules. preemption: 0/2 nodes are available: 1 No preemption victims found for incoming pod, 1 Preemption is not helpful for scheduling.", Type:"Warning", DeprecatedSource:v1.EventSource{Component:"", Host:""}, DeprecatedFirstTimestamp:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), DeprecatedLastTimestamp:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), DeprecatedCount:0}': 'Event "busybox-d46db594c-r4mhw.16fd7d1143cb9f4d" is invalid: [series.count
: Invalid value: "": should be at least 2, eventTime: Invalid value: 2022-06-30 19:35:51.047538 +0000 UTC: field is immutable]' (will not retry!)
*
* ==> kube-scheduler [87b96d92debf] <==
* I0630 19:19:50.324458 1 serving.go:348] Generated self-signed cert in-memory
W0630 19:19:53.827822 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0630 19:19:53.828141 1 authentication.go:346] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0630 19:19:53.828337 1 authentication.go:347] Continuing without authentication configuration. This may treat all requests as anonymous.
W0630 19:19:53.828459 1 authentication.go:348] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0630 19:19:53.860998 1 server.go:147] "Starting Kubernetes Scheduler" version="v1.24.2"
I0630 19:19:53.861187 1 server.go:149] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0630 19:19:53.873997 1 secure_serving.go:210] Serving securely on 127.0.0.1:10259
I0630 19:19:53.874176 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0630 19:19:53.874213 1 shared_informer.go:255] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0630 19:19:53.874232 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0630 19:19:53.974694 1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
*
* ==> kubelet <==
* -- Journal begins at Thu 2022-06-30 19:34:11 UTC, ends at Thu 2022-06-30 19:44:28 UTC. --
Jun 30 19:43:50 multinode-20220630191425-10770 kubelet[1267]: E0630 19:43:50.797962 1267 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"3e848ad9-7923-4c96-a1c0-746d208b645c\" with KillPodSandboxError: \"rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \\\"busybox-d46db594c-6knvj_default\\\" network: could not retrieve port mappings: key is not found\"" pod="default/busybox-d46db594c-6knvj" podUID=3e848ad9-7923-4c96-a1c0-746d208b645c
Jun 30 19:43:52 multinode-20220630191425-10770 kubelet[1267]: E0630 19:43:52.796639 1267 remote_runtime.go:248] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \"coredns-6d4b75cb6d-pk4q6_kube-system\" network: could not retrieve port mappings: key is not found" podSandboxID="bab855fc181af5ca6aff167164b27586eebfa29b2a943d490f9ed4e5da098a8b"
Jun 30 19:43:52 multinode-20220630191425-10770 kubelet[1267]: E0630 19:43:52.799087 1267 kuberuntime_manager.go:999] "Failed to stop sandbox" podSandboxID={Type:docker ID:bab855fc181af5ca6aff167164b27586eebfa29b2a943d490f9ed4e5da098a8b}
Jun 30 19:43:52 multinode-20220630191425-10770 kubelet[1267]: E0630 19:43:52.800158 1267 kuberuntime_manager.go:738] "killPodWithSyncResult failed" err="failed to \"KillPodSandbox\" for \"cce88093-b4eb-4dd8-bbde-32352ab7955c\" with KillPodSandboxError: \"rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \\\"coredns-6d4b75cb6d-pk4q6_kube-system\\\" network: could not retrieve port mappings: key is not found\""
Jun 30 19:43:52 multinode-20220630191425-10770 kubelet[1267]: E0630 19:43:52.800219 1267 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"cce88093-b4eb-4dd8-bbde-32352ab7955c\" with KillPodSandboxError: \"rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \\\"coredns-6d4b75cb6d-pk4q6_kube-system\\\" network: could not retrieve port mappings: key is not found\"" pod="kube-system/coredns-6d4b75cb6d-pk4q6" podUID=cce88093-b4eb-4dd8-bbde-32352ab7955c
Jun 30 19:44:03 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:03.794809 1267 remote_runtime.go:248] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \"busybox-d46db594c-6knvj_default\" network: could not retrieve port mappings: key is not found" podSandboxID="cf4337142d5d838f98de7552ffc56328994c07ba607d70399f73a49777cb67a7"
Jun 30 19:44:03 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:03.795207 1267 kuberuntime_manager.go:999] "Failed to stop sandbox" podSandboxID={Type:docker ID:cf4337142d5d838f98de7552ffc56328994c07ba607d70399f73a49777cb67a7}
Jun 30 19:44:03 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:03.795275 1267 kuberuntime_manager.go:738] "killPodWithSyncResult failed" err="failed to \"KillPodSandbox\" for \"3e848ad9-7923-4c96-a1c0-746d208b645c\" with KillPodSandboxError: \"rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \\\"busybox-d46db594c-6knvj_default\\\" network: could not retrieve port mappings: key is not found\""
Jun 30 19:44:03 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:03.795340 1267 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"3e848ad9-7923-4c96-a1c0-746d208b645c\" with KillPodSandboxError: \"rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \\\"busybox-d46db594c-6knvj_default\\\" network: could not retrieve port mappings: key is not found\"" pod="default/busybox-d46db594c-6knvj" podUID=3e848ad9-7923-4c96-a1c0-746d208b645c
Jun 30 19:44:07 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:07.793823 1267 remote_runtime.go:248] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \"coredns-6d4b75cb6d-pk4q6_kube-system\" network: could not retrieve port mappings: key is not found" podSandboxID="bab855fc181af5ca6aff167164b27586eebfa29b2a943d490f9ed4e5da098a8b"
Jun 30 19:44:07 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:07.793863 1267 kuberuntime_manager.go:999] "Failed to stop sandbox" podSandboxID={Type:docker ID:bab855fc181af5ca6aff167164b27586eebfa29b2a943d490f9ed4e5da098a8b}
Jun 30 19:44:07 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:07.793890 1267 kuberuntime_manager.go:738] "killPodWithSyncResult failed" err="failed to \"KillPodSandbox\" for \"cce88093-b4eb-4dd8-bbde-32352ab7955c\" with KillPodSandboxError: \"rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \\\"coredns-6d4b75cb6d-pk4q6_kube-system\\\" network: could not retrieve port mappings: key is not found\""
Jun 30 19:44:07 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:07.793911 1267 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"cce88093-b4eb-4dd8-bbde-32352ab7955c\" with KillPodSandboxError: \"rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \\\"coredns-6d4b75cb6d-pk4q6_kube-system\\\" network: could not retrieve port mappings: key is not found\"" pod="kube-system/coredns-6d4b75cb6d-pk4q6" podUID=cce88093-b4eb-4dd8-bbde-32352ab7955c
Jun 30 19:44:15 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:15.795538 1267 remote_runtime.go:248] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \"busybox-d46db594c-6knvj_default\" network: could not retrieve port mappings: key is not found" podSandboxID="cf4337142d5d838f98de7552ffc56328994c07ba607d70399f73a49777cb67a7"
Jun 30 19:44:15 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:15.795587 1267 kuberuntime_manager.go:999] "Failed to stop sandbox" podSandboxID={Type:docker ID:cf4337142d5d838f98de7552ffc56328994c07ba607d70399f73a49777cb67a7}
Jun 30 19:44:15 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:15.795625 1267 kuberuntime_manager.go:738] "killPodWithSyncResult failed" err="failed to \"KillPodSandbox\" for \"3e848ad9-7923-4c96-a1c0-746d208b645c\" with KillPodSandboxError: \"rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \\\"busybox-d46db594c-6knvj_default\\\" network: could not retrieve port mappings: key is not found\""
Jun 30 19:44:15 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:15.795661 1267 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"3e848ad9-7923-4c96-a1c0-746d208b645c\" with KillPodSandboxError: \"rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \\\"busybox-d46db594c-6knvj_default\\\" network: could not retrieve port mappings: key is not found\"" pod="default/busybox-d46db594c-6knvj" podUID=3e848ad9-7923-4c96-a1c0-746d208b645c
Jun 30 19:44:22 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:22.795707 1267 remote_runtime.go:248] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \"coredns-6d4b75cb6d-pk4q6_kube-system\" network: could not retrieve port mappings: key is not found" podSandboxID="bab855fc181af5ca6aff167164b27586eebfa29b2a943d490f9ed4e5da098a8b"
Jun 30 19:44:22 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:22.796446 1267 kuberuntime_manager.go:999] "Failed to stop sandbox" podSandboxID={Type:docker ID:bab855fc181af5ca6aff167164b27586eebfa29b2a943d490f9ed4e5da098a8b}
Jun 30 19:44:22 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:22.796651 1267 kuberuntime_manager.go:738] "killPodWithSyncResult failed" err="failed to \"KillPodSandbox\" for \"cce88093-b4eb-4dd8-bbde-32352ab7955c\" with KillPodSandboxError: \"rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \\\"coredns-6d4b75cb6d-pk4q6_kube-system\\\" network: could not retrieve port mappings: key is not found\""
Jun 30 19:44:22 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:22.796741 1267 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"cce88093-b4eb-4dd8-bbde-32352ab7955c\" with KillPodSandboxError: \"rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \\\"coredns-6d4b75cb6d-pk4q6_kube-system\\\" network: could not retrieve port mappings: key is not found\"" pod="kube-system/coredns-6d4b75cb6d-pk4q6" podUID=cce88093-b4eb-4dd8-bbde-32352ab7955c
Jun 30 19:44:28 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:28.795838 1267 remote_runtime.go:248] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \"busybox-d46db594c-6knvj_default\" network: could not retrieve port mappings: key is not found" podSandboxID="cf4337142d5d838f98de7552ffc56328994c07ba607d70399f73a49777cb67a7"
Jun 30 19:44:28 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:28.795910 1267 kuberuntime_manager.go:999] "Failed to stop sandbox" podSandboxID={Type:docker ID:cf4337142d5d838f98de7552ffc56328994c07ba607d70399f73a49777cb67a7}
Jun 30 19:44:28 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:28.795958 1267 kuberuntime_manager.go:738] "killPodWithSyncResult failed" err="failed to \"KillPodSandbox\" for \"3e848ad9-7923-4c96-a1c0-746d208b645c\" with KillPodSandboxError: \"rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \\\"busybox-d46db594c-6knvj_default\\\" network: could not retrieve port mappings: key is not found\""
Jun 30 19:44:28 multinode-20220630191425-10770 kubelet[1267]: E0630 19:44:28.796059 1267 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"3e848ad9-7923-4c96-a1c0-746d208b645c\" with KillPodSandboxError: \"rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod \\\"busybox-d46db594c-6knvj_default\\\" network: could not retrieve port mappings: key is not found\"" pod="default/busybox-d46db594c-6knvj" podUID=3e848ad9-7923-4c96-a1c0-746d208b645c
*
* ==> storage-provisioner [1860d77d60e9] <==
* I0630 19:34:38.631395 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0630 19:35:08.639589 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
*
* ==> storage-provisioner [90758f2fb7ba] <==
* I0630 19:35:21.965076 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0630 19:35:21.983851 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0630 19:35:21.984127 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0630 19:35:39.428174 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0630 19:35:39.429235 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"d1d4e4ba-ece1-450f-b687-446678194dce", APIVersion:"v1", ResourceVersion:"1922", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' multinode-20220630191425-10770_d5282e83-648b-46e9-a5d7-24fb5408a61d became leader
I0630 19:35:39.429390 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_multinode-20220630191425-10770_d5282e83-648b-46e9-a5d7-24fb5408a61d!
I0630 19:35:39.530779 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_multinode-20220630191425-10770_d5282e83-648b-46e9-a5d7-24fb5408a61d!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p multinode-20220630191425-10770 -n multinode-20220630191425-10770
helpers_test.go:261: (dbg) Run: kubectl --context multinode-20220630191425-10770 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:270: non-running pods: busybox-d46db594c-r4mhw
helpers_test.go:272: ======> post-mortem[TestMultiNode/serial/ValidateNameConflict]: describe non-running pods <======
helpers_test.go:275: (dbg) Run: kubectl --context multinode-20220630191425-10770 describe pod busybox-d46db594c-r4mhw
helpers_test.go:280: (dbg) kubectl --context multinode-20220630191425-10770 describe pod busybox-d46db594c-r4mhw:
-- stdout --
Name: busybox-d46db594c-r4mhw
Namespace: default
Priority: 0
Node: <none>
Labels: app=busybox
pod-template-hash=d46db594c
Annotations: <none>
Status: Pending
IP:
IPs: <none>
Controlled By: ReplicaSet/busybox-d46db594c
Containers:
busybox:
Image: gcr.io/k8s-minikube/busybox:1.28
Port: <none>
Host Port: <none>
Command:
sleep
3600
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-gmdtc (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-gmdtc:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 10m default-scheduler 0/3 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/unschedulable: }, 1 node(s) were unschedulable, 3 node(s) didn't match pod anti-affinity rules. preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.
Warning FailedScheduling 10m default-scheduler 0/3 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/unschedulable: }, 1 node(s) were unschedulable, 2 node(s) didn't match pod anti-affinity rules. preemption: 0/3 nodes are available: 1 Preemption is not helpful for scheduling, 2 No preemption victims found for incoming pod.
Warning FailedScheduling 9m53s default-scheduler 0/2 nodes are available: 2 node(s) didn't match pod anti-affinity rules. preemption: 0/2 nodes are available: 2 No preemption victims found for incoming pod.
Warning FailedScheduling 8m40s default-scheduler 0/2 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/unreachable: }, 2 node(s) didn't match pod anti-affinity rules. preemption: 0/2 nodes are available: 1 No preemption victims found for incoming pod, 1 Preemption is not helpful for scheduling.
Warning FailedScheduling 8m38s default-scheduler 0/2 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/unreachable: }, 2 node(s) didn't match pod anti-affinity rules. preemption: 0/2 nodes are available: 1 No preemption victims found for incoming pod, 1 Preemption is not helpful for scheduling.
-- /stdout --
helpers_test.go:283: <<< TestMultiNode/serial/ValidateNameConflict FAILED: end of post-mortem logs <<<
helpers_test.go:284: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiNode/serial/ValidateNameConflict (34.41s)