=== RUN TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run: out/minikube-darwin-amd64 profile list --output json
ha_test.go:309: expected profile "ha-213000" in json of 'profile list' to have "HAppy" status but have "Degraded" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-213000\",\"Status\":\"Degraded\",\"Config\":{\"Name\":\"ha-213000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19883/minikube-v1.34.0-1730282777-19883-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount
\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.2\",\"ClusterName\":\"ha-213000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.169.0.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.169.0.5\",\"Port\":8443,\"Kub
ernetesVersion\":\"v1.31.2\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.169.0.6\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.2\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.169.0.7\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.2\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.169.0.8\",\"Port\":0,\"KubernetesVersion\":\"v1.31.2\",\"ContainerRuntime\":\"\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"amd-gpu-device-plugin\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kubevir
t\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"Moun
tIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":true}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-213000 -n ha-213000
helpers_test.go:244: <<< TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-darwin-amd64 -p ha-213000 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-darwin-amd64 -p ha-213000 logs -n 25: (2.314538141s)
helpers_test.go:252: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart logs:
-- stdout --
==> Audit <==
|---------|------------------------------------------------------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|------------------------------------------------------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
| ssh | ha-213000 ssh -n | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | ha-213000 cp ha-213000-m03:/home/docker/cp-test.txt | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000:/home/docker/cp-test_ha-213000-m03_ha-213000.txt | | | | | |
| ssh | ha-213000 ssh -n | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-213000 ssh -n ha-213000 sudo cat | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | /home/docker/cp-test_ha-213000-m03_ha-213000.txt | | | | | |
| cp | ha-213000 cp ha-213000-m03:/home/docker/cp-test.txt | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000-m02:/home/docker/cp-test_ha-213000-m03_ha-213000-m02.txt | | | | | |
| ssh | ha-213000 ssh -n | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-213000 ssh -n ha-213000-m02 sudo cat | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | /home/docker/cp-test_ha-213000-m03_ha-213000-m02.txt | | | | | |
| cp | ha-213000 cp ha-213000-m03:/home/docker/cp-test.txt | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000-m04:/home/docker/cp-test_ha-213000-m03_ha-213000-m04.txt | | | | | |
| ssh | ha-213000 ssh -n | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-213000 ssh -n ha-213000-m04 sudo cat | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | /home/docker/cp-test_ha-213000-m03_ha-213000-m04.txt | | | | | |
| cp | ha-213000 cp testdata/cp-test.txt | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000-m04:/home/docker/cp-test.txt | | | | | |
| ssh | ha-213000 ssh -n | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | ha-213000 cp ha-213000-m04:/home/docker/cp-test.txt | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestMultiControlPlaneserialCopyFile1308940127/001/cp-test_ha-213000-m04.txt | | | | | |
| ssh | ha-213000 ssh -n | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | ha-213000 cp ha-213000-m04:/home/docker/cp-test.txt | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000:/home/docker/cp-test_ha-213000-m04_ha-213000.txt | | | | | |
| ssh | ha-213000 ssh -n | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-213000 ssh -n ha-213000 sudo cat | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | /home/docker/cp-test_ha-213000-m04_ha-213000.txt | | | | | |
| cp | ha-213000 cp ha-213000-m04:/home/docker/cp-test.txt | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000-m02:/home/docker/cp-test_ha-213000-m04_ha-213000-m02.txt | | | | | |
| ssh | ha-213000 ssh -n | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-213000 ssh -n ha-213000-m02 sudo cat | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | /home/docker/cp-test_ha-213000-m04_ha-213000-m02.txt | | | | | |
| cp | ha-213000 cp ha-213000-m04:/home/docker/cp-test.txt | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000-m03:/home/docker/cp-test_ha-213000-m04_ha-213000-m03.txt | | | | | |
| ssh | ha-213000 ssh -n | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | ha-213000-m04 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | ha-213000 ssh -n ha-213000-m03 sudo cat | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | /home/docker/cp-test_ha-213000-m04_ha-213000-m03.txt | | | | | |
| node | ha-213000 node stop m02 -v=7 | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | 05 Nov 24 10:05 PST |
| | --alsologtostderr | | | | | |
| node | ha-213000 node start m02 -v=7 | ha-213000 | jenkins | v1.34.0 | 05 Nov 24 10:05 PST | |
| | --alsologtostderr | | | | | |
|---------|------------------------------------------------------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/11/05 10:00:48
Running on machine: MacOS-Agent-4
Binary: Built with gc go1.23.2 for darwin/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1105 10:00:48.477016 19703 out.go:345] Setting OutFile to fd 1 ...
I1105 10:00:48.477674 19703 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1105 10:00:48.477680 19703 out.go:358] Setting ErrFile to fd 2...
I1105 10:00:48.477684 19703 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1105 10:00:48.477879 19703 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/19910-17277/.minikube/bin
I1105 10:00:48.479709 19703 out.go:352] Setting JSON to false
I1105 10:00:48.510951 19703 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":7217,"bootTime":1730822431,"procs":529,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"15.0.1","kernelVersion":"24.0.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
W1105 10:00:48.511118 19703 start.go:137] gopshost.Virtualization returned error: not implemented yet
I1105 10:00:48.569600 19703 out.go:177] * [ha-213000] minikube v1.34.0 on Darwin 15.0.1
I1105 10:00:48.610699 19703 notify.go:220] Checking for updates...
I1105 10:00:48.634693 19703 out.go:177] - MINIKUBE_LOCATION=19910
I1105 10:00:48.698776 19703 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/19910-17277/kubeconfig
I1105 10:00:48.753700 19703 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I1105 10:00:48.775781 19703 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1105 10:00:48.796789 19703 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/19910-17277/.minikube
I1105 10:00:48.817657 19703 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1105 10:00:48.839040 19703 driver.go:394] Setting default libvirt URI to qemu:///system
I1105 10:00:48.871720 19703 out.go:177] * Using the hyperkit driver based on user configuration
I1105 10:00:48.913701 19703 start.go:297] selected driver: hyperkit
I1105 10:00:48.913733 19703 start.go:901] validating driver "hyperkit" against <nil>
I1105 10:00:48.913751 19703 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1105 10:00:48.920486 19703 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1105 10:00:48.920632 19703 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/19910-17277/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
I1105 10:00:48.931479 19703 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.34.0
I1105 10:00:48.937804 19703 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1105 10:00:48.937824 19703 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
I1105 10:00:48.937857 19703 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I1105 10:00:48.938103 19703 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1105 10:00:48.938134 19703 cni.go:84] Creating CNI manager for ""
I1105 10:00:48.938170 19703 cni.go:136] multinode detected (0 nodes found), recommending kindnet
I1105 10:00:48.938175 19703 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I1105 10:00:48.938248 19703 start.go:340] cluster config:
{Name:ha-213000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:ha-213000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docke
r CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0
GPUs: AutoPauseInterval:1m0s}
I1105 10:00:48.938346 19703 iso.go:125] acquiring lock: {Name:mka3d5e234f2ff3441663646bb1b78ffeeb4e52b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1105 10:00:48.959836 19703 out.go:177] * Starting "ha-213000" primary control-plane node in "ha-213000" cluster
I1105 10:00:49.001660 19703 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
I1105 10:00:49.001712 19703 preload.go:146] Found local preload: /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-amd64.tar.lz4
I1105 10:00:49.001743 19703 cache.go:56] Caching tarball of preloaded images
I1105 10:00:49.001910 19703 preload.go:172] Found /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I1105 10:00:49.001924 19703 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
I1105 10:00:49.002321 19703 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/config.json ...
I1105 10:00:49.002355 19703 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/config.json: {Name:mk69fb3d9aca0b41d8bea722484079aba6357863 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:00:49.002868 19703 start.go:360] acquireMachinesLock for ha-213000: {Name:mk67e3fe9c26d68e6bc4121ccfd9f37c1a8d85cb Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1105 10:00:49.002969 19703 start.go:364] duration metric: took 85.161µs to acquireMachinesLock for "ha-213000"
I1105 10:00:49.003007 19703 start.go:93] Provisioning new machine with config: &{Name:ha-213000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19883/minikube-v1.34.0-1730282777-19883-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.31.2 ClusterName:ha-213000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
I1105 10:00:49.003069 19703 start.go:125] createHost starting for "" (driver="hyperkit")
I1105 10:00:49.024722 19703 out.go:235] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I1105 10:00:49.024964 19703 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1105 10:00:49.025013 19703 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1105 10:00:49.037332 19703 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:57614
I1105 10:00:49.037758 19703 main.go:141] libmachine: () Calling .GetVersion
I1105 10:00:49.038202 19703 main.go:141] libmachine: Using API Version 1
I1105 10:00:49.038215 19703 main.go:141] libmachine: () Calling .SetConfigRaw
I1105 10:00:49.038496 19703 main.go:141] libmachine: () Calling .GetMachineName
I1105 10:00:49.038622 19703 main.go:141] libmachine: (ha-213000) Calling .GetMachineName
I1105 10:00:49.038725 19703 main.go:141] libmachine: (ha-213000) Calling .DriverName
I1105 10:00:49.038849 19703 start.go:159] libmachine.API.Create for "ha-213000" (driver="hyperkit")
I1105 10:00:49.038876 19703 client.go:168] LocalClient.Create starting
I1105 10:00:49.038916 19703 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem
I1105 10:00:49.038980 19703 main.go:141] libmachine: Decoding PEM data...
I1105 10:00:49.038997 19703 main.go:141] libmachine: Parsing certificate...
I1105 10:00:49.039061 19703 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/cert.pem
I1105 10:00:49.039108 19703 main.go:141] libmachine: Decoding PEM data...
I1105 10:00:49.039119 19703 main.go:141] libmachine: Parsing certificate...
I1105 10:00:49.039131 19703 main.go:141] libmachine: Running pre-create checks...
I1105 10:00:49.039140 19703 main.go:141] libmachine: (ha-213000) Calling .PreCreateCheck
I1105 10:00:49.039304 19703 main.go:141] libmachine: (ha-213000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:00:49.039463 19703 main.go:141] libmachine: (ha-213000) Calling .GetConfigRaw
I1105 10:00:49.045805 19703 main.go:141] libmachine: Creating machine...
I1105 10:00:49.045812 19703 main.go:141] libmachine: (ha-213000) Calling .Create
I1105 10:00:49.045899 19703 main.go:141] libmachine: (ha-213000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:00:49.046076 19703 main.go:141] libmachine: (ha-213000) DBG | I1105 10:00:49.045898 19713 common.go:144] Making disk image using store path: /Users/jenkins/minikube-integration/19910-17277/.minikube
I1105 10:00:49.046146 19703 main.go:141] libmachine: (ha-213000) Downloading /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19910-17277/.minikube/cache/iso/amd64/minikube-v1.34.0-1730282777-19883-amd64.iso...
I1105 10:00:49.239282 19703 main.go:141] libmachine: (ha-213000) DBG | I1105 10:00:49.239158 19713 common.go:151] Creating ssh key: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/id_rsa...
I1105 10:00:49.422633 19703 main.go:141] libmachine: (ha-213000) DBG | I1105 10:00:49.422543 19713 common.go:157] Creating raw disk image: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/ha-213000.rawdisk...
I1105 10:00:49.422652 19703 main.go:141] libmachine: (ha-213000) DBG | Writing magic tar header
I1105 10:00:49.422661 19703 main.go:141] libmachine: (ha-213000) DBG | Writing SSH key tar header
I1105 10:00:49.422947 19703 main.go:141] libmachine: (ha-213000) DBG | I1105 10:00:49.422905 19713 common.go:171] Fixing permissions on /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000 ...
I1105 10:00:49.801010 19703 main.go:141] libmachine: (ha-213000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:00:49.801025 19703 main.go:141] libmachine: (ha-213000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/hyperkit.pid
I1105 10:00:49.801067 19703 main.go:141] libmachine: (ha-213000) DBG | Using UUID 1736dd54-77fc-4deb-8a00-7267ff6ac6e0
I1105 10:00:49.968558 19703 main.go:141] libmachine: (ha-213000) DBG | Generated MAC 82:fc:3d:82:28:7c
I1105 10:00:49.968605 19703 main.go:141] libmachine: (ha-213000) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=ha-213000
I1105 10:00:49.968643 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:49 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"1736dd54-77fc-4deb-8a00-7267ff6ac6e0", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc000112720)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/bzimage", Initrd:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Process)(nil)}
I1105 10:00:49.968680 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:49 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"1736dd54-77fc-4deb-8a00-7267ff6ac6e0", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc000112720)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/bzimage", Initrd:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Process)(nil)}
I1105 10:00:49.968759 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:49 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "1736dd54-77fc-4deb-8a00-7267ff6ac6e0", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/ha-213000.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/tty,log=/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/bzimage,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/initrd,earlyp
rintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=ha-213000"}
I1105 10:00:49.968801 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:49 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U 1736dd54-77fc-4deb-8a00-7267ff6ac6e0 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/ha-213000.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/tty,log=/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/console-ring -f kexec,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/bzimage,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nom
odeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=ha-213000"
I1105 10:00:49.968818 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:49 DEBUG: hyperkit: Redirecting stdout/stderr to logger
I1105 10:00:49.972369 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:49 DEBUG: hyperkit: Pid is 19716
I1105 10:00:49.973014 19703 main.go:141] libmachine: (ha-213000) DBG | Attempt 0
I1105 10:00:49.973034 19703 main.go:141] libmachine: (ha-213000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:00:49.973101 19703 main.go:141] libmachine: (ha-213000) DBG | hyperkit pid from json: 19716
I1105 10:00:49.974438 19703 main.go:141] libmachine: (ha-213000) DBG | Searching for 82:fc:3d:82:28:7c in /var/db/dhcpd_leases ...
I1105 10:00:49.974449 19703 main.go:141] libmachine: (ha-213000) DBG | Found 3 entries in /var/db/dhcpd_leases!
I1105 10:00:49.974461 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:0a:f2:13:1f:4d:a9 ID:1,a:f2:13:1f:4d:a9 Lease:0x672a6979}
I1105 10:00:49.974478 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:42:36:6d:50:88:43 ID:1,42:36:6d:50:88:43 Lease:0x672a68b2}
I1105 10:00:49.974495 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.2 HWAddress:8a:ae:5d:dc:69:d7 ID:1,8a:ae:5d:dc:69:d7 Lease:0x672a66c1}
I1105 10:00:49.985017 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:49 INFO : hyperkit: stderr: Using fd 6 for I/O notifications
I1105 10:00:50.043482 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:50 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD
I1105 10:00:50.044217 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I1105 10:00:50.044239 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I1105 10:00:50.044246 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I1105 10:00:50.044251 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I1105 10:00:50.437454 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:50 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0
I1105 10:00:50.437468 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:50 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0
I1105 10:00:50.552096 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I1105 10:00:50.552115 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I1105 10:00:50.552133 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I1105 10:00:50.552146 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:50 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I1105 10:00:50.553015 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:50 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1
I1105 10:00:50.553028 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:50 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1
I1105 10:00:51.975030 19703 main.go:141] libmachine: (ha-213000) DBG | Attempt 1
I1105 10:00:51.975047 19703 main.go:141] libmachine: (ha-213000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:00:51.975058 19703 main.go:141] libmachine: (ha-213000) DBG | hyperkit pid from json: 19716
I1105 10:00:51.976103 19703 main.go:141] libmachine: (ha-213000) DBG | Searching for 82:fc:3d:82:28:7c in /var/db/dhcpd_leases ...
I1105 10:00:51.976148 19703 main.go:141] libmachine: (ha-213000) DBG | Found 3 entries in /var/db/dhcpd_leases!
I1105 10:00:51.976166 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:0a:f2:13:1f:4d:a9 ID:1,a:f2:13:1f:4d:a9 Lease:0x672a6979}
I1105 10:00:51.976186 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:42:36:6d:50:88:43 ID:1,42:36:6d:50:88:43 Lease:0x672a68b2}
I1105 10:00:51.976200 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.2 HWAddress:8a:ae:5d:dc:69:d7 ID:1,8a:ae:5d:dc:69:d7 Lease:0x672a66c1}
I1105 10:00:53.977051 19703 main.go:141] libmachine: (ha-213000) DBG | Attempt 2
I1105 10:00:53.977066 19703 main.go:141] libmachine: (ha-213000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:00:53.977114 19703 main.go:141] libmachine: (ha-213000) DBG | hyperkit pid from json: 19716
I1105 10:00:53.978147 19703 main.go:141] libmachine: (ha-213000) DBG | Searching for 82:fc:3d:82:28:7c in /var/db/dhcpd_leases ...
I1105 10:00:53.978190 19703 main.go:141] libmachine: (ha-213000) DBG | Found 3 entries in /var/db/dhcpd_leases!
I1105 10:00:53.978202 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:0a:f2:13:1f:4d:a9 ID:1,a:f2:13:1f:4d:a9 Lease:0x672a6979}
I1105 10:00:53.978220 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:42:36:6d:50:88:43 ID:1,42:36:6d:50:88:43 Lease:0x672a68b2}
I1105 10:00:53.978233 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.2 HWAddress:8a:ae:5d:dc:69:d7 ID:1,8a:ae:5d:dc:69:d7 Lease:0x672a66c1}
I1105 10:00:55.979026 19703 main.go:141] libmachine: (ha-213000) DBG | Attempt 3
I1105 10:00:55.979043 19703 main.go:141] libmachine: (ha-213000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:00:55.979100 19703 main.go:141] libmachine: (ha-213000) DBG | hyperkit pid from json: 19716
I1105 10:00:55.980034 19703 main.go:141] libmachine: (ha-213000) DBG | Searching for 82:fc:3d:82:28:7c in /var/db/dhcpd_leases ...
I1105 10:00:55.980091 19703 main.go:141] libmachine: (ha-213000) DBG | Found 3 entries in /var/db/dhcpd_leases!
I1105 10:00:55.980102 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:0a:f2:13:1f:4d:a9 ID:1,a:f2:13:1f:4d:a9 Lease:0x672a6979}
I1105 10:00:55.980125 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:42:36:6d:50:88:43 ID:1,42:36:6d:50:88:43 Lease:0x672a68b2}
I1105 10:00:55.980137 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.2 HWAddress:8a:ae:5d:dc:69:d7 ID:1,8a:ae:5d:dc:69:d7 Lease:0x672a66c1}
I1105 10:00:56.301268 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:56 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1
I1105 10:00:56.301301 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:56 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1
I1105 10:00:56.301310 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:56 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1
I1105 10:00:56.324886 19703 main.go:141] libmachine: (ha-213000) DBG | 2024/11/05 10:00:56 INFO : hyperkit: stderr: rdmsr to register 0xc0011029 on vcpu 1
I1105 10:00:57.980637 19703 main.go:141] libmachine: (ha-213000) DBG | Attempt 4
I1105 10:00:57.980652 19703 main.go:141] libmachine: (ha-213000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:00:57.980732 19703 main.go:141] libmachine: (ha-213000) DBG | hyperkit pid from json: 19716
I1105 10:00:57.981684 19703 main.go:141] libmachine: (ha-213000) DBG | Searching for 82:fc:3d:82:28:7c in /var/db/dhcpd_leases ...
I1105 10:00:57.981732 19703 main.go:141] libmachine: (ha-213000) DBG | Found 3 entries in /var/db/dhcpd_leases!
I1105 10:00:57.981742 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:0a:f2:13:1f:4d:a9 ID:1,a:f2:13:1f:4d:a9 Lease:0x672a6979}
I1105 10:00:57.981749 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:42:36:6d:50:88:43 ID:1,42:36:6d:50:88:43 Lease:0x672a68b2}
I1105 10:00:57.981757 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.2 HWAddress:8a:ae:5d:dc:69:d7 ID:1,8a:ae:5d:dc:69:d7 Lease:0x672a66c1}
I1105 10:00:59.983824 19703 main.go:141] libmachine: (ha-213000) DBG | Attempt 5
I1105 10:00:59.983847 19703 main.go:141] libmachine: (ha-213000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:00:59.984007 19703 main.go:141] libmachine: (ha-213000) DBG | hyperkit pid from json: 19716
I1105 10:00:59.985286 19703 main.go:141] libmachine: (ha-213000) DBG | Searching for 82:fc:3d:82:28:7c in /var/db/dhcpd_leases ...
I1105 10:00:59.985368 19703 main.go:141] libmachine: (ha-213000) DBG | Found 4 entries in /var/db/dhcpd_leases!
I1105 10:00:59.985384 19703 main.go:141] libmachine: (ha-213000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:82:fc:3d:82:28:7c ID:1,82:fc:3d:82:28:7c Lease:0x672a6b6b}
I1105 10:00:59.985396 19703 main.go:141] libmachine: (ha-213000) DBG | Found match: 82:fc:3d:82:28:7c
I1105 10:00:59.985402 19703 main.go:141] libmachine: (ha-213000) DBG | IP: 192.169.0.5
I1105 10:00:59.985465 19703 main.go:141] libmachine: (ha-213000) Calling .GetConfigRaw
I1105 10:00:59.986295 19703 main.go:141] libmachine: (ha-213000) Calling .DriverName
I1105 10:00:59.986452 19703 main.go:141] libmachine: (ha-213000) Calling .DriverName
I1105 10:00:59.986594 19703 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I1105 10:00:59.986606 19703 main.go:141] libmachine: (ha-213000) Calling .GetState
I1105 10:00:59.986719 19703 main.go:141] libmachine: (ha-213000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:00:59.986810 19703 main.go:141] libmachine: (ha-213000) DBG | hyperkit pid from json: 19716
I1105 10:00:59.988032 19703 main.go:141] libmachine: Detecting operating system of created instance...
I1105 10:00:59.988083 19703 main.go:141] libmachine: Waiting for SSH to be available...
I1105 10:00:59.988087 19703 main.go:141] libmachine: Getting to WaitForSSH function...
I1105 10:00:59.988112 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:00:59.988202 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:00:59.988332 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:00:59.988436 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:00:59.988528 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:00:59.988730 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:00:59.988975 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.5 22 <nil> <nil>}
I1105 10:00:59.988982 19703 main.go:141] libmachine: About to run SSH command:
exit 0
I1105 10:01:01.011155 19703 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
I1105 10:01:04.073024 19703 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1105 10:01:04.073037 19703 main.go:141] libmachine: Detecting the provisioner...
I1105 10:01:04.073043 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:04.073211 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:01:04.073307 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:04.073401 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:04.073493 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:01:04.073653 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:01:04.073811 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.5 22 <nil> <nil>}
I1105 10:01:04.073819 19703 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I1105 10:01:04.133464 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I1105 10:01:04.133513 19703 main.go:141] libmachine: found compatible host: buildroot
I1105 10:01:04.133519 19703 main.go:141] libmachine: Provisioning with buildroot...
I1105 10:01:04.133529 19703 main.go:141] libmachine: (ha-213000) Calling .GetMachineName
I1105 10:01:04.133678 19703 buildroot.go:166] provisioning hostname "ha-213000"
I1105 10:01:04.133689 19703 main.go:141] libmachine: (ha-213000) Calling .GetMachineName
I1105 10:01:04.133791 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:04.133872 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:01:04.133967 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:04.134069 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:04.134170 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:01:04.134305 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:01:04.134436 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.5 22 <nil> <nil>}
I1105 10:01:04.134444 19703 main.go:141] libmachine: About to run SSH command:
sudo hostname ha-213000 && echo "ha-213000" | sudo tee /etc/hostname
I1105 10:01:04.206864 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-213000
I1105 10:01:04.206883 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:04.207030 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:01:04.207140 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:04.207234 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:04.207324 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:01:04.207509 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:01:04.207699 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.5 22 <nil> <nil>}
I1105 10:01:04.207711 19703 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sha-213000' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-213000/g' /etc/hosts;
else
echo '127.0.1.1 ha-213000' | sudo tee -a /etc/hosts;
fi
fi
I1105 10:01:04.275310 19703 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1105 10:01:04.275329 19703 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19910-17277/.minikube CaCertPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19910-17277/.minikube}
I1105 10:01:04.275346 19703 buildroot.go:174] setting up certificates
I1105 10:01:04.275367 19703 provision.go:84] configureAuth start
I1105 10:01:04.275378 19703 main.go:141] libmachine: (ha-213000) Calling .GetMachineName
I1105 10:01:04.275523 19703 main.go:141] libmachine: (ha-213000) Calling .GetIP
I1105 10:01:04.275627 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:04.275736 19703 provision.go:143] copyHostCerts
I1105 10:01:04.275773 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.pem
I1105 10:01:04.275854 19703 exec_runner.go:144] found /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.pem, removing ...
I1105 10:01:04.275861 19703 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.pem
I1105 10:01:04.276002 19703 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.pem (1082 bytes)
I1105 10:01:04.276234 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/19910-17277/.minikube/cert.pem
I1105 10:01:04.276283 19703 exec_runner.go:144] found /Users/jenkins/minikube-integration/19910-17277/.minikube/cert.pem, removing ...
I1105 10:01:04.276287 19703 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19910-17277/.minikube/cert.pem
I1105 10:01:04.276380 19703 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19910-17277/.minikube/cert.pem (1123 bytes)
I1105 10:01:04.276579 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/19910-17277/.minikube/key.pem
I1105 10:01:04.276626 19703 exec_runner.go:144] found /Users/jenkins/minikube-integration/19910-17277/.minikube/key.pem, removing ...
I1105 10:01:04.276631 19703 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19910-17277/.minikube/key.pem
I1105 10:01:04.276750 19703 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19910-17277/.minikube/key.pem (1675 bytes)
I1105 10:01:04.276914 19703 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca-key.pem org=jenkins.ha-213000 san=[127.0.0.1 192.169.0.5 ha-213000 localhost minikube]
I1105 10:01:04.409758 19703 provision.go:177] copyRemoteCerts
I1105 10:01:04.409836 19703 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1105 10:01:04.409852 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:04.410004 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:01:04.410102 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:04.410207 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:01:04.410308 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/id_rsa Username:docker}
I1105 10:01:04.447116 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I1105 10:01:04.447193 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1105 10:01:04.466891 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server.pem -> /etc/docker/server.pem
I1105 10:01:04.466954 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)
I1105 10:01:04.486228 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I1105 10:01:04.486290 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1105 10:01:04.506082 19703 provision.go:87] duration metric: took 230.693486ms to configureAuth
I1105 10:01:04.506098 19703 buildroot.go:189] setting minikube options for container-runtime
I1105 10:01:04.506258 19703 config.go:182] Loaded profile config "ha-213000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1105 10:01:04.506272 19703 main.go:141] libmachine: (ha-213000) Calling .DriverName
I1105 10:01:04.506412 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:04.506508 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:01:04.506593 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:04.506676 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:04.506765 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:01:04.506897 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:01:04.507032 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.5 22 <nil> <nil>}
I1105 10:01:04.507040 19703 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I1105 10:01:04.567965 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I1105 10:01:04.567978 19703 buildroot.go:70] root file system type: tmpfs
I1105 10:01:04.568060 19703 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I1105 10:01:04.568074 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:04.568219 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:01:04.568335 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:04.568441 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:04.568552 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:01:04.568731 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:01:04.568876 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.5 22 <nil> <nil>}
I1105 10:01:04.568928 19703 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I1105 10:01:04.639803 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I1105 10:01:04.639825 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:04.639961 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:01:04.640058 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:04.640141 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:04.640255 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:01:04.640420 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:01:04.640549 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.5 22 <nil> <nil>}
I1105 10:01:04.640561 19703 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I1105 10:01:06.214895 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I1105 10:01:06.214911 19703 main.go:141] libmachine: Checking connection to Docker...
I1105 10:01:06.214917 19703 main.go:141] libmachine: (ha-213000) Calling .GetURL
I1105 10:01:06.215063 19703 main.go:141] libmachine: Docker is up and running!
I1105 10:01:06.215071 19703 main.go:141] libmachine: Reticulating splines...
I1105 10:01:06.215076 19703 client.go:171] duration metric: took 17.176350291s to LocalClient.Create
I1105 10:01:06.215089 19703 start.go:167] duration metric: took 17.176396472s to libmachine.API.Create "ha-213000"
I1105 10:01:06.215099 19703 start.go:293] postStartSetup for "ha-213000" (driver="hyperkit")
I1105 10:01:06.215106 19703 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1105 10:01:06.215116 19703 main.go:141] libmachine: (ha-213000) Calling .DriverName
I1105 10:01:06.215261 19703 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1105 10:01:06.215274 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:06.215361 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:01:06.215442 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:06.215528 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:01:06.215620 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/id_rsa Username:docker}
I1105 10:01:06.251640 19703 ssh_runner.go:195] Run: cat /etc/os-release
I1105 10:01:06.255113 19703 info.go:137] Remote host: Buildroot 2023.02.9
I1105 10:01:06.255129 19703 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19910-17277/.minikube/addons for local assets ...
I1105 10:01:06.255230 19703 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19910-17277/.minikube/files for local assets ...
I1105 10:01:06.255446 19703 filesync.go:149] local asset: /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem -> 178422.pem in /etc/ssl/certs
I1105 10:01:06.255453 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem -> /etc/ssl/certs/178422.pem
I1105 10:01:06.255711 19703 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1105 10:01:06.263216 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem --> /etc/ssl/certs/178422.pem (1708 bytes)
I1105 10:01:06.283684 19703 start.go:296] duration metric: took 68.576557ms for postStartSetup
I1105 10:01:06.283726 19703 main.go:141] libmachine: (ha-213000) Calling .GetConfigRaw
I1105 10:01:06.284405 19703 main.go:141] libmachine: (ha-213000) Calling .GetIP
I1105 10:01:06.284548 19703 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/config.json ...
I1105 10:01:06.284926 19703 start.go:128] duration metric: took 17.282000829s to createHost
I1105 10:01:06.284941 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:06.285030 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:01:06.285125 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:06.285202 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:06.285269 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:01:06.285398 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:01:06.285521 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.5 22 <nil> <nil>}
I1105 10:01:06.285528 19703 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I1105 10:01:06.344331 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: 1730829665.881654888
I1105 10:01:06.344343 19703 fix.go:216] guest clock: 1730829665.881654888
I1105 10:01:06.344347 19703 fix.go:229] Guest: 2024-11-05 10:01:05.881654888 -0800 PST Remote: 2024-11-05 10:01:06.284934 -0800 PST m=+17.850547767 (delta=-403.279112ms)
I1105 10:01:06.344367 19703 fix.go:200] guest clock delta is within tolerance: -403.279112ms
I1105 10:01:06.344370 19703 start.go:83] releasing machines lock for "ha-213000", held for 17.341551607s
I1105 10:01:06.344388 19703 main.go:141] libmachine: (ha-213000) Calling .DriverName
I1105 10:01:06.344528 19703 main.go:141] libmachine: (ha-213000) Calling .GetIP
I1105 10:01:06.344623 19703 main.go:141] libmachine: (ha-213000) Calling .DriverName
I1105 10:01:06.344951 19703 main.go:141] libmachine: (ha-213000) Calling .DriverName
I1105 10:01:06.345054 19703 main.go:141] libmachine: (ha-213000) Calling .DriverName
I1105 10:01:06.345149 19703 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1105 10:01:06.345178 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:06.345208 19703 ssh_runner.go:195] Run: cat /version.json
I1105 10:01:06.345219 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:06.345270 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:01:06.345332 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:01:06.345365 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:06.345442 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:06.345461 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:01:06.345518 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:01:06.345559 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/id_rsa Username:docker}
I1105 10:01:06.345639 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/id_rsa Username:docker}
I1105 10:01:06.378204 19703 ssh_runner.go:195] Run: systemctl --version
I1105 10:01:06.426915 19703 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1105 10:01:06.431535 19703 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1105 10:01:06.431591 19703 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1105 10:01:06.445898 19703 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1105 10:01:06.445913 19703 start.go:495] detecting cgroup driver to use...
I1105 10:01:06.446023 19703 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1105 10:01:06.460899 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I1105 10:01:06.469852 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1105 10:01:06.478814 19703 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I1105 10:01:06.478874 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I1105 10:01:06.487613 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1105 10:01:06.496557 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1105 10:01:06.505258 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1105 10:01:06.514169 19703 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1105 10:01:06.524040 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1105 10:01:06.533030 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I1105 10:01:06.541790 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I1105 10:01:06.550841 19703 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1105 10:01:06.558861 19703 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I1105 10:01:06.558919 19703 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I1105 10:01:06.568040 19703 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1105 10:01:06.576174 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:01:06.680889 19703 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1105 10:01:06.699975 19703 start.go:495] detecting cgroup driver to use...
I1105 10:01:06.700071 19703 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I1105 10:01:06.713715 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1105 10:01:06.724704 19703 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1105 10:01:06.743034 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1105 10:01:06.753151 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1105 10:01:06.764276 19703 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1105 10:01:06.804304 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1105 10:01:06.815447 19703 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I1105 10:01:06.838920 19703 ssh_runner.go:195] Run: which cri-dockerd
I1105 10:01:06.842715 19703 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I1105 10:01:06.857786 19703 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)
I1105 10:01:06.875540 19703 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I1105 10:01:06.983809 19703 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I1105 10:01:07.086590 19703 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I1105 10:01:07.086669 19703 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I1105 10:01:07.101565 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:01:07.202392 19703 ssh_runner.go:195] Run: sudo systemctl restart docker
I1105 10:01:09.490529 19703 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.288138695s)
I1105 10:01:09.490615 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
I1105 10:01:09.502437 19703 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket
I1105 10:01:09.516436 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I1105 10:01:09.526819 19703 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I1105 10:01:09.622839 19703 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I1105 10:01:09.716251 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:01:09.826522 19703 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I1105 10:01:09.839888 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I1105 10:01:09.850796 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:01:09.959403 19703 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
I1105 10:01:10.017340 19703 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
I1105 10:01:10.017457 19703 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I1105 10:01:10.021721 19703 start.go:563] Will wait 60s for crictl version
I1105 10:01:10.021786 19703 ssh_runner.go:195] Run: which crictl
I1105 10:01:10.024691 19703 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1105 10:01:10.049837 19703 start.go:579] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 27.3.1
RuntimeApiVersion: v1
I1105 10:01:10.049922 19703 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I1105 10:01:10.066022 19703 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I1105 10:01:10.125079 19703 out.go:235] * Preparing Kubernetes v1.31.2 on Docker 27.3.1 ...
I1105 10:01:10.125132 19703 main.go:141] libmachine: (ha-213000) Calling .GetIP
I1105 10:01:10.125605 19703 ssh_runner.go:195] Run: grep 192.169.0.1 host.minikube.internal$ /etc/hosts
I1105 10:01:10.129273 19703 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.169.0.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1105 10:01:10.139143 19703 kubeadm.go:883] updating cluster {Name:ha-213000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19883/minikube-v1.34.0-1730282777-19883-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.
2 ClusterName:ha-213000 Namespace:default APIServerHAVIP:192.169.0.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.169.0.5 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Moun
tType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1105 10:01:10.139212 19703 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
I1105 10:01:10.139280 19703 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I1105 10:01:10.150154 19703 docker.go:689] Got preloaded images:
I1105 10:01:10.150166 19703 docker.go:695] registry.k8s.io/kube-apiserver:v1.31.2 wasn't preloaded
I1105 10:01:10.150233 19703 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
I1105 10:01:10.157824 19703 ssh_runner.go:195] Run: which lz4
I1105 10:01:10.160636 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-amd64.tar.lz4 -> /preloaded.tar.lz4
I1105 10:01:10.160780 19703 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4
I1105 10:01:10.163841 19703 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/preloaded.tar.lz4': No such file or directory
I1105 10:01:10.163861 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (343199686 bytes)
I1105 10:01:11.159350 19703 docker.go:653] duration metric: took 998.641869ms to copy over tarball
I1105 10:01:11.159432 19703 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
I1105 10:01:13.249323 19703 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.089892673s)
I1105 10:01:13.249340 19703 ssh_runner.go:146] rm: /preloaded.tar.lz4
I1105 10:01:13.274325 19703 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
I1105 10:01:13.282463 19703 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2631 bytes)
I1105 10:01:13.296334 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:01:13.388712 19703 ssh_runner.go:195] Run: sudo systemctl restart docker
I1105 10:01:15.739164 19703 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.350454399s)
I1105 10:01:15.739273 19703 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I1105 10:01:15.754024 19703 docker.go:689] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.31.2
registry.k8s.io/kube-controller-manager:v1.31.2
registry.k8s.io/kube-scheduler:v1.31.2
registry.k8s.io/kube-proxy:v1.31.2
registry.k8s.io/coredns/coredns:v1.11.3
registry.k8s.io/etcd:3.5.15-0
registry.k8s.io/pause:3.10
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I1105 10:01:15.754043 19703 cache_images.go:84] Images are preloaded, skipping loading
I1105 10:01:15.754049 19703 kubeadm.go:934] updating node { 192.169.0.5 8443 v1.31.2 docker true true} ...
I1105 10:01:15.754140 19703 kubeadm.go:946] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-213000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.169.0.5
[Install]
config:
{KubernetesVersion:v1.31.2 ClusterName:ha-213000 Namespace:default APIServerHAVIP:192.169.0.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1105 10:01:15.754227 19703 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I1105 10:01:15.788737 19703 cni.go:84] Creating CNI manager for ""
I1105 10:01:15.788757 19703 cni.go:136] multinode detected (1 nodes found), recommending kindnet
I1105 10:01:15.788770 19703 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I1105 10:01:15.788787 19703 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.169.0.5 APIServerPort:8443 KubernetesVersion:v1.31.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-213000 NodeName:ha-213000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.169.0.5"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.169.0.5 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manif
ests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1105 10:01:15.788861 19703 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.169.0.5
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/cri-dockerd.sock
name: "ha-213000"
kubeletExtraArgs:
- name: "node-ip"
value: "192.169.0.5"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.169.0.5"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
- name: "proxy-refresh-interval"
value: "70000"
kubernetesVersion: v1.31.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1105 10:01:15.788877 19703 kube-vip.go:115] generating kube-vip config ...
I1105 10:01:15.788942 19703 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"
I1105 10:01:15.801675 19703 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip
I1105 10:01:15.801751 19703 kube-vip.go:137] kube-vip config:
apiVersion: v1
kind: Pod
metadata:
creationTimestamp: null
name: kube-vip
namespace: kube-system
spec:
containers:
- args:
- manager
env:
- name: vip_arp
value: "true"
- name: port
value: "8443"
- name: vip_nodename
valueFrom:
fieldRef:
fieldPath: spec.nodeName
- name: vip_interface
value: eth0
- name: vip_cidr
value: "32"
- name: dns_mode
value: first
- name: cp_enable
value: "true"
- name: cp_namespace
value: kube-system
- name: vip_leaderelection
value: "true"
- name: vip_leasename
value: plndr-cp-lock
- name: vip_leaseduration
value: "5"
- name: vip_renewdeadline
value: "3"
- name: vip_retryperiod
value: "1"
- name: address
value: 192.169.0.254
- name: prometheus_server
value: :2112
- name : lb_enable
value: "true"
- name: lb_port
value: "8443"
image: ghcr.io/kube-vip/kube-vip:v0.8.6
imagePullPolicy: IfNotPresent
name: kube-vip
resources: {}
securityContext:
capabilities:
add:
- NET_ADMIN
- NET_RAW
volumeMounts:
- mountPath: /etc/kubernetes/admin.conf
name: kubeconfig
hostAliases:
- hostnames:
- kubernetes
ip: 127.0.0.1
hostNetwork: true
volumes:
- hostPath:
path: "/etc/kubernetes/super-admin.conf"
name: kubeconfig
status: {}
I1105 10:01:15.801824 19703 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.2
I1105 10:01:15.809490 19703 binaries.go:44] Found k8s binaries, skipping transfer
I1105 10:01:15.809553 19703 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
I1105 10:01:15.816819 19703 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (307 bytes)
I1105 10:01:15.831209 19703 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1105 10:01:15.844621 19703 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2284 bytes)
I1105 10:01:15.857998 19703 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1446 bytes)
I1105 10:01:15.871169 19703 ssh_runner.go:195] Run: grep 192.169.0.254 control-plane.minikube.internal$ /etc/hosts
I1105 10:01:15.874131 19703 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.169.0.254 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1105 10:01:15.883385 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:01:15.976109 19703 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1105 10:01:15.992221 19703 certs.go:68] Setting up /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000 for IP: 192.169.0.5
I1105 10:01:15.992233 19703 certs.go:194] generating shared ca certs ...
I1105 10:01:15.992243 19703 certs.go:226] acquiring lock for ca certs: {Name:mk71cfd5cfa6f19aa54770800e673e4533fb7d9c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:01:15.992461 19703 certs.go:235] skipping valid "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.key
I1105 10:01:15.992552 19703 certs.go:235] skipping valid "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/proxy-client-ca.key
I1105 10:01:15.992562 19703 certs.go:256] generating profile certs ...
I1105 10:01:15.992612 19703 certs.go:363] generating signed profile cert for "minikube-user": /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/client.key
I1105 10:01:15.992624 19703 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/client.crt with IP's: []
I1105 10:01:16.094282 19703 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/client.crt ...
I1105 10:01:16.094299 19703 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/client.crt: {Name:mk32df45c928182ea5273921e15df540dba3284b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:01:16.094649 19703 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/client.key ...
I1105 10:01:16.094656 19703 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/client.key: {Name:mk4ba8eb16cdbfaf693d3586557970b225775c80 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:01:16.094907 19703 certs.go:363] generating signed profile cert for "minikube": /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key.0c0b88a3
I1105 10:01:16.094921 19703 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt.0c0b88a3 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.169.0.5 192.169.0.254]
I1105 10:01:16.166905 19703 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt.0c0b88a3 ...
I1105 10:01:16.166920 19703 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt.0c0b88a3: {Name:mk8e48df26de9447c3326b40118c66ea248d3cbf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:01:16.167265 19703 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key.0c0b88a3 ...
I1105 10:01:16.167275 19703 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key.0c0b88a3: {Name:mkb555a3da1a71d498a5e7f44da4ed0baf461c37 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:01:16.167543 19703 certs.go:381] copying /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt.0c0b88a3 -> /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt
I1105 10:01:16.167743 19703 certs.go:385] copying /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key.0c0b88a3 -> /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key
I1105 10:01:16.167942 19703 certs.go:363] generating signed profile cert for "aggregator": /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.key
I1105 10:01:16.167958 19703 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.crt with IP's: []
I1105 10:01:16.340393 19703 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.crt ...
I1105 10:01:16.340414 19703 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.crt: {Name:mkad63aa252d0a246c051641017bfdd8bd78fbe5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:01:16.340763 19703 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.key ...
I1105 10:01:16.340771 19703 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.key: {Name:mkc1a14cacaacc53921fd9d706ec801444580291 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:01:16.341021 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I1105 10:01:16.341051 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I1105 10:01:16.341070 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I1105 10:01:16.341091 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I1105 10:01:16.341110 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I1105 10:01:16.341129 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I1105 10:01:16.341149 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I1105 10:01:16.341171 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I1105 10:01:16.341276 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/17842.pem (1338 bytes)
W1105 10:01:16.341338 19703 certs.go:480] ignoring /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/17842_empty.pem, impossibly tiny 0 bytes
I1105 10:01:16.341346 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca-key.pem (1679 bytes)
I1105 10:01:16.341376 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem (1082 bytes)
I1105 10:01:16.341409 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/cert.pem (1123 bytes)
I1105 10:01:16.341438 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/key.pem (1675 bytes)
I1105 10:01:16.341499 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem (1708 bytes)
I1105 10:01:16.341533 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I1105 10:01:16.341553 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/17842.pem -> /usr/share/ca-certificates/17842.pem
I1105 10:01:16.341577 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem -> /usr/share/ca-certificates/178422.pem
I1105 10:01:16.342013 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1105 10:01:16.361630 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1105 10:01:16.380740 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1105 10:01:16.400614 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1105 10:01:16.420038 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
I1105 10:01:16.439653 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1105 10:01:16.458562 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1105 10:01:16.478643 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1105 10:01:16.497792 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1105 10:01:16.516678 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/17842.pem --> /usr/share/ca-certificates/17842.pem (1338 bytes)
I1105 10:01:16.535739 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem --> /usr/share/ca-certificates/178422.pem (1708 bytes)
I1105 10:01:16.555130 19703 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1105 10:01:16.569073 19703 ssh_runner.go:195] Run: openssl version
I1105 10:01:16.573341 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/17842.pem && ln -fs /usr/share/ca-certificates/17842.pem /etc/ssl/certs/17842.pem"
I1105 10:01:16.582782 19703 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/17842.pem
I1105 10:01:16.586227 19703 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 5 17:52 /usr/share/ca-certificates/17842.pem
I1105 10:01:16.586277 19703 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/17842.pem
I1105 10:01:16.590528 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/17842.pem /etc/ssl/certs/51391683.0"
I1105 10:01:16.599704 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/178422.pem && ln -fs /usr/share/ca-certificates/178422.pem /etc/ssl/certs/178422.pem"
I1105 10:01:16.608870 19703 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/178422.pem
I1105 10:01:16.612245 19703 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 5 17:52 /usr/share/ca-certificates/178422.pem
I1105 10:01:16.612298 19703 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/178422.pem
I1105 10:01:16.616513 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/178422.pem /etc/ssl/certs/3ec20f2e.0"
I1105 10:01:16.625608 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1105 10:01:16.635771 19703 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1105 10:01:16.639310 19703 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 5 17:43 /usr/share/ca-certificates/minikubeCA.pem
I1105 10:01:16.639358 19703 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1105 10:01:16.643770 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1105 10:01:16.654663 19703 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1105 10:01:16.660794 19703 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1105 10:01:16.660842 19703 kubeadm.go:392] StartCluster: {Name:ha-213000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19883/minikube-v1.34.0-1730282777-19883-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 C
lusterName:ha-213000 Namespace:default APIServerHAVIP:192.169.0.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.169.0.5 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountTy
pe:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1105 10:01:16.660953 19703 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I1105 10:01:16.677060 19703 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1105 10:01:16.690427 19703 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1105 10:01:16.700859 19703 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1105 10:01:16.709261 19703 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1105 10:01:16.709272 19703 kubeadm.go:157] found existing configuration files:
I1105 10:01:16.709351 19703 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1105 10:01:16.718113 19703 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1105 10:01:16.718192 19703 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I1105 10:01:16.726411 19703 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1105 10:01:16.734224 19703 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1105 10:01:16.734289 19703 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1105 10:01:16.742733 19703 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1105 10:01:16.750784 19703 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1105 10:01:16.750844 19703 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1105 10:01:16.759076 19703 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1105 10:01:16.766845 19703 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1105 10:01:16.766909 19703 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1105 10:01:16.774996 19703 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I1105 10:01:16.840437 19703 kubeadm.go:310] [init] Using Kubernetes version: v1.31.2
I1105 10:01:16.840491 19703 kubeadm.go:310] [preflight] Running pre-flight checks
I1105 10:01:16.926763 19703 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I1105 10:01:16.926877 19703 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1105 10:01:16.926980 19703 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I1105 10:01:16.936091 19703 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1105 10:01:16.983362 19703 out.go:235] - Generating certificates and keys ...
I1105 10:01:16.983421 19703 kubeadm.go:310] [certs] Using existing ca certificate authority
I1105 10:01:16.983471 19703 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I1105 10:01:17.072797 19703 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I1105 10:01:17.179588 19703 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I1105 10:01:17.306014 19703 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I1105 10:01:17.631639 19703 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I1105 10:01:17.770167 19703 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I1105 10:01:17.770365 19703 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [ha-213000 localhost] and IPs [192.169.0.5 127.0.0.1 ::1]
I1105 10:01:18.036090 19703 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I1105 10:01:18.036251 19703 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [ha-213000 localhost] and IPs [192.169.0.5 127.0.0.1 ::1]
I1105 10:01:18.099648 19703 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I1105 10:01:18.290329 19703 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I1105 10:01:18.487625 19703 kubeadm.go:310] [certs] Generating "sa" key and public key
I1105 10:01:18.487812 19703 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1105 10:01:18.631478 19703 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I1105 10:01:18.780093 19703 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I1105 10:01:18.888960 19703 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1105 10:01:19.168437 19703 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1105 10:01:19.347823 19703 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1105 10:01:19.348317 19703 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1105 10:01:19.350236 19703 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1105 10:01:19.371622 19703 out.go:235] - Booting up control plane ...
I1105 10:01:19.371724 19703 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1105 10:01:19.371803 19703 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1105 10:01:19.371856 19703 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1105 10:01:19.371944 19703 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1105 10:01:19.372021 19703 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1105 10:01:19.372058 19703 kubeadm.go:310] [kubelet-start] Starting the kubelet
I1105 10:01:19.481087 19703 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I1105 10:01:19.481190 19703 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I1105 10:01:20.488429 19703 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.007994623s
I1105 10:01:20.488531 19703 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I1105 10:01:26.203663 19703 kubeadm.go:310] [api-check] The API server is healthy after 5.719526197s
I1105 10:01:26.212624 19703 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1105 10:01:26.220645 19703 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1105 10:01:26.233694 19703 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I1105 10:01:26.233859 19703 kubeadm.go:310] [mark-control-plane] Marking the node ha-213000 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1105 10:01:26.244246 19703 kubeadm.go:310] [bootstrap-token] Using token: w4nohd.4e3143tllv8ohc8g
I1105 10:01:26.284768 19703 out.go:235] - Configuring RBAC rules ...
I1105 10:01:26.284885 19703 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1105 10:01:26.286787 19703 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1105 10:01:26.310075 19703 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1105 10:01:26.312761 19703 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1105 10:01:26.318937 19703 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1105 10:01:26.322239 19703 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1105 10:01:26.608210 19703 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1105 10:01:27.037009 19703 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I1105 10:01:27.610360 19703 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I1105 10:01:27.611067 19703 kubeadm.go:310]
I1105 10:01:27.611117 19703 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I1105 10:01:27.611123 19703 kubeadm.go:310]
I1105 10:01:27.611199 19703 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I1105 10:01:27.611208 19703 kubeadm.go:310]
I1105 10:01:27.611229 19703 kubeadm.go:310] mkdir -p $HOME/.kube
I1105 10:01:27.611277 19703 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1105 10:01:27.611341 19703 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1105 10:01:27.611352 19703 kubeadm.go:310]
I1105 10:01:27.611397 19703 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I1105 10:01:27.611403 19703 kubeadm.go:310]
I1105 10:01:27.611451 19703 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I1105 10:01:27.611459 19703 kubeadm.go:310]
I1105 10:01:27.611495 19703 kubeadm.go:310] You should now deploy a pod network to the cluster.
I1105 10:01:27.611550 19703 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1105 10:01:27.611623 19703 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1105 10:01:27.611630 19703 kubeadm.go:310]
I1105 10:01:27.611697 19703 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I1105 10:01:27.611766 19703 kubeadm.go:310] and service account keys on each node and then running the following as root:
I1105 10:01:27.611773 19703 kubeadm.go:310]
I1105 10:01:27.611836 19703 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token w4nohd.4e3143tllv8ohc8g \
I1105 10:01:27.611921 19703 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:2aaa6cfcc57cd555da7aed58a5e5ed7a34a7fb597dea4022fdf5920ac62a4564 \
I1105 10:01:27.611942 19703 kubeadm.go:310] --control-plane
I1105 10:01:27.611949 19703 kubeadm.go:310]
I1105 10:01:27.612027 19703 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I1105 10:01:27.612038 19703 kubeadm.go:310]
I1105 10:01:27.612109 19703 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token w4nohd.4e3143tllv8ohc8g \
I1105 10:01:27.612190 19703 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:2aaa6cfcc57cd555da7aed58a5e5ed7a34a7fb597dea4022fdf5920ac62a4564
I1105 10:01:27.612839 19703 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1105 10:01:27.612851 19703 cni.go:84] Creating CNI manager for ""
I1105 10:01:27.612855 19703 cni.go:136] multinode detected (1 nodes found), recommending kindnet
I1105 10:01:27.638912 19703 out.go:177] * Configuring CNI (Container Networking Interface) ...
I1105 10:01:27.682614 19703 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I1105 10:01:27.687942 19703 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.2/kubectl ...
I1105 10:01:27.687953 19703 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I1105 10:01:27.701992 19703 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I1105 10:01:27.936771 19703 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1105 10:01:27.936836 19703 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1105 10:01:27.936838 19703 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-213000 minikube.k8s.io/updated_at=2024_11_05T10_01_27_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=47b0afc9e70653f81ca813437c4c46b74450b911 minikube.k8s.io/name=ha-213000 minikube.k8s.io/primary=true
I1105 10:01:28.117503 19703 ops.go:34] apiserver oom_adj: -16
I1105 10:01:28.117657 19703 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1105 10:01:28.618627 19703 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1105 10:01:29.117808 19703 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1105 10:01:29.617729 19703 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1105 10:01:30.119155 19703 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1105 10:01:30.618084 19703 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1105 10:01:31.118505 19703 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1105 10:01:31.195673 19703 kubeadm.go:1113] duration metric: took 3.258930438s to wait for elevateKubeSystemPrivileges
I1105 10:01:31.195694 19703 kubeadm.go:394] duration metric: took 14.534988132s to StartCluster
I1105 10:01:31.195710 19703 settings.go:142] acquiring lock: {Name:mkb9db6c39cf305021d5d9ea8e7cd364fbed4154 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:01:31.195820 19703 settings.go:150] Updating kubeconfig: /Users/jenkins/minikube-integration/19910-17277/kubeconfig
I1105 10:01:31.196307 19703 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19910-17277/kubeconfig: {Name:mk020782da2535e8a484bb28e080ca9961ae0c64 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:01:31.196590 19703 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1105 10:01:31.196592 19703 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.169.0.5 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
I1105 10:01:31.196603 19703 start.go:241] waiting for startup goroutines ...
I1105 10:01:31.196618 19703 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1105 10:01:31.196671 19703 addons.go:69] Setting storage-provisioner=true in profile "ha-213000"
I1105 10:01:31.196685 19703 addons.go:234] Setting addon storage-provisioner=true in "ha-213000"
I1105 10:01:31.196691 19703 addons.go:69] Setting default-storageclass=true in profile "ha-213000"
I1105 10:01:31.196703 19703 host.go:66] Checking if "ha-213000" exists ...
I1105 10:01:31.196707 19703 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-213000"
I1105 10:01:31.196741 19703 config.go:182] Loaded profile config "ha-213000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1105 10:01:31.196976 19703 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1105 10:01:31.196986 19703 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1105 10:01:31.196996 19703 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1105 10:01:31.197000 19703 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1105 10:01:31.208908 19703 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:57639
I1105 10:01:31.209261 19703 main.go:141] libmachine: () Calling .GetVersion
I1105 10:01:31.209642 19703 main.go:141] libmachine: Using API Version 1
I1105 10:01:31.209655 19703 main.go:141] libmachine: () Calling .SetConfigRaw
I1105 10:01:31.209868 19703 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:57641
I1105 10:01:31.209885 19703 main.go:141] libmachine: () Calling .GetMachineName
I1105 10:01:31.210032 19703 main.go:141] libmachine: (ha-213000) Calling .GetState
I1105 10:01:31.210143 19703 main.go:141] libmachine: (ha-213000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:01:31.210244 19703 main.go:141] libmachine: () Calling .GetVersion
I1105 10:01:31.210251 19703 main.go:141] libmachine: (ha-213000) DBG | hyperkit pid from json: 19716
I1105 10:01:31.210574 19703 main.go:141] libmachine: Using API Version 1
I1105 10:01:31.210584 19703 main.go:141] libmachine: () Calling .SetConfigRaw
I1105 10:01:31.210788 19703 main.go:141] libmachine: () Calling .GetMachineName
I1105 10:01:31.211192 19703 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1105 10:01:31.211225 19703 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1105 10:01:31.212394 19703 loader.go:395] Config loaded from file: /Users/jenkins/minikube-integration/19910-17277/kubeconfig
I1105 10:01:31.213752 19703 kapi.go:59] client config for ha-213000: &rest.Config{Host:"https://192.169.0.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/client.key", CAFile:"/Users/jenkins/minikube-integration/19910-17277/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(ni
l)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x11e86e20), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1105 10:01:31.214400 19703 cert_rotation.go:140] Starting client certificate rotation controller
I1105 10:01:31.214537 19703 addons.go:234] Setting addon default-storageclass=true in "ha-213000"
I1105 10:01:31.214564 19703 host.go:66] Checking if "ha-213000" exists ...
I1105 10:01:31.214803 19703 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1105 10:01:31.214828 19703 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1105 10:01:31.223254 19703 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:57643
I1105 10:01:31.223597 19703 main.go:141] libmachine: () Calling .GetVersion
I1105 10:01:31.224001 19703 main.go:141] libmachine: Using API Version 1
I1105 10:01:31.224022 19703 main.go:141] libmachine: () Calling .SetConfigRaw
I1105 10:01:31.224270 19703 main.go:141] libmachine: () Calling .GetMachineName
I1105 10:01:31.224394 19703 main.go:141] libmachine: (ha-213000) Calling .GetState
I1105 10:01:31.224509 19703 main.go:141] libmachine: (ha-213000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:01:31.224581 19703 main.go:141] libmachine: (ha-213000) DBG | hyperkit pid from json: 19716
I1105 10:01:31.225831 19703 main.go:141] libmachine: (ha-213000) Calling .DriverName
I1105 10:01:31.226397 19703 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:57645
I1105 10:01:31.226753 19703 main.go:141] libmachine: () Calling .GetVersion
I1105 10:01:31.227096 19703 main.go:141] libmachine: Using API Version 1
I1105 10:01:31.227107 19703 main.go:141] libmachine: () Calling .SetConfigRaw
I1105 10:01:31.227355 19703 main.go:141] libmachine: () Calling .GetMachineName
I1105 10:01:31.227741 19703 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1105 10:01:31.227767 19703 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1105 10:01:31.238983 19703 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:57647
I1105 10:01:31.239279 19703 main.go:141] libmachine: () Calling .GetVersion
I1105 10:01:31.239639 19703 main.go:141] libmachine: Using API Version 1
I1105 10:01:31.239659 19703 main.go:141] libmachine: () Calling .SetConfigRaw
I1105 10:01:31.239882 19703 main.go:141] libmachine: () Calling .GetMachineName
I1105 10:01:31.239983 19703 main.go:141] libmachine: (ha-213000) Calling .GetState
I1105 10:01:31.240069 19703 main.go:141] libmachine: (ha-213000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:01:31.240135 19703 main.go:141] libmachine: (ha-213000) DBG | hyperkit pid from json: 19716
I1105 10:01:31.241282 19703 main.go:141] libmachine: (ha-213000) Calling .DriverName
I1105 10:01:31.241435 19703 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I1105 10:01:31.241450 19703 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1105 10:01:31.241460 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:31.241543 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:01:31.241623 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:31.241696 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:01:31.241776 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/id_rsa Username:docker}
I1105 10:01:31.250526 19703 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1105 10:01:31.270056 19703 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1105 10:01:31.270068 19703 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1105 10:01:31.270085 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:31.270249 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:01:31.270368 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:31.270493 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:01:31.270593 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/id_rsa Username:docker}
I1105 10:01:31.343009 19703 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1105 10:01:31.358734 19703 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.169.0.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I1105 10:01:31.372889 19703 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1105 10:01:31.583824 19703 main.go:141] libmachine: Making call to close driver server
I1105 10:01:31.583836 19703 main.go:141] libmachine: (ha-213000) Calling .Close
I1105 10:01:31.584072 19703 main.go:141] libmachine: (ha-213000) DBG | Closing plugin on server side
I1105 10:01:31.584088 19703 main.go:141] libmachine: Successfully made call to close driver server
I1105 10:01:31.584097 19703 main.go:141] libmachine: Making call to close connection to plugin binary
I1105 10:01:31.584114 19703 main.go:141] libmachine: Making call to close driver server
I1105 10:01:31.584120 19703 main.go:141] libmachine: (ha-213000) Calling .Close
I1105 10:01:31.584249 19703 main.go:141] libmachine: Successfully made call to close driver server
I1105 10:01:31.584257 19703 main.go:141] libmachine: Making call to close connection to plugin binary
I1105 10:01:31.584263 19703 main.go:141] libmachine: (ha-213000) DBG | Closing plugin on server side
I1105 10:01:31.584311 19703 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
I1105 10:01:31.584343 19703 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
I1105 10:01:31.584428 19703 round_trippers.go:463] GET https://192.169.0.254:8443/apis/storage.k8s.io/v1/storageclasses
I1105 10:01:31.584433 19703 round_trippers.go:469] Request Headers:
I1105 10:01:31.584440 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:01:31.584445 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:01:31.589847 19703 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I1105 10:01:31.590273 19703 round_trippers.go:463] PUT https://192.169.0.254:8443/apis/storage.k8s.io/v1/storageclasses/standard
I1105 10:01:31.590280 19703 round_trippers.go:469] Request Headers:
I1105 10:01:31.590285 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:01:31.590289 19703 round_trippers.go:473] Content-Type: application/json
I1105 10:01:31.590292 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:01:31.591793 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:01:31.591915 19703 main.go:141] libmachine: Making call to close driver server
I1105 10:01:31.591923 19703 main.go:141] libmachine: (ha-213000) Calling .Close
I1105 10:01:31.592075 19703 main.go:141] libmachine: Successfully made call to close driver server
I1105 10:01:31.592084 19703 main.go:141] libmachine: Making call to close connection to plugin binary
I1105 10:01:31.592098 19703 main.go:141] libmachine: (ha-213000) DBG | Closing plugin on server side
I1105 10:01:31.661628 19703 start.go:971] {"host.minikube.internal": 192.169.0.1} host record injected into CoreDNS's ConfigMap
I1105 10:01:31.799548 19703 main.go:141] libmachine: Making call to close driver server
I1105 10:01:31.799567 19703 main.go:141] libmachine: (ha-213000) Calling .Close
I1105 10:01:31.799772 19703 main.go:141] libmachine: (ha-213000) DBG | Closing plugin on server side
I1105 10:01:31.799790 19703 main.go:141] libmachine: Successfully made call to close driver server
I1105 10:01:31.799800 19703 main.go:141] libmachine: Making call to close connection to plugin binary
I1105 10:01:31.799817 19703 main.go:141] libmachine: Making call to close driver server
I1105 10:01:31.799822 19703 main.go:141] libmachine: (ha-213000) Calling .Close
I1105 10:01:31.799950 19703 main.go:141] libmachine: Successfully made call to close driver server
I1105 10:01:31.799959 19703 main.go:141] libmachine: Making call to close connection to plugin binary
I1105 10:01:31.823619 19703 out.go:177] * Enabled addons: default-storageclass, storage-provisioner
I1105 10:01:31.881388 19703 addons.go:510] duration metric: took 684.78194ms for enable addons: enabled=[default-storageclass storage-provisioner]
I1105 10:01:31.881432 19703 start.go:246] waiting for cluster config update ...
I1105 10:01:31.881446 19703 start.go:255] writing updated cluster config ...
I1105 10:01:31.902486 19703 out.go:201]
I1105 10:01:31.940014 19703 config.go:182] Loaded profile config "ha-213000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1105 10:01:31.940131 19703 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/config.json ...
I1105 10:01:31.962472 19703 out.go:177] * Starting "ha-213000-m02" control-plane node in "ha-213000" cluster
I1105 10:01:32.004496 19703 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
I1105 10:01:32.004517 19703 cache.go:56] Caching tarball of preloaded images
I1105 10:01:32.004642 19703 preload.go:172] Found /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I1105 10:01:32.004651 19703 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
I1105 10:01:32.004703 19703 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/config.json ...
I1105 10:01:32.005148 19703 start.go:360] acquireMachinesLock for ha-213000-m02: {Name:mk67e3fe9c26d68e6bc4121ccfd9f37c1a8d85cb Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1105 10:01:32.005220 19703 start.go:364] duration metric: took 59.105µs to acquireMachinesLock for "ha-213000-m02"
I1105 10:01:32.005235 19703 start.go:93] Provisioning new machine with config: &{Name:ha-213000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19883/minikube-v1.34.0-1730282777-19883-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.31.2 ClusterName:ha-213000 Namespace:default APIServerHAVIP:192.169.0.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.169.0.5 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks
:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
I1105 10:01:32.005275 19703 start.go:125] createHost starting for "m02" (driver="hyperkit")
I1105 10:01:32.026387 19703 out.go:235] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I1105 10:01:32.026549 19703 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1105 10:01:32.026581 19703 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1105 10:01:32.038441 19703 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:57652
I1105 10:01:32.038798 19703 main.go:141] libmachine: () Calling .GetVersion
I1105 10:01:32.039196 19703 main.go:141] libmachine: Using API Version 1
I1105 10:01:32.039218 19703 main.go:141] libmachine: () Calling .SetConfigRaw
I1105 10:01:32.039447 19703 main.go:141] libmachine: () Calling .GetMachineName
I1105 10:01:32.039560 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetMachineName
I1105 10:01:32.039666 19703 main.go:141] libmachine: (ha-213000-m02) Calling .DriverName
I1105 10:01:32.039774 19703 start.go:159] libmachine.API.Create for "ha-213000" (driver="hyperkit")
I1105 10:01:32.039792 19703 client.go:168] LocalClient.Create starting
I1105 10:01:32.039824 19703 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem
I1105 10:01:32.039866 19703 main.go:141] libmachine: Decoding PEM data...
I1105 10:01:32.039878 19703 main.go:141] libmachine: Parsing certificate...
I1105 10:01:32.039917 19703 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/cert.pem
I1105 10:01:32.039950 19703 main.go:141] libmachine: Decoding PEM data...
I1105 10:01:32.039959 19703 main.go:141] libmachine: Parsing certificate...
I1105 10:01:32.039978 19703 main.go:141] libmachine: Running pre-create checks...
I1105 10:01:32.039982 19703 main.go:141] libmachine: (ha-213000-m02) Calling .PreCreateCheck
I1105 10:01:32.040065 19703 main.go:141] libmachine: (ha-213000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:01:32.040093 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetConfigRaw
I1105 10:01:32.047652 19703 main.go:141] libmachine: Creating machine...
I1105 10:01:32.047661 19703 main.go:141] libmachine: (ha-213000-m02) Calling .Create
I1105 10:01:32.047736 19703 main.go:141] libmachine: (ha-213000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:01:32.047898 19703 main.go:141] libmachine: (ha-213000-m02) DBG | I1105 10:01:32.047732 19737 common.go:144] Making disk image using store path: /Users/jenkins/minikube-integration/19910-17277/.minikube
I1105 10:01:32.047955 19703 main.go:141] libmachine: (ha-213000-m02) Downloading /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19910-17277/.minikube/cache/iso/amd64/minikube-v1.34.0-1730282777-19883-amd64.iso...
I1105 10:01:32.258405 19703 main.go:141] libmachine: (ha-213000-m02) DBG | I1105 10:01:32.258328 19737 common.go:151] Creating ssh key: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/id_rsa...
I1105 10:01:32.370475 19703 main.go:141] libmachine: (ha-213000-m02) DBG | I1105 10:01:32.370420 19737 common.go:157] Creating raw disk image: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/ha-213000-m02.rawdisk...
I1105 10:01:32.370496 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Writing magic tar header
I1105 10:01:32.370504 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Writing SSH key tar header
I1105 10:01:32.371373 19703 main.go:141] libmachine: (ha-213000-m02) DBG | I1105 10:01:32.371253 19737 common.go:171] Fixing permissions on /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02 ...
I1105 10:01:32.760483 19703 main.go:141] libmachine: (ha-213000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:01:32.760499 19703 main.go:141] libmachine: (ha-213000-m02) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/hyperkit.pid
I1105 10:01:32.760532 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Using UUID 8475f971-284e-486e-b8b0-772de8e0415c
I1105 10:01:32.785150 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Generated MAC 4a:4e:c6:49:69:60
I1105 10:01:32.785168 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=ha-213000
I1105 10:01:32.785208 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:32 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"8475f971-284e-486e-b8b0-772de8e0415c", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0001d21e0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/bzimage", Initrd:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Process)(nil)}
I1105 10:01:32.785232 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:32 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"8475f971-284e-486e-b8b0-772de8e0415c", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0001d21e0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/bzimage", Initrd:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Process)(nil)}
I1105 10:01:32.785286 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:32 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "8475f971-284e-486e-b8b0-772de8e0415c", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/ha-213000-m02.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/tty,log=/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/bzimage,/Users/jenkins/minikube-integration/19910-17277/.minikube/
machines/ha-213000-m02/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=ha-213000"}
I1105 10:01:32.785316 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:32 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U 8475f971-284e-486e-b8b0-772de8e0415c -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/ha-213000-m02.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/tty,log=/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/console-ring -f kexec,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/bzimage,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/initrd,earlyprintk=serial loglevel=3 co
nsole=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=ha-213000"
I1105 10:01:32.785326 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:32 DEBUG: hyperkit: Redirecting stdout/stderr to logger
I1105 10:01:32.788392 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:32 DEBUG: hyperkit: Pid is 19738
I1105 10:01:32.789760 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Attempt 0
I1105 10:01:32.789776 19703 main.go:141] libmachine: (ha-213000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:01:32.789838 19703 main.go:141] libmachine: (ha-213000-m02) DBG | hyperkit pid from json: 19738
I1105 10:01:32.790923 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Searching for 4a:4e:c6:49:69:60 in /var/db/dhcpd_leases ...
I1105 10:01:32.791036 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Found 4 entries in /var/db/dhcpd_leases!
I1105 10:01:32.791047 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:82:fc:3d:82:28:7c ID:1,82:fc:3d:82:28:7c Lease:0x672a6b6b}
I1105 10:01:32.791055 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:0a:f2:13:1f:4d:a9 ID:1,a:f2:13:1f:4d:a9 Lease:0x672a6979}
I1105 10:01:32.791063 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:42:36:6d:50:88:43 ID:1,42:36:6d:50:88:43 Lease:0x672a68b2}
I1105 10:01:32.791071 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.2 HWAddress:8a:ae:5d:dc:69:d7 ID:1,8a:ae:5d:dc:69:d7 Lease:0x672a66c1}
I1105 10:01:32.799256 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:32 INFO : hyperkit: stderr: Using fd 6 for I/O notifications
I1105 10:01:32.810076 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:32 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD
I1105 10:01:32.811011 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:32 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I1105 10:01:32.811039 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:32 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I1105 10:01:32.811065 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:32 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I1105 10:01:32.811083 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:32 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I1105 10:01:33.216124 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:33 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0
I1105 10:01:33.216141 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:33 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0
I1105 10:01:33.331141 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:33 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I1105 10:01:33.331187 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:33 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I1105 10:01:33.331200 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:33 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I1105 10:01:33.331210 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:33 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I1105 10:01:33.331930 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:33 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1
I1105 10:01:33.331952 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:33 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1
I1105 10:01:34.791292 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Attempt 1
I1105 10:01:34.791308 19703 main.go:141] libmachine: (ha-213000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:01:34.791415 19703 main.go:141] libmachine: (ha-213000-m02) DBG | hyperkit pid from json: 19738
I1105 10:01:34.792404 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Searching for 4a:4e:c6:49:69:60 in /var/db/dhcpd_leases ...
I1105 10:01:34.792463 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Found 4 entries in /var/db/dhcpd_leases!
I1105 10:01:34.792476 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:82:fc:3d:82:28:7c ID:1,82:fc:3d:82:28:7c Lease:0x672a6b6b}
I1105 10:01:34.792486 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:0a:f2:13:1f:4d:a9 ID:1,a:f2:13:1f:4d:a9 Lease:0x672a6979}
I1105 10:01:34.792493 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:42:36:6d:50:88:43 ID:1,42:36:6d:50:88:43 Lease:0x672a68b2}
I1105 10:01:34.792500 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.2 HWAddress:8a:ae:5d:dc:69:d7 ID:1,8a:ae:5d:dc:69:d7 Lease:0x672a66c1}
I1105 10:01:36.794004 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Attempt 2
I1105 10:01:36.794019 19703 main.go:141] libmachine: (ha-213000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:01:36.794104 19703 main.go:141] libmachine: (ha-213000-m02) DBG | hyperkit pid from json: 19738
I1105 10:01:36.795044 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Searching for 4a:4e:c6:49:69:60 in /var/db/dhcpd_leases ...
I1105 10:01:36.795099 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Found 4 entries in /var/db/dhcpd_leases!
I1105 10:01:36.795107 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:82:fc:3d:82:28:7c ID:1,82:fc:3d:82:28:7c Lease:0x672a6b6b}
I1105 10:01:36.795115 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:0a:f2:13:1f:4d:a9 ID:1,a:f2:13:1f:4d:a9 Lease:0x672a6979}
I1105 10:01:36.795123 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:42:36:6d:50:88:43 ID:1,42:36:6d:50:88:43 Lease:0x672a68b2}
I1105 10:01:36.795143 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.2 HWAddress:8a:ae:5d:dc:69:d7 ID:1,8a:ae:5d:dc:69:d7 Lease:0x672a66c1}
I1105 10:01:38.796117 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Attempt 3
I1105 10:01:38.796134 19703 main.go:141] libmachine: (ha-213000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:01:38.796192 19703 main.go:141] libmachine: (ha-213000-m02) DBG | hyperkit pid from json: 19738
I1105 10:01:38.797137 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Searching for 4a:4e:c6:49:69:60 in /var/db/dhcpd_leases ...
I1105 10:01:38.797198 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Found 4 entries in /var/db/dhcpd_leases!
I1105 10:01:38.797207 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:82:fc:3d:82:28:7c ID:1,82:fc:3d:82:28:7c Lease:0x672a6b6b}
I1105 10:01:38.797215 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:0a:f2:13:1f:4d:a9 ID:1,a:f2:13:1f:4d:a9 Lease:0x672a6979}
I1105 10:01:38.797220 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:42:36:6d:50:88:43 ID:1,42:36:6d:50:88:43 Lease:0x672a68b2}
I1105 10:01:38.797228 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.2 HWAddress:8a:ae:5d:dc:69:d7 ID:1,8a:ae:5d:dc:69:d7 Lease:0x672a66c1}
I1105 10:01:39.085812 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:39 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1
I1105 10:01:39.085887 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:39 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1
I1105 10:01:39.085896 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:39 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1
I1105 10:01:39.108556 19703 main.go:141] libmachine: (ha-213000-m02) DBG | 2024/11/05 10:01:39 INFO : hyperkit: stderr: rdmsr to register 0xc0011029 on vcpu 1
I1105 10:01:40.797630 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Attempt 4
I1105 10:01:40.797646 19703 main.go:141] libmachine: (ha-213000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:01:40.797725 19703 main.go:141] libmachine: (ha-213000-m02) DBG | hyperkit pid from json: 19738
I1105 10:01:40.798681 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Searching for 4a:4e:c6:49:69:60 in /var/db/dhcpd_leases ...
I1105 10:01:40.798749 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Found 4 entries in /var/db/dhcpd_leases!
I1105 10:01:40.798757 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:82:fc:3d:82:28:7c ID:1,82:fc:3d:82:28:7c Lease:0x672a6b6b}
I1105 10:01:40.798766 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:0a:f2:13:1f:4d:a9 ID:1,a:f2:13:1f:4d:a9 Lease:0x672a6979}
I1105 10:01:40.798773 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:42:36:6d:50:88:43 ID:1,42:36:6d:50:88:43 Lease:0x672a68b2}
I1105 10:01:40.798785 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.2 HWAddress:8a:ae:5d:dc:69:d7 ID:1,8a:ae:5d:dc:69:d7 Lease:0x672a66c1}
I1105 10:01:42.800804 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Attempt 5
I1105 10:01:42.800819 19703 main.go:141] libmachine: (ha-213000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:01:42.800888 19703 main.go:141] libmachine: (ha-213000-m02) DBG | hyperkit pid from json: 19738
I1105 10:01:42.801843 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Searching for 4a:4e:c6:49:69:60 in /var/db/dhcpd_leases ...
I1105 10:01:42.801914 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Found 5 entries in /var/db/dhcpd_leases!
I1105 10:01:42.801923 19703 main.go:141] libmachine: (ha-213000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.6 HWAddress:4a:4e:c6:49:69:60 ID:1,4a:4e:c6:49:69:60 Lease:0x672a6b96}
I1105 10:01:42.801933 19703 main.go:141] libmachine: (ha-213000-m02) DBG | Found match: 4a:4e:c6:49:69:60
I1105 10:01:42.801939 19703 main.go:141] libmachine: (ha-213000-m02) DBG | IP: 192.169.0.6
I1105 10:01:42.802006 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetConfigRaw
I1105 10:01:42.802642 19703 main.go:141] libmachine: (ha-213000-m02) Calling .DriverName
I1105 10:01:42.802744 19703 main.go:141] libmachine: (ha-213000-m02) Calling .DriverName
I1105 10:01:42.802850 19703 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I1105 10:01:42.802857 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetState
I1105 10:01:42.802937 19703 main.go:141] libmachine: (ha-213000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:01:42.802999 19703 main.go:141] libmachine: (ha-213000-m02) DBG | hyperkit pid from json: 19738
I1105 10:01:42.803924 19703 main.go:141] libmachine: Detecting operating system of created instance...
I1105 10:01:42.803931 19703 main.go:141] libmachine: Waiting for SSH to be available...
I1105 10:01:42.803935 19703 main.go:141] libmachine: Getting to WaitForSSH function...
I1105 10:01:42.803939 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHHostname
I1105 10:01:42.804024 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHPort
I1105 10:01:42.804111 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:42.804205 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:42.804300 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHUsername
I1105 10:01:42.804436 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:01:42.804615 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.6 22 <nil> <nil>}
I1105 10:01:42.804623 19703 main.go:141] libmachine: About to run SSH command:
exit 0
I1105 10:01:43.860176 19703 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1105 10:01:43.860188 19703 main.go:141] libmachine: Detecting the provisioner...
I1105 10:01:43.860194 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHHostname
I1105 10:01:43.860339 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHPort
I1105 10:01:43.860450 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:43.860549 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:43.860635 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHUsername
I1105 10:01:43.860782 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:01:43.860934 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.6 22 <nil> <nil>}
I1105 10:01:43.860943 19703 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I1105 10:01:43.918908 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I1105 10:01:43.918939 19703 main.go:141] libmachine: found compatible host: buildroot
I1105 10:01:43.918944 19703 main.go:141] libmachine: Provisioning with buildroot...
I1105 10:01:43.918953 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetMachineName
I1105 10:01:43.919089 19703 buildroot.go:166] provisioning hostname "ha-213000-m02"
I1105 10:01:43.919101 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetMachineName
I1105 10:01:43.919200 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHHostname
I1105 10:01:43.919297 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHPort
I1105 10:01:43.919385 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:43.919473 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:43.919562 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHUsername
I1105 10:01:43.919750 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:01:43.919884 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.6 22 <nil> <nil>}
I1105 10:01:43.919892 19703 main.go:141] libmachine: About to run SSH command:
sudo hostname ha-213000-m02 && echo "ha-213000-m02" | sudo tee /etc/hostname
I1105 10:01:43.986937 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-213000-m02
I1105 10:01:43.986952 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHHostname
I1105 10:01:43.987088 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHPort
I1105 10:01:43.987192 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:43.987282 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:43.987385 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHUsername
I1105 10:01:43.987525 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:01:43.987656 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.6 22 <nil> <nil>}
I1105 10:01:43.987668 19703 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sha-213000-m02' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-213000-m02/g' /etc/hosts;
else
echo '127.0.1.1 ha-213000-m02' | sudo tee -a /etc/hosts;
fi
fi
I1105 10:01:44.049824 19703 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1105 10:01:44.049837 19703 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19910-17277/.minikube CaCertPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19910-17277/.minikube}
I1105 10:01:44.049852 19703 buildroot.go:174] setting up certificates
I1105 10:01:44.049859 19703 provision.go:84] configureAuth start
I1105 10:01:44.049865 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetMachineName
I1105 10:01:44.050000 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetIP
I1105 10:01:44.050104 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHHostname
I1105 10:01:44.050210 19703 provision.go:143] copyHostCerts
I1105 10:01:44.050243 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.pem
I1105 10:01:44.050287 19703 exec_runner.go:144] found /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.pem, removing ...
I1105 10:01:44.050293 19703 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.pem
I1105 10:01:44.050418 19703 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.pem (1082 bytes)
I1105 10:01:44.050628 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/19910-17277/.minikube/cert.pem
I1105 10:01:44.050658 19703 exec_runner.go:144] found /Users/jenkins/minikube-integration/19910-17277/.minikube/cert.pem, removing ...
I1105 10:01:44.050663 19703 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19910-17277/.minikube/cert.pem
I1105 10:01:44.050731 19703 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19910-17277/.minikube/cert.pem (1123 bytes)
I1105 10:01:44.050902 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/19910-17277/.minikube/key.pem
I1105 10:01:44.050930 19703 exec_runner.go:144] found /Users/jenkins/minikube-integration/19910-17277/.minikube/key.pem, removing ...
I1105 10:01:44.050935 19703 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19910-17277/.minikube/key.pem
I1105 10:01:44.050999 19703 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19910-17277/.minikube/key.pem (1675 bytes)
I1105 10:01:44.051159 19703 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca-key.pem org=jenkins.ha-213000-m02 san=[127.0.0.1 192.169.0.6 ha-213000-m02 localhost minikube]
I1105 10:01:44.155430 19703 provision.go:177] copyRemoteCerts
I1105 10:01:44.155494 19703 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1105 10:01:44.155508 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHHostname
I1105 10:01:44.155652 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHPort
I1105 10:01:44.155761 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:44.155855 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHUsername
I1105 10:01:44.155960 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.6 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/id_rsa Username:docker}
I1105 10:01:44.190390 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I1105 10:01:44.190459 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1105 10:01:44.209956 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server.pem -> /etc/docker/server.pem
I1105 10:01:44.210020 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I1105 10:01:44.229611 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I1105 10:01:44.229678 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1105 10:01:44.249732 19703 provision.go:87] duration metric: took 199.867169ms to configureAuth
I1105 10:01:44.249751 19703 buildroot.go:189] setting minikube options for container-runtime
I1105 10:01:44.249884 19703 config.go:182] Loaded profile config "ha-213000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1105 10:01:44.249897 19703 main.go:141] libmachine: (ha-213000-m02) Calling .DriverName
I1105 10:01:44.250035 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHHostname
I1105 10:01:44.250145 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHPort
I1105 10:01:44.250227 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:44.250309 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:44.250384 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHUsername
I1105 10:01:44.250517 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:01:44.250642 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.6 22 <nil> <nil>}
I1105 10:01:44.250651 19703 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I1105 10:01:44.307473 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I1105 10:01:44.307484 19703 buildroot.go:70] root file system type: tmpfs
I1105 10:01:44.307570 19703 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I1105 10:01:44.307582 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHHostname
I1105 10:01:44.307713 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHPort
I1105 10:01:44.307800 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:44.307896 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:44.307984 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHUsername
I1105 10:01:44.308146 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:01:44.308285 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.6 22 <nil> <nil>}
I1105 10:01:44.308329 19703 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
Environment="NO_PROXY=192.169.0.5"
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I1105 10:01:44.374560 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
Environment=NO_PROXY=192.169.0.5
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I1105 10:01:44.374579 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHHostname
I1105 10:01:44.374715 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHPort
I1105 10:01:44.374811 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:44.374905 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:44.374997 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHUsername
I1105 10:01:44.375155 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:01:44.375292 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.6 22 <nil> <nil>}
I1105 10:01:44.375306 19703 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I1105 10:01:45.916909 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I1105 10:01:45.916923 19703 main.go:141] libmachine: Checking connection to Docker...
I1105 10:01:45.916928 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetURL
I1105 10:01:45.917079 19703 main.go:141] libmachine: Docker is up and running!
I1105 10:01:45.917088 19703 main.go:141] libmachine: Reticulating splines...
I1105 10:01:45.917094 19703 client.go:171] duration metric: took 13.877421847s to LocalClient.Create
I1105 10:01:45.917107 19703 start.go:167] duration metric: took 13.877464427s to libmachine.API.Create "ha-213000"
I1105 10:01:45.917113 19703 start.go:293] postStartSetup for "ha-213000-m02" (driver="hyperkit")
I1105 10:01:45.917119 19703 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1105 10:01:45.917129 19703 main.go:141] libmachine: (ha-213000-m02) Calling .DriverName
I1105 10:01:45.917290 19703 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1105 10:01:45.917304 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHHostname
I1105 10:01:45.917390 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHPort
I1105 10:01:45.917474 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:45.917556 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHUsername
I1105 10:01:45.917651 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.6 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/id_rsa Username:docker}
I1105 10:01:45.954621 19703 ssh_runner.go:195] Run: cat /etc/os-release
I1105 10:01:45.963284 19703 info.go:137] Remote host: Buildroot 2023.02.9
I1105 10:01:45.963298 19703 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19910-17277/.minikube/addons for local assets ...
I1105 10:01:45.963394 19703 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19910-17277/.minikube/files for local assets ...
I1105 10:01:45.963534 19703 filesync.go:149] local asset: /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem -> 178422.pem in /etc/ssl/certs
I1105 10:01:45.963541 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem -> /etc/ssl/certs/178422.pem
I1105 10:01:45.963709 19703 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1105 10:01:45.974744 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem --> /etc/ssl/certs/178422.pem (1708 bytes)
I1105 10:01:46.007617 19703 start.go:296] duration metric: took 90.496072ms for postStartSetup
I1105 10:01:46.007644 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetConfigRaw
I1105 10:01:46.008278 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetIP
I1105 10:01:46.008431 19703 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/config.json ...
I1105 10:01:46.008809 19703 start.go:128] duration metric: took 14.00365458s to createHost
I1105 10:01:46.008826 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHHostname
I1105 10:01:46.008921 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHPort
I1105 10:01:46.009026 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:46.009114 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:46.009199 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHUsername
I1105 10:01:46.009324 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:01:46.009442 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.6 22 <nil> <nil>}
I1105 10:01:46.009449 19703 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I1105 10:01:46.065399 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: 1730829706.339878187
I1105 10:01:46.065410 19703 fix.go:216] guest clock: 1730829706.339878187
I1105 10:01:46.065415 19703 fix.go:229] Guest: 2024-11-05 10:01:46.339878187 -0800 PST Remote: 2024-11-05 10:01:46.00882 -0800 PST m=+57.574793708 (delta=331.058187ms)
I1105 10:01:46.065424 19703 fix.go:200] guest clock delta is within tolerance: 331.058187ms
I1105 10:01:46.065428 19703 start.go:83] releasing machines lock for "ha-213000-m02", held for 14.060329703s
I1105 10:01:46.065445 19703 main.go:141] libmachine: (ha-213000-m02) Calling .DriverName
I1105 10:01:46.065576 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetIP
I1105 10:01:46.087717 19703 out.go:177] * Found network options:
I1105 10:01:46.109842 19703 out.go:177] - NO_PROXY=192.169.0.5
W1105 10:01:46.131999 19703 proxy.go:119] fail to check proxy env: Error ip not in block
I1105 10:01:46.132065 19703 main.go:141] libmachine: (ha-213000-m02) Calling .DriverName
I1105 10:01:46.132924 19703 main.go:141] libmachine: (ha-213000-m02) Calling .DriverName
I1105 10:01:46.133189 19703 main.go:141] libmachine: (ha-213000-m02) Calling .DriverName
I1105 10:01:46.133350 19703 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1105 10:01:46.133419 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHHostname
W1105 10:01:46.133425 19703 proxy.go:119] fail to check proxy env: Error ip not in block
I1105 10:01:46.133511 19703 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1105 10:01:46.133525 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHHostname
I1105 10:01:46.133564 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHPort
I1105 10:01:46.133658 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHPort
I1105 10:01:46.133724 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:46.133792 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHKeyPath
I1105 10:01:46.133856 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHUsername
I1105 10:01:46.133913 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetSSHUsername
I1105 10:01:46.133985 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.6 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/id_rsa Username:docker}
I1105 10:01:46.134067 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.6 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m02/id_rsa Username:docker}
W1105 10:01:46.166296 19703 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1105 10:01:46.166372 19703 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1105 10:01:46.210783 19703 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1105 10:01:46.210798 19703 start.go:495] detecting cgroup driver to use...
I1105 10:01:46.210864 19703 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1105 10:01:46.225606 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I1105 10:01:46.234567 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1105 10:01:46.243434 19703 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I1105 10:01:46.243498 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I1105 10:01:46.252254 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1105 10:01:46.260991 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1105 10:01:46.269783 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1105 10:01:46.278460 19703 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1105 10:01:46.287315 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1105 10:01:46.296362 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I1105 10:01:46.305259 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I1105 10:01:46.314314 19703 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1105 10:01:46.322151 19703 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I1105 10:01:46.322203 19703 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I1105 10:01:46.331333 19703 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1105 10:01:46.339411 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:01:46.437814 19703 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1105 10:01:46.456976 19703 start.go:495] detecting cgroup driver to use...
I1105 10:01:46.457074 19703 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I1105 10:01:46.473512 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1105 10:01:46.487971 19703 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1105 10:01:46.501912 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1105 10:01:46.512646 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1105 10:01:46.523147 19703 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1105 10:01:46.545158 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1105 10:01:46.555335 19703 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I1105 10:01:46.570377 19703 ssh_runner.go:195] Run: which cri-dockerd
I1105 10:01:46.573322 19703 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I1105 10:01:46.580455 19703 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)
I1105 10:01:46.594087 19703 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I1105 10:01:46.688786 19703 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I1105 10:01:46.806047 19703 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I1105 10:01:46.806077 19703 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I1105 10:01:46.821570 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:01:46.919986 19703 ssh_runner.go:195] Run: sudo systemctl restart docker
I1105 10:01:49.283369 19703 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.363383588s)
I1105 10:01:49.283454 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
I1105 10:01:49.293731 19703 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket
I1105 10:01:49.306548 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I1105 10:01:49.317994 19703 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I1105 10:01:49.421101 19703 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I1105 10:01:49.523439 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:01:49.641875 19703 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I1105 10:01:49.655594 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I1105 10:01:49.667711 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:01:49.787298 19703 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
I1105 10:01:49.845991 19703 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
I1105 10:01:49.846096 19703 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I1105 10:01:49.851066 19703 start.go:563] Will wait 60s for crictl version
I1105 10:01:49.851131 19703 ssh_runner.go:195] Run: which crictl
I1105 10:01:49.854437 19703 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1105 10:01:49.883943 19703 start.go:579] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 27.3.1
RuntimeApiVersion: v1
I1105 10:01:49.884034 19703 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I1105 10:01:49.900385 19703 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I1105 10:01:49.958496 19703 out.go:235] * Preparing Kubernetes v1.31.2 on Docker 27.3.1 ...
I1105 10:01:50.015373 19703 out.go:177] - env NO_PROXY=192.169.0.5
I1105 10:01:50.036835 19703 main.go:141] libmachine: (ha-213000-m02) Calling .GetIP
I1105 10:01:50.037289 19703 ssh_runner.go:195] Run: grep 192.169.0.1 host.minikube.internal$ /etc/hosts
I1105 10:01:50.041454 19703 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.169.0.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1105 10:01:50.051908 19703 mustload.go:65] Loading cluster: ha-213000
I1105 10:01:50.052063 19703 config.go:182] Loaded profile config "ha-213000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1105 10:01:50.052290 19703 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1105 10:01:50.052318 19703 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1105 10:01:50.063943 19703 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:57675
I1105 10:01:50.064254 19703 main.go:141] libmachine: () Calling .GetVersion
I1105 10:01:50.064622 19703 main.go:141] libmachine: Using API Version 1
I1105 10:01:50.064639 19703 main.go:141] libmachine: () Calling .SetConfigRaw
I1105 10:01:50.064857 19703 main.go:141] libmachine: () Calling .GetMachineName
I1105 10:01:50.064943 19703 main.go:141] libmachine: (ha-213000) Calling .GetState
I1105 10:01:50.065040 19703 main.go:141] libmachine: (ha-213000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:01:50.065101 19703 main.go:141] libmachine: (ha-213000) DBG | hyperkit pid from json: 19716
I1105 10:01:50.066239 19703 host.go:66] Checking if "ha-213000" exists ...
I1105 10:01:50.066502 19703 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1105 10:01:50.066538 19703 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1105 10:01:50.077511 19703 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:57677
I1105 10:01:50.077820 19703 main.go:141] libmachine: () Calling .GetVersion
I1105 10:01:50.078153 19703 main.go:141] libmachine: Using API Version 1
I1105 10:01:50.078165 19703 main.go:141] libmachine: () Calling .SetConfigRaw
I1105 10:01:50.078378 19703 main.go:141] libmachine: () Calling .GetMachineName
I1105 10:01:50.078491 19703 main.go:141] libmachine: (ha-213000) Calling .DriverName
I1105 10:01:50.078597 19703 certs.go:68] Setting up /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000 for IP: 192.169.0.6
I1105 10:01:50.078603 19703 certs.go:194] generating shared ca certs ...
I1105 10:01:50.078614 19703 certs.go:226] acquiring lock for ca certs: {Name:mk71cfd5cfa6f19aa54770800e673e4533fb7d9c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:01:50.078762 19703 certs.go:235] skipping valid "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.key
I1105 10:01:50.078814 19703 certs.go:235] skipping valid "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/proxy-client-ca.key
I1105 10:01:50.078823 19703 certs.go:256] generating profile certs ...
I1105 10:01:50.078932 19703 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/client.key
I1105 10:01:50.078952 19703 certs.go:363] generating signed profile cert for "minikube": /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key.72f96614
I1105 10:01:50.078965 19703 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt.72f96614 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.169.0.5 192.169.0.6 192.169.0.254]
I1105 10:01:50.259675 19703 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt.72f96614 ...
I1105 10:01:50.259696 19703 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt.72f96614: {Name:mk88a6c605d32cdc699192a3b9f65c36d4d8999e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:01:50.260061 19703 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key.72f96614 ...
I1105 10:01:50.260070 19703 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key.72f96614: {Name:mk09cfa8a7c58367d4fd503cdc6b46cb11ab646e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:01:50.260325 19703 certs.go:381] copying /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt.72f96614 -> /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt
I1105 10:01:50.260527 19703 certs.go:385] copying /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key.72f96614 -> /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key
I1105 10:01:50.260749 19703 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.key
I1105 10:01:50.260759 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I1105 10:01:50.260781 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I1105 10:01:50.260800 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I1105 10:01:50.260819 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I1105 10:01:50.260838 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I1105 10:01:50.260856 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I1105 10:01:50.260874 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I1105 10:01:50.260893 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I1105 10:01:50.260970 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/17842.pem (1338 bytes)
W1105 10:01:50.261007 19703 certs.go:480] ignoring /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/17842_empty.pem, impossibly tiny 0 bytes
I1105 10:01:50.261015 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca-key.pem (1679 bytes)
I1105 10:01:50.261049 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem (1082 bytes)
I1105 10:01:50.261078 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/cert.pem (1123 bytes)
I1105 10:01:50.261106 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/key.pem (1675 bytes)
I1105 10:01:50.261167 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem (1708 bytes)
I1105 10:01:50.261198 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/17842.pem -> /usr/share/ca-certificates/17842.pem
I1105 10:01:50.261219 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem -> /usr/share/ca-certificates/178422.pem
I1105 10:01:50.261239 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I1105 10:01:50.261271 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:50.261425 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:01:50.261537 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:50.261637 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:01:50.261724 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/id_rsa Username:docker}
I1105 10:01:50.291214 19703 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
I1105 10:01:50.295029 19703 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
I1105 10:01:50.304845 19703 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
I1105 10:01:50.308184 19703 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
I1105 10:01:50.316387 19703 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
I1105 10:01:50.319596 19703 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
I1105 10:01:50.337836 19703 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
I1105 10:01:50.342163 19703 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
I1105 10:01:50.351433 19703 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
I1105 10:01:50.354494 19703 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
I1105 10:01:50.362620 19703 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
I1105 10:01:50.365669 19703 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1675 bytes)
I1105 10:01:50.373430 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1105 10:01:50.393167 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1105 10:01:50.412948 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1105 10:01:50.433246 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1105 10:01:50.454659 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)
I1105 10:01:50.476244 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1105 10:01:50.497382 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1105 10:01:50.518008 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1105 10:01:50.539746 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/17842.pem --> /usr/share/ca-certificates/17842.pem (1338 bytes)
I1105 10:01:50.559947 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem --> /usr/share/ca-certificates/178422.pem (1708 bytes)
I1105 10:01:50.580509 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1105 10:01:50.600953 19703 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
I1105 10:01:50.615539 19703 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
I1105 10:01:50.631388 19703 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
I1105 10:01:50.646013 19703 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
I1105 10:01:50.660722 19703 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
I1105 10:01:50.675559 19703 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1675 bytes)
I1105 10:01:50.690207 19703 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
I1105 10:01:50.705146 19703 ssh_runner.go:195] Run: openssl version
I1105 10:01:50.709852 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/17842.pem && ln -fs /usr/share/ca-certificates/17842.pem /etc/ssl/certs/17842.pem"
I1105 10:01:50.720235 19703 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/17842.pem
I1105 10:01:50.724017 19703 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 5 17:52 /usr/share/ca-certificates/17842.pem
I1105 10:01:50.724092 19703 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/17842.pem
I1105 10:01:50.728732 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/17842.pem /etc/ssl/certs/51391683.0"
I1105 10:01:50.738807 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/178422.pem && ln -fs /usr/share/ca-certificates/178422.pem /etc/ssl/certs/178422.pem"
I1105 10:01:50.748691 19703 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/178422.pem
I1105 10:01:50.752394 19703 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 5 17:52 /usr/share/ca-certificates/178422.pem
I1105 10:01:50.752467 19703 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/178422.pem
I1105 10:01:50.757374 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/178422.pem /etc/ssl/certs/3ec20f2e.0"
I1105 10:01:50.767503 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1105 10:01:50.777410 19703 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1105 10:01:50.781104 19703 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 5 17:43 /usr/share/ca-certificates/minikubeCA.pem
I1105 10:01:50.781174 19703 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1105 10:01:50.785786 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1105 10:01:50.795583 19703 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1105 10:01:50.798943 19703 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1105 10:01:50.798984 19703 kubeadm.go:934] updating node {m02 192.169.0.6 8443 v1.31.2 docker true true} ...
I1105 10:01:50.799037 19703 kubeadm.go:946] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-213000-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.169.0.6
[Install]
config:
{KubernetesVersion:v1.31.2 ClusterName:ha-213000 Namespace:default APIServerHAVIP:192.169.0.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1105 10:01:50.799054 19703 kube-vip.go:115] generating kube-vip config ...
I1105 10:01:50.799124 19703 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"
I1105 10:01:50.814293 19703 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip
I1105 10:01:50.814341 19703 kube-vip.go:137] kube-vip config:
apiVersion: v1
kind: Pod
metadata:
creationTimestamp: null
name: kube-vip
namespace: kube-system
spec:
containers:
- args:
- manager
env:
- name: vip_arp
value: "true"
- name: port
value: "8443"
- name: vip_nodename
valueFrom:
fieldRef:
fieldPath: spec.nodeName
- name: vip_interface
value: eth0
- name: vip_cidr
value: "32"
- name: dns_mode
value: first
- name: cp_enable
value: "true"
- name: cp_namespace
value: kube-system
- name: vip_leaderelection
value: "true"
- name: vip_leasename
value: plndr-cp-lock
- name: vip_leaseduration
value: "5"
- name: vip_renewdeadline
value: "3"
- name: vip_retryperiod
value: "1"
- name: address
value: 192.169.0.254
- name: prometheus_server
value: :2112
- name : lb_enable
value: "true"
- name: lb_port
value: "8443"
image: ghcr.io/kube-vip/kube-vip:v0.8.6
imagePullPolicy: IfNotPresent
name: kube-vip
resources: {}
securityContext:
capabilities:
add:
- NET_ADMIN
- NET_RAW
volumeMounts:
- mountPath: /etc/kubernetes/admin.conf
name: kubeconfig
hostAliases:
- hostnames:
- kubernetes
ip: 127.0.0.1
hostNetwork: true
volumes:
- hostPath:
path: "/etc/kubernetes/admin.conf"
name: kubeconfig
status: {}
I1105 10:01:50.814416 19703 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.2
I1105 10:01:50.823146 19703 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.31.2: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/binaries/v1.31.2': No such file or directory
Initiating transfer...
I1105 10:01:50.823227 19703 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.31.2
I1105 10:01:50.832606 19703 download.go:107] Downloading: https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubectl.sha256 -> /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/linux/amd64/v1.31.2/kubectl
I1105 10:01:50.832611 19703 download.go:107] Downloading: https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubelet.sha256 -> /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/linux/amd64/v1.31.2/kubelet
I1105 10:01:50.832606 19703 download.go:107] Downloading: https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubeadm.sha256 -> /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/linux/amd64/v1.31.2/kubeadm
I1105 10:01:53.130716 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/linux/amd64/v1.31.2/kubectl -> /var/lib/minikube/binaries/v1.31.2/kubectl
I1105 10:01:53.131358 19703 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubectl
I1105 10:01:53.135037 19703 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubectl: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubectl: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubectl': No such file or directory
I1105 10:01:53.135071 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/linux/amd64/v1.31.2/kubectl --> /var/lib/minikube/binaries/v1.31.2/kubectl (56381592 bytes)
I1105 10:01:53.503819 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/linux/amd64/v1.31.2/kubeadm -> /var/lib/minikube/binaries/v1.31.2/kubeadm
I1105 10:01:53.503977 19703 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubeadm
I1105 10:01:53.507746 19703 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubeadm: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubeadm: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubeadm': No such file or directory
I1105 10:01:53.507776 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/linux/amd64/v1.31.2/kubeadm --> /var/lib/minikube/binaries/v1.31.2/kubeadm (58290328 bytes)
I1105 10:01:54.433884 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1105 10:01:54.445780 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/linux/amd64/v1.31.2/kubelet -> /var/lib/minikube/binaries/v1.31.2/kubelet
I1105 10:01:54.449919 19703 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubelet
I1105 10:01:54.453259 19703 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubelet: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubelet: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubelet': No such file or directory
I1105 10:01:54.453278 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/linux/amd64/v1.31.2/kubelet --> /var/lib/minikube/binaries/v1.31.2/kubelet (76902744 bytes)
I1105 10:01:54.698228 19703 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
I1105 10:01:54.705621 19703 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (311 bytes)
I1105 10:01:54.719140 19703 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1105 10:01:54.732989 19703 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1440 bytes)
I1105 10:01:54.747064 19703 ssh_runner.go:195] Run: grep 192.169.0.254 control-plane.minikube.internal$ /etc/hosts
I1105 10:01:54.750001 19703 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.169.0.254 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1105 10:01:54.764611 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:01:54.865217 19703 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1105 10:01:54.881672 19703 host.go:66] Checking if "ha-213000" exists ...
I1105 10:01:54.881968 19703 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1105 10:01:54.881993 19703 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1105 10:01:54.911777 19703 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:57704
I1105 10:01:54.912101 19703 main.go:141] libmachine: () Calling .GetVersion
I1105 10:01:54.912484 19703 main.go:141] libmachine: Using API Version 1
I1105 10:01:54.912500 19703 main.go:141] libmachine: () Calling .SetConfigRaw
I1105 10:01:54.912742 19703 main.go:141] libmachine: () Calling .GetMachineName
I1105 10:01:54.912836 19703 main.go:141] libmachine: (ha-213000) Calling .DriverName
I1105 10:01:54.912927 19703 start.go:317] joinCluster: &{Name:ha-213000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19883/minikube-v1.34.0-1730282777-19883-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 Clu
sterName:ha-213000 Namespace:default APIServerHAVIP:192.169.0.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.169.0.5 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.169.0.6 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpira
tion:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1105 10:01:54.913009 19703 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm token create --print-join-command --ttl=0"
I1105 10:01:54.913021 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:01:54.913107 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:01:54.913205 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:01:54.913312 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:01:54.913396 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/id_rsa Username:docker}
I1105 10:01:55.045976 19703 start.go:343] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.169.0.6 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
I1105 10:01:55.046004 19703 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 5r3zgt.rf02xhd5n0rx0515 --discovery-token-ca-cert-hash sha256:2aaa6cfcc57cd555da7aed58a5e5ed7a34a7fb597dea4022fdf5920ac62a4564 --ignore-preflight-errors=all --cri-socket unix:///var/run/cri-dockerd.sock --node-name=ha-213000-m02 --control-plane --apiserver-advertise-address=192.169.0.6 --apiserver-bind-port=8443"
I1105 10:02:51.053865 19703 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 5r3zgt.rf02xhd5n0rx0515 --discovery-token-ca-cert-hash sha256:2aaa6cfcc57cd555da7aed58a5e5ed7a34a7fb597dea4022fdf5920ac62a4564 --ignore-preflight-errors=all --cri-socket unix:///var/run/cri-dockerd.sock --node-name=ha-213000-m02 --control-plane --apiserver-advertise-address=192.169.0.6 --apiserver-bind-port=8443": (56.008348234s)
I1105 10:02:51.053890 19703 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
I1105 10:02:51.498162 19703 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-213000-m02 minikube.k8s.io/updated_at=2024_11_05T10_02_51_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=47b0afc9e70653f81ca813437c4c46b74450b911 minikube.k8s.io/name=ha-213000 minikube.k8s.io/primary=false
I1105 10:02:51.582922 19703 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-213000-m02 node-role.kubernetes.io/control-plane:NoSchedule-
I1105 10:02:51.686566 19703 start.go:319] duration metric: took 56.774150217s to joinCluster
I1105 10:02:51.686607 19703 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.169.0.6 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
I1105 10:02:51.686840 19703 config.go:182] Loaded profile config "ha-213000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1105 10:02:51.711458 19703 out.go:177] * Verifying Kubernetes components...
I1105 10:02:51.753270 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:02:52.031063 19703 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1105 10:02:52.044378 19703 loader.go:395] Config loaded from file: /Users/jenkins/minikube-integration/19910-17277/kubeconfig
I1105 10:02:52.044645 19703 kapi.go:59] client config for ha-213000: &rest.Config{Host:"https://192.169.0.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/client.key", CAFile:"/Users/jenkins/minikube-integration/19910-17277/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(ni
l)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x11e86e20), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
W1105 10:02:52.044691 19703 kubeadm.go:483] Overriding stale ClientConfig host https://192.169.0.254:8443 with https://192.169.0.5:8443
I1105 10:02:52.044863 19703 node_ready.go:35] waiting up to 6m0s for node "ha-213000-m02" to be "Ready" ...
I1105 10:02:52.044923 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:52.044928 19703 round_trippers.go:469] Request Headers:
I1105 10:02:52.044934 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:52.044938 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:52.058081 19703 round_trippers.go:574] Response Status: 200 OK in 13 milliseconds
I1105 10:02:52.545656 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:52.545674 19703 round_trippers.go:469] Request Headers:
I1105 10:02:52.545681 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:52.545696 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:52.555893 19703 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds
I1105 10:02:53.045024 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:53.045046 19703 round_trippers.go:469] Request Headers:
I1105 10:02:53.045052 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:53.045055 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:53.048645 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:02:53.546069 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:53.546084 19703 round_trippers.go:469] Request Headers:
I1105 10:02:53.546091 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:53.546093 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:53.547996 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:02:54.045237 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:54.045257 19703 round_trippers.go:469] Request Headers:
I1105 10:02:54.045267 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:54.045272 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:54.047820 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:02:54.048291 19703 node_ready.go:53] node "ha-213000-m02" has status "Ready":"False"
I1105 10:02:54.545760 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:54.545775 19703 round_trippers.go:469] Request Headers:
I1105 10:02:54.545782 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:54.545785 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:54.547819 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:02:55.044978 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:55.044993 19703 round_trippers.go:469] Request Headers:
I1105 10:02:55.045001 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:55.045004 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:55.046984 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:02:55.545354 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:55.545368 19703 round_trippers.go:469] Request Headers:
I1105 10:02:55.545375 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:55.545378 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:55.548038 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:02:56.045218 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:56.045245 19703 round_trippers.go:469] Request Headers:
I1105 10:02:56.045253 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:56.045268 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:56.047334 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:02:56.544996 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:56.545011 19703 round_trippers.go:469] Request Headers:
I1105 10:02:56.545018 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:56.545021 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:56.547178 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:02:56.547527 19703 node_ready.go:53] node "ha-213000-m02" has status "Ready":"False"
I1105 10:02:57.045514 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:57.045534 19703 round_trippers.go:469] Request Headers:
I1105 10:02:57.045542 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:57.045547 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:57.047484 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:02:57.544988 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:57.545015 19703 round_trippers.go:469] Request Headers:
I1105 10:02:57.545024 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:57.545051 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:57.547803 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:02:58.045000 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:58.045015 19703 round_trippers.go:469] Request Headers:
I1105 10:02:58.045024 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:58.045028 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:58.047832 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:02:58.546341 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:58.546364 19703 round_trippers.go:469] Request Headers:
I1105 10:02:58.546375 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:58.546382 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:58.549120 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:02:58.549600 19703 node_ready.go:53] node "ha-213000-m02" has status "Ready":"False"
I1105 10:02:59.046258 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:59.046274 19703 round_trippers.go:469] Request Headers:
I1105 10:02:59.046280 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:59.046284 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:59.048819 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:02:59.545918 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:02:59.545955 19703 round_trippers.go:469] Request Headers:
I1105 10:02:59.545965 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:02:59.545970 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:02:59.548272 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:00.046889 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:00.046941 19703 round_trippers.go:469] Request Headers:
I1105 10:03:00.046952 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:00.046957 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:00.049445 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:00.545645 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:00.545688 19703 round_trippers.go:469] Request Headers:
I1105 10:03:00.545698 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:00.545703 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:00.547837 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:01.045437 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:01.045458 19703 round_trippers.go:469] Request Headers:
I1105 10:03:01.045487 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:01.045493 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:01.048085 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:01.048344 19703 node_ready.go:53] node "ha-213000-m02" has status "Ready":"False"
I1105 10:03:01.545645 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:01.545659 19703 round_trippers.go:469] Request Headers:
I1105 10:03:01.545667 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:01.545671 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:01.547691 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:02.045598 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:02.045646 19703 round_trippers.go:469] Request Headers:
I1105 10:03:02.045658 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:02.045664 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:02.048807 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:03:02.546565 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:02.546592 19703 round_trippers.go:469] Request Headers:
I1105 10:03:02.546604 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:02.546612 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:02.549476 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:03.045855 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:03.045870 19703 round_trippers.go:469] Request Headers:
I1105 10:03:03.045879 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:03.045884 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:03.048183 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:03.048643 19703 node_ready.go:53] node "ha-213000-m02" has status "Ready":"False"
I1105 10:03:03.545655 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:03.545672 19703 round_trippers.go:469] Request Headers:
I1105 10:03:03.545680 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:03.545685 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:03.548253 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:04.045787 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:04.045799 19703 round_trippers.go:469] Request Headers:
I1105 10:03:04.045804 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:04.045808 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:04.047953 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:04.545151 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:04.545177 19703 round_trippers.go:469] Request Headers:
I1105 10:03:04.545189 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:04.545194 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:04.548344 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:03:05.045476 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:05.045491 19703 round_trippers.go:469] Request Headers:
I1105 10:03:05.045499 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:05.045505 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:05.047869 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:05.545655 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:05.545683 19703 round_trippers.go:469] Request Headers:
I1105 10:03:05.545690 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:05.545695 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:05.547764 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:05.548130 19703 node_ready.go:53] node "ha-213000-m02" has status "Ready":"False"
I1105 10:03:06.044875 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:06.044918 19703 round_trippers.go:469] Request Headers:
I1105 10:03:06.044928 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:06.044935 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:06.048311 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:06.544896 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:06.544908 19703 round_trippers.go:469] Request Headers:
I1105 10:03:06.544914 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:06.544918 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:06.547153 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:07.046736 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:07.046760 19703 round_trippers.go:469] Request Headers:
I1105 10:03:07.046771 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:07.046776 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:07.053742 19703 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds
I1105 10:03:07.545035 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:07.545055 19703 round_trippers.go:469] Request Headers:
I1105 10:03:07.545065 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:07.545072 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:07.548090 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:03:07.548456 19703 node_ready.go:53] node "ha-213000-m02" has status "Ready":"False"
I1105 10:03:08.045232 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:08.045266 19703 round_trippers.go:469] Request Headers:
I1105 10:03:08.045277 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:08.045283 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:08.047484 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:08.546527 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:08.546544 19703 round_trippers.go:469] Request Headers:
I1105 10:03:08.546553 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:08.546557 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:08.549226 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:09.044874 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:09.044886 19703 round_trippers.go:469] Request Headers:
I1105 10:03:09.044892 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:09.044895 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:09.047137 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:09.544845 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:09.544883 19703 round_trippers.go:469] Request Headers:
I1105 10:03:09.544894 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:09.544900 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:09.547114 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:10.045255 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:10.045274 19703 round_trippers.go:469] Request Headers:
I1105 10:03:10.045282 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:10.045287 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:10.047408 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:10.047748 19703 node_ready.go:49] node "ha-213000-m02" has status "Ready":"True"
I1105 10:03:10.047761 19703 node_ready.go:38] duration metric: took 18.003041287s for node "ha-213000-m02" to be "Ready" ...
I1105 10:03:10.047767 19703 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1105 10:03:10.047809 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods
I1105 10:03:10.047815 19703 round_trippers.go:469] Request Headers:
I1105 10:03:10.047821 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:10.047824 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:10.050396 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:10.054843 19703 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-cv2cc" in "kube-system" namespace to be "Ready" ...
I1105 10:03:10.054888 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-cv2cc
I1105 10:03:10.054893 19703 round_trippers.go:469] Request Headers:
I1105 10:03:10.054898 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:10.054902 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:10.056627 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:03:10.057017 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:03:10.057024 19703 round_trippers.go:469] Request Headers:
I1105 10:03:10.057030 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:10.057034 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:10.058541 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:03:10.058972 19703 pod_ready.go:93] pod "coredns-7c65d6cfc9-cv2cc" in "kube-system" namespace has status "Ready":"True"
I1105 10:03:10.058981 19703 pod_ready.go:82] duration metric: took 4.12715ms for pod "coredns-7c65d6cfc9-cv2cc" in "kube-system" namespace to be "Ready" ...
I1105 10:03:10.058987 19703 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-q96rw" in "kube-system" namespace to be "Ready" ...
I1105 10:03:10.059026 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-q96rw
I1105 10:03:10.059031 19703 round_trippers.go:469] Request Headers:
I1105 10:03:10.059036 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:10.059040 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:10.060406 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:03:10.060936 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:03:10.060944 19703 round_trippers.go:469] Request Headers:
I1105 10:03:10.060949 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:10.060952 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:10.062259 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:03:10.062752 19703 pod_ready.go:93] pod "coredns-7c65d6cfc9-q96rw" in "kube-system" namespace has status "Ready":"True"
I1105 10:03:10.062760 19703 pod_ready.go:82] duration metric: took 3.768625ms for pod "coredns-7c65d6cfc9-q96rw" in "kube-system" namespace to be "Ready" ...
I1105 10:03:10.062766 19703 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:03:10.062794 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/etcd-ha-213000
I1105 10:03:10.062799 19703 round_trippers.go:469] Request Headers:
I1105 10:03:10.062804 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:10.062808 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:10.064381 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:03:10.064737 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:03:10.064744 19703 round_trippers.go:469] Request Headers:
I1105 10:03:10.064749 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:10.064753 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:10.066188 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:03:10.066657 19703 pod_ready.go:93] pod "etcd-ha-213000" in "kube-system" namespace has status "Ready":"True"
I1105 10:03:10.066666 19703 pod_ready.go:82] duration metric: took 3.89498ms for pod "etcd-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:03:10.066671 19703 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:03:10.066702 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/etcd-ha-213000-m02
I1105 10:03:10.066707 19703 round_trippers.go:469] Request Headers:
I1105 10:03:10.066716 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:10.066720 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:10.068481 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:03:10.068975 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:10.068982 19703 round_trippers.go:469] Request Headers:
I1105 10:03:10.068988 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:10.068993 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:10.070316 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:03:10.070596 19703 pod_ready.go:93] pod "etcd-ha-213000-m02" in "kube-system" namespace has status "Ready":"True"
I1105 10:03:10.070604 19703 pod_ready.go:82] duration metric: took 3.927721ms for pod "etcd-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:03:10.070613 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:03:10.246069 19703 request.go:632] Waited for 175.411357ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-213000
I1105 10:03:10.246135 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-213000
I1105 10:03:10.246143 19703 round_trippers.go:469] Request Headers:
I1105 10:03:10.246150 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:10.246157 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:10.248509 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:10.445735 19703 request.go:632] Waited for 196.830174ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:03:10.445773 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:03:10.445810 19703 round_trippers.go:469] Request Headers:
I1105 10:03:10.445820 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:10.445825 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:10.447694 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:03:10.448028 19703 pod_ready.go:93] pod "kube-apiserver-ha-213000" in "kube-system" namespace has status "Ready":"True"
I1105 10:03:10.448037 19703 pod_ready.go:82] duration metric: took 377.422873ms for pod "kube-apiserver-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:03:10.448044 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:03:10.645309 19703 request.go:632] Waited for 197.231613ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-213000-m02
I1105 10:03:10.645351 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-213000-m02
I1105 10:03:10.645387 19703 round_trippers.go:469] Request Headers:
I1105 10:03:10.645393 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:10.645398 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:10.647385 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:03:10.845570 19703 request.go:632] Waited for 197.573578ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:10.845611 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:10.845619 19703 round_trippers.go:469] Request Headers:
I1105 10:03:10.845632 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:10.845641 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:10.848369 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:10.848765 19703 pod_ready.go:93] pod "kube-apiserver-ha-213000-m02" in "kube-system" namespace has status "Ready":"True"
I1105 10:03:10.848776 19703 pod_ready.go:82] duration metric: took 400.729678ms for pod "kube-apiserver-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:03:10.848783 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:03:11.046537 19703 request.go:632] Waited for 197.717054ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-213000
I1105 10:03:11.046604 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-213000
I1105 10:03:11.046612 19703 round_trippers.go:469] Request Headers:
I1105 10:03:11.046621 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:11.046628 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:11.048951 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:11.246799 19703 request.go:632] Waited for 197.304848ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:03:11.246915 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:03:11.246922 19703 round_trippers.go:469] Request Headers:
I1105 10:03:11.246932 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:11.246938 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:11.249732 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:11.250168 19703 pod_ready.go:93] pod "kube-controller-manager-ha-213000" in "kube-system" namespace has status "Ready":"True"
I1105 10:03:11.250177 19703 pod_ready.go:82] duration metric: took 401.392962ms for pod "kube-controller-manager-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:03:11.250184 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:03:11.446428 19703 request.go:632] Waited for 196.056309ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-213000-m02
I1105 10:03:11.446480 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-213000-m02
I1105 10:03:11.446489 19703 round_trippers.go:469] Request Headers:
I1105 10:03:11.446499 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:11.446505 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:11.449627 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:03:11.646969 19703 request.go:632] Waited for 196.797375ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:11.647076 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:11.647092 19703 round_trippers.go:469] Request Headers:
I1105 10:03:11.647104 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:11.647110 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:11.650574 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:03:11.650948 19703 pod_ready.go:93] pod "kube-controller-manager-ha-213000-m02" in "kube-system" namespace has status "Ready":"True"
I1105 10:03:11.650974 19703 pod_ready.go:82] duration metric: took 400.789912ms for pod "kube-controller-manager-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:03:11.650982 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-s52w5" in "kube-system" namespace to be "Ready" ...
I1105 10:03:11.845660 19703 request.go:632] Waited for 194.624945ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-proxy-s52w5
I1105 10:03:11.845696 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-proxy-s52w5
I1105 10:03:11.845702 19703 round_trippers.go:469] Request Headers:
I1105 10:03:11.845710 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:11.845715 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:11.848177 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:12.045843 19703 request.go:632] Waited for 197.194177ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:12.045884 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:12.045890 19703 round_trippers.go:469] Request Headers:
I1105 10:03:12.045898 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:12.045904 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:12.048353 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:12.048691 19703 pod_ready.go:93] pod "kube-proxy-s52w5" in "kube-system" namespace has status "Ready":"True"
I1105 10:03:12.048700 19703 pod_ready.go:82] duration metric: took 397.716056ms for pod "kube-proxy-s52w5" in "kube-system" namespace to be "Ready" ...
I1105 10:03:12.048712 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-s8xxj" in "kube-system" namespace to be "Ready" ...
I1105 10:03:12.247441 19703 request.go:632] Waited for 198.639286ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-proxy-s8xxj
I1105 10:03:12.247526 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-proxy-s8xxj
I1105 10:03:12.247535 19703 round_trippers.go:469] Request Headers:
I1105 10:03:12.247546 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:12.247553 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:12.251277 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:03:12.445804 19703 request.go:632] Waited for 193.98688ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:03:12.445866 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:03:12.445879 19703 round_trippers.go:469] Request Headers:
I1105 10:03:12.445891 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:12.445909 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:12.448985 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:03:12.449660 19703 pod_ready.go:93] pod "kube-proxy-s8xxj" in "kube-system" namespace has status "Ready":"True"
I1105 10:03:12.449672 19703 pod_ready.go:82] duration metric: took 400.957346ms for pod "kube-proxy-s8xxj" in "kube-system" namespace to be "Ready" ...
I1105 10:03:12.449680 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:03:12.646023 19703 request.go:632] Waited for 196.29617ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-213000
I1105 10:03:12.646138 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-213000
I1105 10:03:12.646148 19703 round_trippers.go:469] Request Headers:
I1105 10:03:12.646156 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:12.646160 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:12.648881 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:12.846423 19703 request.go:632] Waited for 197.041377ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:03:12.846478 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:03:12.846486 19703 round_trippers.go:469] Request Headers:
I1105 10:03:12.846495 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:12.846500 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:12.849237 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:12.849526 19703 pod_ready.go:93] pod "kube-scheduler-ha-213000" in "kube-system" namespace has status "Ready":"True"
I1105 10:03:12.849536 19703 pod_ready.go:82] duration metric: took 399.853481ms for pod "kube-scheduler-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:03:12.849543 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:03:13.046888 19703 request.go:632] Waited for 197.276485ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-213000-m02
I1105 10:03:13.046931 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-213000-m02
I1105 10:03:13.046938 19703 round_trippers.go:469] Request Headers:
I1105 10:03:13.046973 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:13.046978 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:13.049651 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:13.246632 19703 request.go:632] Waited for 196.567235ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:13.246683 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:03:13.246692 19703 round_trippers.go:469] Request Headers:
I1105 10:03:13.246727 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:13.246737 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:13.249732 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:03:13.250368 19703 pod_ready.go:93] pod "kube-scheduler-ha-213000-m02" in "kube-system" namespace has status "Ready":"True"
I1105 10:03:13.250378 19703 pod_ready.go:82] duration metric: took 400.834283ms for pod "kube-scheduler-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:03:13.250385 19703 pod_ready.go:39] duration metric: took 3.20263718s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1105 10:03:13.250407 19703 api_server.go:52] waiting for apiserver process to appear ...
I1105 10:03:13.250476 19703 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1105 10:03:13.263389 19703 api_server.go:72] duration metric: took 21.576959393s to wait for apiserver process to appear ...
I1105 10:03:13.263406 19703 api_server.go:88] waiting for apiserver healthz status ...
I1105 10:03:13.263422 19703 api_server.go:253] Checking apiserver healthz at https://192.169.0.5:8443/healthz ...
I1105 10:03:13.267595 19703 api_server.go:279] https://192.169.0.5:8443/healthz returned 200:
ok
I1105 10:03:13.267641 19703 round_trippers.go:463] GET https://192.169.0.5:8443/version
I1105 10:03:13.267649 19703 round_trippers.go:469] Request Headers:
I1105 10:03:13.267658 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:13.267666 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:13.268160 19703 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds
I1105 10:03:13.268232 19703 api_server.go:141] control plane version: v1.31.2
I1105 10:03:13.268245 19703 api_server.go:131] duration metric: took 4.83504ms to wait for apiserver health ...
I1105 10:03:13.268250 19703 system_pods.go:43] waiting for kube-system pods to appear ...
I1105 10:03:13.447320 19703 request.go:632] Waited for 179.029832ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods
I1105 10:03:13.447393 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods
I1105 10:03:13.447401 19703 round_trippers.go:469] Request Headers:
I1105 10:03:13.447409 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:13.447414 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:13.451090 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:03:13.454646 19703 system_pods.go:59] 17 kube-system pods found
I1105 10:03:13.454662 19703 system_pods.go:61] "coredns-7c65d6cfc9-cv2cc" [b6d32d7c-e03f-4a60-a2eb-e81042e65e49] Running
I1105 10:03:13.454667 19703 system_pods.go:61] "coredns-7c65d6cfc9-q96rw" [cb820265-326d-4e02-b187-0f30754bcd99] Running
I1105 10:03:13.454671 19703 system_pods.go:61] "etcd-ha-213000" [1d431f2a-8064-4bc9-bc70-913243f83645] Running
I1105 10:03:13.454673 19703 system_pods.go:61] "etcd-ha-213000-m02" [da6eb444-2c2a-4c8a-82ab-13a543bf0fa0] Running
I1105 10:03:13.454676 19703 system_pods.go:61] "kindnet-hppzk" [3f615ca1-027e-42fe-ad0c-943f7686805f] Running
I1105 10:03:13.454679 19703 system_pods.go:61] "kindnet-pf9hr" [320af5ac-d6b6-4fc4-ac52-1b35b9c81ce7] Running
I1105 10:03:13.454681 19703 system_pods.go:61] "kube-apiserver-ha-213000" [a32fee4d-29c9-4919-9554-351393c17408] Running
I1105 10:03:13.454685 19703 system_pods.go:61] "kube-apiserver-ha-213000-m02" [0e69e69b-f4a1-4c5b-a78b-d18411aecae8] Running
I1105 10:03:13.454688 19703 system_pods.go:61] "kube-controller-manager-ha-213000" [0405dcb5-6322-47fe-b929-22f12fd80b1b] Running
I1105 10:03:13.454699 19703 system_pods.go:61] "kube-controller-manager-ha-213000-m02" [06d77930-6b69-471d-9139-f454d903c918] Running
I1105 10:03:13.454702 19703 system_pods.go:61] "kube-proxy-s52w5" [08e6c33b-72c8-4277-9d0f-c8257490cc64] Running
I1105 10:03:13.454707 19703 system_pods.go:61] "kube-proxy-s8xxj" [416d3e9e-efe2-42fe-9a62-6bf5ebc884ae] Running
I1105 10:03:13.454710 19703 system_pods.go:61] "kube-scheduler-ha-213000" [ea19a8b5-3829-4b24-ac87-fd5f74b755d4] Running
I1105 10:03:13.454712 19703 system_pods.go:61] "kube-scheduler-ha-213000-m02" [f26961d7-33d3-417a-87fd-3c6911dcb46a] Running
I1105 10:03:13.454715 19703 system_pods.go:61] "kube-vip-ha-213000" [970e81e4-8295-4cc4-9b62-b943e6e6a003] Running
I1105 10:03:13.454718 19703 system_pods.go:61] "kube-vip-ha-213000-m02" [bb20bc57-fecb-4ff7-937e-59d4a6303c32] Running
I1105 10:03:13.454721 19703 system_pods.go:61] "storage-provisioner" [e7f00930-b382-473c-be59-04504c6e23ff] Running
I1105 10:03:13.454725 19703 system_pods.go:74] duration metric: took 186.473341ms to wait for pod list to return data ...
I1105 10:03:13.454731 19703 default_sa.go:34] waiting for default service account to be created ...
I1105 10:03:13.645590 19703 request.go:632] Waited for 190.785599ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/default/serviceaccounts
I1105 10:03:13.645629 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/default/serviceaccounts
I1105 10:03:13.645636 19703 round_trippers.go:469] Request Headers:
I1105 10:03:13.645645 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:13.645651 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:13.648706 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:03:13.648833 19703 default_sa.go:45] found service account: "default"
I1105 10:03:13.648842 19703 default_sa.go:55] duration metric: took 194.109049ms for default service account to be created ...
I1105 10:03:13.648848 19703 system_pods.go:116] waiting for k8s-apps to be running ...
I1105 10:03:13.845301 19703 request.go:632] Waited for 196.413293ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods
I1105 10:03:13.845347 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods
I1105 10:03:13.845354 19703 round_trippers.go:469] Request Headers:
I1105 10:03:13.845362 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:13.845368 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:13.849295 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:03:13.853094 19703 system_pods.go:86] 17 kube-system pods found
I1105 10:03:13.853105 19703 system_pods.go:89] "coredns-7c65d6cfc9-cv2cc" [b6d32d7c-e03f-4a60-a2eb-e81042e65e49] Running
I1105 10:03:13.853109 19703 system_pods.go:89] "coredns-7c65d6cfc9-q96rw" [cb820265-326d-4e02-b187-0f30754bcd99] Running
I1105 10:03:13.853113 19703 system_pods.go:89] "etcd-ha-213000" [1d431f2a-8064-4bc9-bc70-913243f83645] Running
I1105 10:03:13.853116 19703 system_pods.go:89] "etcd-ha-213000-m02" [da6eb444-2c2a-4c8a-82ab-13a543bf0fa0] Running
I1105 10:03:13.853122 19703 system_pods.go:89] "kindnet-hppzk" [3f615ca1-027e-42fe-ad0c-943f7686805f] Running
I1105 10:03:13.853125 19703 system_pods.go:89] "kindnet-pf9hr" [320af5ac-d6b6-4fc4-ac52-1b35b9c81ce7] Running
I1105 10:03:13.853128 19703 system_pods.go:89] "kube-apiserver-ha-213000" [a32fee4d-29c9-4919-9554-351393c17408] Running
I1105 10:03:13.853131 19703 system_pods.go:89] "kube-apiserver-ha-213000-m02" [0e69e69b-f4a1-4c5b-a78b-d18411aecae8] Running
I1105 10:03:13.853133 19703 system_pods.go:89] "kube-controller-manager-ha-213000" [0405dcb5-6322-47fe-b929-22f12fd80b1b] Running
I1105 10:03:13.853139 19703 system_pods.go:89] "kube-controller-manager-ha-213000-m02" [06d77930-6b69-471d-9139-f454d903c918] Running
I1105 10:03:13.853145 19703 system_pods.go:89] "kube-proxy-s52w5" [08e6c33b-72c8-4277-9d0f-c8257490cc64] Running
I1105 10:03:13.853147 19703 system_pods.go:89] "kube-proxy-s8xxj" [416d3e9e-efe2-42fe-9a62-6bf5ebc884ae] Running
I1105 10:03:13.853150 19703 system_pods.go:89] "kube-scheduler-ha-213000" [ea19a8b5-3829-4b24-ac87-fd5f74b755d4] Running
I1105 10:03:13.853153 19703 system_pods.go:89] "kube-scheduler-ha-213000-m02" [f26961d7-33d3-417a-87fd-3c6911dcb46a] Running
I1105 10:03:13.853155 19703 system_pods.go:89] "kube-vip-ha-213000" [970e81e4-8295-4cc4-9b62-b943e6e6a003] Running
I1105 10:03:13.853158 19703 system_pods.go:89] "kube-vip-ha-213000-m02" [bb20bc57-fecb-4ff7-937e-59d4a6303c32] Running
I1105 10:03:13.853161 19703 system_pods.go:89] "storage-provisioner" [e7f00930-b382-473c-be59-04504c6e23ff] Running
I1105 10:03:13.853165 19703 system_pods.go:126] duration metric: took 204.31519ms to wait for k8s-apps to be running ...
I1105 10:03:13.853173 19703 system_svc.go:44] waiting for kubelet service to be running ....
I1105 10:03:13.853242 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1105 10:03:13.864800 19703 system_svc.go:56] duration metric: took 11.624062ms WaitForService to wait for kubelet
I1105 10:03:13.864814 19703 kubeadm.go:582] duration metric: took 22.178392392s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1105 10:03:13.864830 19703 node_conditions.go:102] verifying NodePressure condition ...
I1105 10:03:14.047134 19703 request.go:632] Waited for 182.24401ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes
I1105 10:03:14.047270 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes
I1105 10:03:14.047286 19703 round_trippers.go:469] Request Headers:
I1105 10:03:14.047300 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:03:14.047306 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:03:14.051327 19703 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I1105 10:03:14.051979 19703 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki
I1105 10:03:14.051996 19703 node_conditions.go:123] node cpu capacity is 2
I1105 10:03:14.052008 19703 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki
I1105 10:03:14.052011 19703 node_conditions.go:123] node cpu capacity is 2
I1105 10:03:14.052014 19703 node_conditions.go:105] duration metric: took 187.182073ms to run NodePressure ...
I1105 10:03:14.052022 19703 start.go:241] waiting for startup goroutines ...
I1105 10:03:14.052040 19703 start.go:255] writing updated cluster config ...
I1105 10:03:14.073950 19703 out.go:201]
I1105 10:03:14.095736 19703 config.go:182] Loaded profile config "ha-213000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1105 10:03:14.095829 19703 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/config.json ...
I1105 10:03:14.117446 19703 out.go:177] * Starting "ha-213000-m03" control-plane node in "ha-213000" cluster
I1105 10:03:14.159672 19703 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
I1105 10:03:14.159707 19703 cache.go:56] Caching tarball of preloaded images
I1105 10:03:14.159953 19703 preload.go:172] Found /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I1105 10:03:14.159973 19703 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on docker
I1105 10:03:14.160101 19703 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/config.json ...
I1105 10:03:14.161238 19703 start.go:360] acquireMachinesLock for ha-213000-m03: {Name:mk67e3fe9c26d68e6bc4121ccfd9f37c1a8d85cb Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1105 10:03:14.161402 19703 start.go:364] duration metric: took 132.038µs to acquireMachinesLock for "ha-213000-m03"
I1105 10:03:14.161444 19703 start.go:93] Provisioning new machine with config: &{Name:ha-213000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19883/minikube-v1.34.0-1730282777-19883-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.31.2 ClusterName:ha-213000 Namespace:default APIServerHAVIP:192.169.0.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.169.0.5 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.169.0.6 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress
:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker Bina
ryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
I1105 10:03:14.161537 19703 start.go:125] createHost starting for "m03" (driver="hyperkit")
I1105 10:03:14.203378 19703 out.go:235] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I1105 10:03:14.203509 19703 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1105 10:03:14.203540 19703 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1105 10:03:14.215464 19703 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:57709
I1105 10:03:14.215800 19703 main.go:141] libmachine: () Calling .GetVersion
I1105 10:03:14.216175 19703 main.go:141] libmachine: Using API Version 1
I1105 10:03:14.216187 19703 main.go:141] libmachine: () Calling .SetConfigRaw
I1105 10:03:14.216413 19703 main.go:141] libmachine: () Calling .GetMachineName
I1105 10:03:14.216532 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetMachineName
I1105 10:03:14.216639 19703 main.go:141] libmachine: (ha-213000-m03) Calling .DriverName
I1105 10:03:14.216755 19703 start.go:159] libmachine.API.Create for "ha-213000" (driver="hyperkit")
I1105 10:03:14.216774 19703 client.go:168] LocalClient.Create starting
I1105 10:03:14.216804 19703 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem
I1105 10:03:14.216876 19703 main.go:141] libmachine: Decoding PEM data...
I1105 10:03:14.216886 19703 main.go:141] libmachine: Parsing certificate...
I1105 10:03:14.216927 19703 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/cert.pem
I1105 10:03:14.216976 19703 main.go:141] libmachine: Decoding PEM data...
I1105 10:03:14.216986 19703 main.go:141] libmachine: Parsing certificate...
I1105 10:03:14.217000 19703 main.go:141] libmachine: Running pre-create checks...
I1105 10:03:14.217004 19703 main.go:141] libmachine: (ha-213000-m03) Calling .PreCreateCheck
I1105 10:03:14.217109 19703 main.go:141] libmachine: (ha-213000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:03:14.217166 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetConfigRaw
I1105 10:03:14.217654 19703 main.go:141] libmachine: Creating machine...
I1105 10:03:14.217662 19703 main.go:141] libmachine: (ha-213000-m03) Calling .Create
I1105 10:03:14.217732 19703 main.go:141] libmachine: (ha-213000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:03:14.217901 19703 main.go:141] libmachine: (ha-213000-m03) DBG | I1105 10:03:14.217732 19773 common.go:144] Making disk image using store path: /Users/jenkins/minikube-integration/19910-17277/.minikube
I1105 10:03:14.217969 19703 main.go:141] libmachine: (ha-213000-m03) Downloading /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/19910-17277/.minikube/cache/iso/amd64/minikube-v1.34.0-1730282777-19883-amd64.iso...
I1105 10:03:14.490580 19703 main.go:141] libmachine: (ha-213000-m03) DBG | I1105 10:03:14.490490 19773 common.go:151] Creating ssh key: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/id_rsa...
I1105 10:03:14.554451 19703 main.go:141] libmachine: (ha-213000-m03) DBG | I1105 10:03:14.554363 19773 common.go:157] Creating raw disk image: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/ha-213000-m03.rawdisk...
I1105 10:03:14.554467 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Writing magic tar header
I1105 10:03:14.554475 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Writing SSH key tar header
I1105 10:03:14.555306 19703 main.go:141] libmachine: (ha-213000-m03) DBG | I1105 10:03:14.555244 19773 common.go:171] Fixing permissions on /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03 ...
I1105 10:03:15.030518 19703 main.go:141] libmachine: (ha-213000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:03:15.030575 19703 main.go:141] libmachine: (ha-213000-m03) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/hyperkit.pid
I1105 10:03:15.030627 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Using UUID 9e834d88-ec2a-4703-a798-2d165259ce86
I1105 10:03:15.063985 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Generated MAC 06:83:5c:e9:cb:34
I1105 10:03:15.064010 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=ha-213000
I1105 10:03:15.064043 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"9e834d88-ec2a-4703-a798-2d165259ce86", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0001d21e0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/bzimage", Initrd:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Process)(nil)}
I1105 10:03:15.064075 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"9e834d88-ec2a-4703-a798-2d165259ce86", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0001d21e0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/bzimage", Initrd:"/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Process)(nil)}
I1105 10:03:15.064114 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "9e834d88-ec2a-4703-a798-2d165259ce86", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/ha-213000-m03.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/tty,log=/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/bzimage,/Users/jenkins/minikube-integration/19910-17277/.minikube/
machines/ha-213000-m03/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=ha-213000"}
I1105 10:03:15.064146 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U 9e834d88-ec2a-4703-a798-2d165259ce86 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/ha-213000-m03.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/tty,log=/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/console-ring -f kexec,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/bzimage,/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/initrd,earlyprintk=serial loglevel=3 co
nsole=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=ha-213000"
I1105 10:03:15.064163 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 DEBUG: hyperkit: Redirecting stdout/stderr to logger
I1105 10:03:15.067111 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 DEBUG: hyperkit: Pid is 19776
I1105 10:03:15.067572 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Attempt 0
I1105 10:03:15.067585 19703 main.go:141] libmachine: (ha-213000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:03:15.067601 19703 main.go:141] libmachine: (ha-213000-m03) DBG | hyperkit pid from json: 19776
I1105 10:03:15.068753 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Searching for 06:83:5c:e9:cb:34 in /var/db/dhcpd_leases ...
I1105 10:03:15.068832 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Found 5 entries in /var/db/dhcpd_leases!
I1105 10:03:15.068842 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.6 HWAddress:4a:4e:c6:49:69:60 ID:1,4a:4e:c6:49:69:60 Lease:0x672a6b96}
I1105 10:03:15.068849 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:82:fc:3d:82:28:7c ID:1,82:fc:3d:82:28:7c Lease:0x672a6b6b}
I1105 10:03:15.068858 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:0a:f2:13:1f:4d:a9 ID:1,a:f2:13:1f:4d:a9 Lease:0x672a6979}
I1105 10:03:15.068869 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:42:36:6d:50:88:43 ID:1,42:36:6d:50:88:43 Lease:0x672a68b2}
I1105 10:03:15.068885 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.2 HWAddress:8a:ae:5d:dc:69:d7 ID:1,8a:ae:5d:dc:69:d7 Lease:0x672a66c1}
I1105 10:03:15.077682 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 INFO : hyperkit: stderr: Using fd 6 for I/O notifications
I1105 10:03:15.086555 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD
I1105 10:03:15.087707 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I1105 10:03:15.087735 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I1105 10:03:15.087751 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I1105 10:03:15.087769 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I1105 10:03:15.487970 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0
I1105 10:03:15.487985 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0
I1105 10:03:15.602906 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I1105 10:03:15.602926 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I1105 10:03:15.602934 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I1105 10:03:15.602939 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I1105 10:03:15.603764 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1
I1105 10:03:15.603775 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:15 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1
I1105 10:03:17.070391 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Attempt 1
I1105 10:03:17.070406 19703 main.go:141] libmachine: (ha-213000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:03:17.070484 19703 main.go:141] libmachine: (ha-213000-m03) DBG | hyperkit pid from json: 19776
I1105 10:03:17.071430 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Searching for 06:83:5c:e9:cb:34 in /var/db/dhcpd_leases ...
I1105 10:03:17.071487 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Found 5 entries in /var/db/dhcpd_leases!
I1105 10:03:17.071507 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.6 HWAddress:4a:4e:c6:49:69:60 ID:1,4a:4e:c6:49:69:60 Lease:0x672a6b96}
I1105 10:03:17.071517 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:82:fc:3d:82:28:7c ID:1,82:fc:3d:82:28:7c Lease:0x672a6b6b}
I1105 10:03:17.071526 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:0a:f2:13:1f:4d:a9 ID:1,a:f2:13:1f:4d:a9 Lease:0x672a6979}
I1105 10:03:17.071533 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:42:36:6d:50:88:43 ID:1,42:36:6d:50:88:43 Lease:0x672a68b2}
I1105 10:03:17.071540 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.2 HWAddress:8a:ae:5d:dc:69:d7 ID:1,8a:ae:5d:dc:69:d7 Lease:0x672a66c1}
I1105 10:03:19.071643 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Attempt 2
I1105 10:03:19.071657 19703 main.go:141] libmachine: (ha-213000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:03:19.071732 19703 main.go:141] libmachine: (ha-213000-m03) DBG | hyperkit pid from json: 19776
I1105 10:03:19.072732 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Searching for 06:83:5c:e9:cb:34 in /var/db/dhcpd_leases ...
I1105 10:03:19.072790 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Found 5 entries in /var/db/dhcpd_leases!
I1105 10:03:19.072797 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.6 HWAddress:4a:4e:c6:49:69:60 ID:1,4a:4e:c6:49:69:60 Lease:0x672a6b96}
I1105 10:03:19.072820 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:82:fc:3d:82:28:7c ID:1,82:fc:3d:82:28:7c Lease:0x672a6b6b}
I1105 10:03:19.072832 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:0a:f2:13:1f:4d:a9 ID:1,a:f2:13:1f:4d:a9 Lease:0x672a6979}
I1105 10:03:19.072839 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:42:36:6d:50:88:43 ID:1,42:36:6d:50:88:43 Lease:0x672a68b2}
I1105 10:03:19.072847 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.2 HWAddress:8a:ae:5d:dc:69:d7 ID:1,8a:ae:5d:dc:69:d7 Lease:0x672a66c1}
I1105 10:03:21.074196 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Attempt 3
I1105 10:03:21.074212 19703 main.go:141] libmachine: (ha-213000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:03:21.074292 19703 main.go:141] libmachine: (ha-213000-m03) DBG | hyperkit pid from json: 19776
I1105 10:03:21.075239 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Searching for 06:83:5c:e9:cb:34 in /var/db/dhcpd_leases ...
I1105 10:03:21.075306 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Found 5 entries in /var/db/dhcpd_leases!
I1105 10:03:21.075318 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.6 HWAddress:4a:4e:c6:49:69:60 ID:1,4a:4e:c6:49:69:60 Lease:0x672a6b96}
I1105 10:03:21.075336 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:82:fc:3d:82:28:7c ID:1,82:fc:3d:82:28:7c Lease:0x672a6b6b}
I1105 10:03:21.075342 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:0a:f2:13:1f:4d:a9 ID:1,a:f2:13:1f:4d:a9 Lease:0x672a6979}
I1105 10:03:21.075348 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:42:36:6d:50:88:43 ID:1,42:36:6d:50:88:43 Lease:0x672a68b2}
I1105 10:03:21.075356 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.2 HWAddress:8a:ae:5d:dc:69:d7 ID:1,8a:ae:5d:dc:69:d7 Lease:0x672a66c1}
I1105 10:03:21.396531 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:21 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1
I1105 10:03:21.396580 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:21 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1
I1105 10:03:21.396612 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:21 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1
I1105 10:03:21.420738 19703 main.go:141] libmachine: (ha-213000-m03) DBG | 2024/11/05 10:03:21 INFO : hyperkit: stderr: rdmsr to register 0xc0011029 on vcpu 1
I1105 10:03:23.075524 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Attempt 4
I1105 10:03:23.075538 19703 main.go:141] libmachine: (ha-213000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:03:23.075648 19703 main.go:141] libmachine: (ha-213000-m03) DBG | hyperkit pid from json: 19776
I1105 10:03:23.076609 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Searching for 06:83:5c:e9:cb:34 in /var/db/dhcpd_leases ...
I1105 10:03:23.076667 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Found 5 entries in /var/db/dhcpd_leases!
I1105 10:03:23.076676 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.6 HWAddress:4a:4e:c6:49:69:60 ID:1,4a:4e:c6:49:69:60 Lease:0x672a6b96}
I1105 10:03:23.076684 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:82:fc:3d:82:28:7c ID:1,82:fc:3d:82:28:7c Lease:0x672a6b6b}
I1105 10:03:23.076690 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:0a:f2:13:1f:4d:a9 ID:1,a:f2:13:1f:4d:a9 Lease:0x672a6979}
I1105 10:03:23.076697 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:42:36:6d:50:88:43 ID:1,42:36:6d:50:88:43 Lease:0x672a68b2}
I1105 10:03:23.076705 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.2 HWAddress:8a:ae:5d:dc:69:d7 ID:1,8a:ae:5d:dc:69:d7 Lease:0x672a66c1}
I1105 10:03:25.077448 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Attempt 5
I1105 10:03:25.077468 19703 main.go:141] libmachine: (ha-213000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:03:25.077588 19703 main.go:141] libmachine: (ha-213000-m03) DBG | hyperkit pid from json: 19776
I1105 10:03:25.078838 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Searching for 06:83:5c:e9:cb:34 in /var/db/dhcpd_leases ...
I1105 10:03:25.078950 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Found 6 entries in /var/db/dhcpd_leases!
I1105 10:03:25.078960 19703 main.go:141] libmachine: (ha-213000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.7 HWAddress:06:83:5c:e9:cb:34 ID:1,6:83:5c:e9:cb:34 Lease:0x672a6bfc}
I1105 10:03:25.078966 19703 main.go:141] libmachine: (ha-213000-m03) DBG | Found match: 06:83:5c:e9:cb:34
I1105 10:03:25.078970 19703 main.go:141] libmachine: (ha-213000-m03) DBG | IP: 192.169.0.7
I1105 10:03:25.079034 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetConfigRaw
I1105 10:03:25.079648 19703 main.go:141] libmachine: (ha-213000-m03) Calling .DriverName
I1105 10:03:25.079753 19703 main.go:141] libmachine: (ha-213000-m03) Calling .DriverName
I1105 10:03:25.079858 19703 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I1105 10:03:25.079867 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetState
I1105 10:03:25.079968 19703 main.go:141] libmachine: (ha-213000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:03:25.080027 19703 main.go:141] libmachine: (ha-213000-m03) DBG | hyperkit pid from json: 19776
I1105 10:03:25.081028 19703 main.go:141] libmachine: Detecting operating system of created instance...
I1105 10:03:25.081037 19703 main.go:141] libmachine: Waiting for SSH to be available...
I1105 10:03:25.081043 19703 main.go:141] libmachine: Getting to WaitForSSH function...
I1105 10:03:25.081047 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHHostname
I1105 10:03:25.081134 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHPort
I1105 10:03:25.081211 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:25.081299 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:25.081396 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHUsername
I1105 10:03:25.081991 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:03:25.082321 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.7 22 <nil> <nil>}
I1105 10:03:25.082330 19703 main.go:141] libmachine: About to run SSH command:
exit 0
I1105 10:03:26.133521 19703 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1105 10:03:26.133535 19703 main.go:141] libmachine: Detecting the provisioner...
I1105 10:03:26.133540 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHHostname
I1105 10:03:26.133696 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHPort
I1105 10:03:26.133825 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:26.133956 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:26.134044 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHUsername
I1105 10:03:26.134222 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:03:26.134364 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.7 22 <nil> <nil>}
I1105 10:03:26.134372 19703 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I1105 10:03:26.183718 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2023.02.9-dirty
ID=buildroot
VERSION_ID=2023.02.9
PRETTY_NAME="Buildroot 2023.02.9"
I1105 10:03:26.183767 19703 main.go:141] libmachine: found compatible host: buildroot
I1105 10:03:26.183774 19703 main.go:141] libmachine: Provisioning with buildroot...
I1105 10:03:26.183779 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetMachineName
I1105 10:03:26.183908 19703 buildroot.go:166] provisioning hostname "ha-213000-m03"
I1105 10:03:26.183917 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetMachineName
I1105 10:03:26.184015 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHHostname
I1105 10:03:26.184096 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHPort
I1105 10:03:26.184192 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:26.184276 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:26.184357 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHUsername
I1105 10:03:26.184497 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:03:26.184635 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.7 22 <nil> <nil>}
I1105 10:03:26.184643 19703 main.go:141] libmachine: About to run SSH command:
sudo hostname ha-213000-m03 && echo "ha-213000-m03" | sudo tee /etc/hostname
I1105 10:03:26.245764 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-213000-m03
I1105 10:03:26.245779 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHHostname
I1105 10:03:26.245911 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHPort
I1105 10:03:26.246034 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:26.246135 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:26.246225 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHUsername
I1105 10:03:26.246371 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:03:26.246514 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.7 22 <nil> <nil>}
I1105 10:03:26.246525 19703 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sha-213000-m03' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-213000-m03/g' /etc/hosts;
else
echo '127.0.1.1 ha-213000-m03' | sudo tee -a /etc/hosts;
fi
fi
I1105 10:03:26.304895 19703 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1105 10:03:26.304911 19703 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/19910-17277/.minikube CaCertPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/19910-17277/.minikube}
I1105 10:03:26.304922 19703 buildroot.go:174] setting up certificates
I1105 10:03:26.304929 19703 provision.go:84] configureAuth start
I1105 10:03:26.304936 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetMachineName
I1105 10:03:26.305070 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetIP
I1105 10:03:26.305166 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHHostname
I1105 10:03:26.305256 19703 provision.go:143] copyHostCerts
I1105 10:03:26.305284 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.pem
I1105 10:03:26.305330 19703 exec_runner.go:144] found /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.pem, removing ...
I1105 10:03:26.305336 19703 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.pem
I1105 10:03:26.305479 19703 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.pem (1082 bytes)
I1105 10:03:26.305706 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/19910-17277/.minikube/cert.pem
I1105 10:03:26.305741 19703 exec_runner.go:144] found /Users/jenkins/minikube-integration/19910-17277/.minikube/cert.pem, removing ...
I1105 10:03:26.305746 19703 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19910-17277/.minikube/cert.pem
I1105 10:03:26.305833 19703 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/19910-17277/.minikube/cert.pem (1123 bytes)
I1105 10:03:26.305989 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/19910-17277/.minikube/key.pem
I1105 10:03:26.306040 19703 exec_runner.go:144] found /Users/jenkins/minikube-integration/19910-17277/.minikube/key.pem, removing ...
I1105 10:03:26.306045 19703 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/19910-17277/.minikube/key.pem
I1105 10:03:26.306127 19703 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/19910-17277/.minikube/key.pem (1675 bytes)
I1105 10:03:26.306297 19703 provision.go:117] generating server cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca-key.pem org=jenkins.ha-213000-m03 san=[127.0.0.1 192.169.0.7 ha-213000-m03 localhost minikube]
I1105 10:03:26.464060 19703 provision.go:177] copyRemoteCerts
I1105 10:03:26.464124 19703 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1105 10:03:26.464140 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHHostname
I1105 10:03:26.464292 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHPort
I1105 10:03:26.464393 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:26.464474 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHUsername
I1105 10:03:26.464559 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/id_rsa Username:docker}
I1105 10:03:26.496436 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server.pem -> /etc/docker/server.pem
I1105 10:03:26.496516 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I1105 10:03:26.516600 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I1105 10:03:26.516672 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1105 10:03:26.535607 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I1105 10:03:26.535680 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1105 10:03:26.556861 19703 provision.go:87] duration metric: took 251.926291ms to configureAuth
I1105 10:03:26.556882 19703 buildroot.go:189] setting minikube options for container-runtime
I1105 10:03:26.557331 19703 config.go:182] Loaded profile config "ha-213000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1105 10:03:26.557344 19703 main.go:141] libmachine: (ha-213000-m03) Calling .DriverName
I1105 10:03:26.557488 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHHostname
I1105 10:03:26.557585 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHPort
I1105 10:03:26.557665 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:26.557758 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:26.557840 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHUsername
I1105 10:03:26.557971 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:03:26.558096 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.7 22 <nil> <nil>}
I1105 10:03:26.558106 19703 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I1105 10:03:26.608963 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I1105 10:03:26.608976 19703 buildroot.go:70] root file system type: tmpfs
I1105 10:03:26.609053 19703 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I1105 10:03:26.609068 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHHostname
I1105 10:03:26.609212 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHPort
I1105 10:03:26.609317 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:26.609404 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:26.609483 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHUsername
I1105 10:03:26.609628 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:03:26.609762 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.7 22 <nil> <nil>}
I1105 10:03:26.609808 19703 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
Environment="NO_PROXY=192.169.0.5"
Environment="NO_PROXY=192.169.0.5,192.169.0.6"
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I1105 10:03:26.670604 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
Environment=NO_PROXY=192.169.0.5
Environment=NO_PROXY=192.169.0.5,192.169.0.6
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I1105 10:03:26.670621 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHHostname
I1105 10:03:26.670766 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHPort
I1105 10:03:26.670854 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:26.670959 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:26.671050 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHUsername
I1105 10:03:26.671201 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:03:26.671337 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.7 22 <nil> <nil>}
I1105 10:03:26.671349 19703 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I1105 10:03:28.299545 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I1105 10:03:28.299559 19703 main.go:141] libmachine: Checking connection to Docker...
I1105 10:03:28.299574 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetURL
I1105 10:03:28.299721 19703 main.go:141] libmachine: Docker is up and running!
I1105 10:03:28.299730 19703 main.go:141] libmachine: Reticulating splines...
I1105 10:03:28.299735 19703 client.go:171] duration metric: took 14.083083071s to LocalClient.Create
I1105 10:03:28.299751 19703 start.go:167] duration metric: took 14.083123931s to libmachine.API.Create "ha-213000"
I1105 10:03:28.299756 19703 start.go:293] postStartSetup for "ha-213000-m03" (driver="hyperkit")
I1105 10:03:28.299763 19703 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1105 10:03:28.299775 19703 main.go:141] libmachine: (ha-213000-m03) Calling .DriverName
I1105 10:03:28.299931 19703 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1105 10:03:28.299943 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHHostname
I1105 10:03:28.300030 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHPort
I1105 10:03:28.300114 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:28.300191 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHUsername
I1105 10:03:28.300269 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/id_rsa Username:docker}
I1105 10:03:28.335699 19703 ssh_runner.go:195] Run: cat /etc/os-release
I1105 10:03:28.339827 19703 info.go:137] Remote host: Buildroot 2023.02.9
I1105 10:03:28.339839 19703 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19910-17277/.minikube/addons for local assets ...
I1105 10:03:28.339952 19703 filesync.go:126] Scanning /Users/jenkins/minikube-integration/19910-17277/.minikube/files for local assets ...
I1105 10:03:28.340166 19703 filesync.go:149] local asset: /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem -> 178422.pem in /etc/ssl/certs
I1105 10:03:28.340173 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem -> /etc/ssl/certs/178422.pem
I1105 10:03:28.340432 19703 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1105 10:03:28.353898 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem --> /etc/ssl/certs/178422.pem (1708 bytes)
I1105 10:03:28.384126 19703 start.go:296] duration metric: took 84.362542ms for postStartSetup
I1105 10:03:28.384153 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetConfigRaw
I1105 10:03:28.384834 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetIP
I1105 10:03:28.385024 19703 profile.go:143] Saving config to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/config.json ...
I1105 10:03:28.385403 19703 start.go:128] duration metric: took 14.223987778s to createHost
I1105 10:03:28.385418 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHHostname
I1105 10:03:28.385511 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHPort
I1105 10:03:28.385585 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:28.385675 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:28.385752 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHUsername
I1105 10:03:28.385869 19703 main.go:141] libmachine: Using SSH client type: native
I1105 10:03:28.385999 19703 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x102e5620] 0x102e8300 <nil> [] 0s} 192.169.0.7 22 <nil> <nil>}
I1105 10:03:28.386006 19703 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I1105 10:03:28.435792 19703 main.go:141] libmachine: SSH cmd err, output: <nil>: 1730829808.714335766
I1105 10:03:28.435806 19703 fix.go:216] guest clock: 1730829808.714335766
I1105 10:03:28.435811 19703 fix.go:229] Guest: 2024-11-05 10:03:28.714335766 -0800 PST Remote: 2024-11-05 10:03:28.385413 -0800 PST m=+159.952313720 (delta=328.922766ms)
I1105 10:03:28.435825 19703 fix.go:200] guest clock delta is within tolerance: 328.922766ms
I1105 10:03:28.435829 19703 start.go:83] releasing machines lock for "ha-213000-m03", held for 14.274546252s
I1105 10:03:28.435845 19703 main.go:141] libmachine: (ha-213000-m03) Calling .DriverName
I1105 10:03:28.435975 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetIP
I1105 10:03:28.463026 19703 out.go:177] * Found network options:
I1105 10:03:28.524451 19703 out.go:177] - NO_PROXY=192.169.0.5,192.169.0.6
W1105 10:03:28.550710 19703 proxy.go:119] fail to check proxy env: Error ip not in block
W1105 10:03:28.550742 19703 proxy.go:119] fail to check proxy env: Error ip not in block
I1105 10:03:28.550759 19703 main.go:141] libmachine: (ha-213000-m03) Calling .DriverName
I1105 10:03:28.551499 19703 main.go:141] libmachine: (ha-213000-m03) Calling .DriverName
I1105 10:03:28.551696 19703 main.go:141] libmachine: (ha-213000-m03) Calling .DriverName
W1105 10:03:28.551855 19703 proxy.go:119] fail to check proxy env: Error ip not in block
W1105 10:03:28.551871 19703 proxy.go:119] fail to check proxy env: Error ip not in block
I1105 10:03:28.551938 19703 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1105 10:03:28.551950 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHHostname
I1105 10:03:28.552047 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHPort
I1105 10:03:28.552054 19703 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1105 10:03:28.552073 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHHostname
I1105 10:03:28.552162 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:28.552174 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHPort
I1105 10:03:28.552281 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHUsername
I1105 10:03:28.552298 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHKeyPath
I1105 10:03:28.552403 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetSSHUsername
I1105 10:03:28.552430 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/id_rsa Username:docker}
I1105 10:03:28.552508 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.7 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000-m03/id_rsa Username:docker}
W1105 10:03:28.623667 19703 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1105 10:03:28.623763 19703 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1105 10:03:28.636396 19703 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1105 10:03:28.636411 19703 start.go:495] detecting cgroup driver to use...
I1105 10:03:28.636477 19703 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1105 10:03:28.651269 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I1105 10:03:28.659803 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1105 10:03:28.668221 19703 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I1105 10:03:28.668301 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I1105 10:03:28.676635 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1105 10:03:28.684733 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1105 10:03:28.693062 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1105 10:03:28.701350 19703 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1105 10:03:28.709600 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1105 10:03:28.717536 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I1105 10:03:28.725790 19703 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I1105 10:03:28.734256 19703 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1105 10:03:28.741810 19703 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I1105 10:03:28.741868 19703 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I1105 10:03:28.750498 19703 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1105 10:03:28.757777 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:03:28.848477 19703 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1105 10:03:28.867603 19703 start.go:495] detecting cgroup driver to use...
I1105 10:03:28.867693 19703 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I1105 10:03:28.882469 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1105 10:03:28.893733 19703 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1105 10:03:28.910872 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1105 10:03:28.921618 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1105 10:03:28.931860 19703 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1105 10:03:28.955674 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1105 10:03:28.966135 19703 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I1105 10:03:28.981687 19703 ssh_runner.go:195] Run: which cri-dockerd
I1105 10:03:28.984719 19703 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I1105 10:03:28.992276 19703 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)
I1105 10:03:29.007094 19703 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I1105 10:03:29.103508 19703 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I1105 10:03:29.207614 19703 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I1105 10:03:29.207637 19703 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I1105 10:03:29.221804 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:03:29.326678 19703 ssh_runner.go:195] Run: sudo systemctl restart docker
I1105 10:03:31.637809 19703 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.31112896s)
I1105 10:03:31.637894 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
I1105 10:03:31.648270 19703 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket
I1105 10:03:31.661112 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I1105 10:03:31.671447 19703 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I1105 10:03:31.763823 19703 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I1105 10:03:31.864111 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:03:31.960037 19703 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I1105 10:03:31.972710 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I1105 10:03:31.983457 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:03:32.073613 19703 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
I1105 10:03:32.131634 19703 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
I1105 10:03:32.132384 19703 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I1105 10:03:32.136690 19703 start.go:563] Will wait 60s for crictl version
I1105 10:03:32.136768 19703 ssh_runner.go:195] Run: which crictl
I1105 10:03:32.139750 19703 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I1105 10:03:32.167666 19703 start.go:579] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 27.3.1
RuntimeApiVersion: v1
I1105 10:03:32.167752 19703 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I1105 10:03:32.185621 19703 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I1105 10:03:32.230649 19703 out.go:235] * Preparing Kubernetes v1.31.2 on Docker 27.3.1 ...
I1105 10:03:32.272942 19703 out.go:177] - env NO_PROXY=192.169.0.5
I1105 10:03:32.316102 19703 out.go:177] - env NO_PROXY=192.169.0.5,192.169.0.6
I1105 10:03:32.337095 19703 main.go:141] libmachine: (ha-213000-m03) Calling .GetIP
I1105 10:03:32.337555 19703 ssh_runner.go:195] Run: grep 192.169.0.1 host.minikube.internal$ /etc/hosts
I1105 10:03:32.342111 19703 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.169.0.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1105 10:03:32.352735 19703 mustload.go:65] Loading cluster: ha-213000
I1105 10:03:32.352915 19703 config.go:182] Loaded profile config "ha-213000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1105 10:03:32.353165 19703 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1105 10:03:32.353188 19703 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1105 10:03:32.364602 19703 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:57732
I1105 10:03:32.364908 19703 main.go:141] libmachine: () Calling .GetVersion
I1105 10:03:32.365258 19703 main.go:141] libmachine: Using API Version 1
I1105 10:03:32.365274 19703 main.go:141] libmachine: () Calling .SetConfigRaw
I1105 10:03:32.365482 19703 main.go:141] libmachine: () Calling .GetMachineName
I1105 10:03:32.365613 19703 main.go:141] libmachine: (ha-213000) Calling .GetState
I1105 10:03:32.365706 19703 main.go:141] libmachine: (ha-213000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1105 10:03:32.365791 19703 main.go:141] libmachine: (ha-213000) DBG | hyperkit pid from json: 19716
I1105 10:03:32.366950 19703 host.go:66] Checking if "ha-213000" exists ...
I1105 10:03:32.367212 19703 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1105 10:03:32.367238 19703 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1105 10:03:32.378822 19703 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:57734
I1105 10:03:32.379151 19703 main.go:141] libmachine: () Calling .GetVersion
I1105 10:03:32.379474 19703 main.go:141] libmachine: Using API Version 1
I1105 10:03:32.379486 19703 main.go:141] libmachine: () Calling .SetConfigRaw
I1105 10:03:32.379723 19703 main.go:141] libmachine: () Calling .GetMachineName
I1105 10:03:32.379829 19703 main.go:141] libmachine: (ha-213000) Calling .DriverName
I1105 10:03:32.379937 19703 certs.go:68] Setting up /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000 for IP: 192.169.0.7
I1105 10:03:32.379942 19703 certs.go:194] generating shared ca certs ...
I1105 10:03:32.379956 19703 certs.go:226] acquiring lock for ca certs: {Name:mk71cfd5cfa6f19aa54770800e673e4533fb7d9c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:03:32.380143 19703 certs.go:235] skipping valid "minikubeCA" ca cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.key
I1105 10:03:32.380237 19703 certs.go:235] skipping valid "proxyClientCA" ca cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/proxy-client-ca.key
I1105 10:03:32.380246 19703 certs.go:256] generating profile certs ...
I1105 10:03:32.380342 19703 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/client.key
I1105 10:03:32.380361 19703 certs.go:363] generating signed profile cert for "minikube": /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key.7ae243e9
I1105 10:03:32.380396 19703 crypto.go:68] Generating cert /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt.7ae243e9 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.169.0.5 192.169.0.6 192.169.0.7 192.169.0.254]
I1105 10:03:32.531495 19703 crypto.go:156] Writing cert to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt.7ae243e9 ...
I1105 10:03:32.531519 19703 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt.7ae243e9: {Name:mked1b883793443cd41069aa04846ce3d13e3cd6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:03:32.531897 19703 crypto.go:164] Writing key to /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key.7ae243e9 ...
I1105 10:03:32.531907 19703 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key.7ae243e9: {Name:mkc6838eeb283dd1eaf268f9b1d512c474d2ec87 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1105 10:03:32.532158 19703 certs.go:381] copying /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt.7ae243e9 -> /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt
I1105 10:03:32.532364 19703 certs.go:385] copying /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key.7ae243e9 -> /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key
I1105 10:03:32.532662 19703 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.key
I1105 10:03:32.532672 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I1105 10:03:32.532701 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I1105 10:03:32.532722 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I1105 10:03:32.532741 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I1105 10:03:32.532759 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I1105 10:03:32.532779 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I1105 10:03:32.532797 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I1105 10:03:32.532819 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I1105 10:03:32.532921 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/17842.pem (1338 bytes)
W1105 10:03:32.532977 19703 certs.go:480] ignoring /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/17842_empty.pem, impossibly tiny 0 bytes
I1105 10:03:32.532985 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca-key.pem (1679 bytes)
I1105 10:03:32.533022 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/ca.pem (1082 bytes)
I1105 10:03:32.533055 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/cert.pem (1123 bytes)
I1105 10:03:32.533086 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/key.pem (1675 bytes)
I1105 10:03:32.533156 19703 certs.go:484] found cert: /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem (1708 bytes)
I1105 10:03:32.533192 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem -> /usr/share/ca-certificates/178422.pem
I1105 10:03:32.533220 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I1105 10:03:32.533241 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/17842.pem -> /usr/share/ca-certificates/17842.pem
I1105 10:03:32.533273 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:03:32.533416 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:03:32.533504 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:03:32.533579 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:03:32.533666 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/id_rsa Username:docker}
I1105 10:03:32.562870 19703 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
I1105 10:03:32.566125 19703 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
I1105 10:03:32.574941 19703 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
I1105 10:03:32.577997 19703 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
I1105 10:03:32.590640 19703 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
I1105 10:03:32.593905 19703 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
I1105 10:03:32.603441 19703 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
I1105 10:03:32.607210 19703 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
I1105 10:03:32.616800 19703 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
I1105 10:03:32.620077 19703 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
I1105 10:03:32.629598 19703 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
I1105 10:03:32.632721 19703 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1675 bytes)
I1105 10:03:32.641637 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1105 10:03:32.661020 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1105 10:03:32.681195 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1105 10:03:32.700777 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1105 10:03:32.719964 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)
I1105 10:03:32.740252 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1105 10:03:32.759642 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1105 10:03:32.778570 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I1105 10:03:32.798835 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/files/etc/ssl/certs/178422.pem --> /usr/share/ca-certificates/178422.pem (1708 bytes)
I1105 10:03:32.818449 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1105 10:03:32.837230 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/certs/17842.pem --> /usr/share/ca-certificates/17842.pem (1338 bytes)
I1105 10:03:32.856822 19703 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
I1105 10:03:32.870143 19703 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
I1105 10:03:32.883780 19703 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
I1105 10:03:32.897915 19703 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
I1105 10:03:32.911578 19703 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
I1105 10:03:32.925103 19703 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1675 bytes)
I1105 10:03:32.938796 19703 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
I1105 10:03:32.953077 19703 ssh_runner.go:195] Run: openssl version
I1105 10:03:32.957362 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1105 10:03:32.966865 19703 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1105 10:03:32.970193 19703 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 5 17:43 /usr/share/ca-certificates/minikubeCA.pem
I1105 10:03:32.970241 19703 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1105 10:03:32.974304 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1105 10:03:32.983690 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/17842.pem && ln -fs /usr/share/ca-certificates/17842.pem /etc/ssl/certs/17842.pem"
I1105 10:03:32.993172 19703 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/17842.pem
I1105 10:03:32.996898 19703 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 5 17:52 /usr/share/ca-certificates/17842.pem
I1105 10:03:32.996967 19703 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/17842.pem
I1105 10:03:33.001371 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/17842.pem /etc/ssl/certs/51391683.0"
I1105 10:03:33.010757 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/178422.pem && ln -fs /usr/share/ca-certificates/178422.pem /etc/ssl/certs/178422.pem"
I1105 10:03:33.020281 19703 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/178422.pem
I1105 10:03:33.023901 19703 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 5 17:52 /usr/share/ca-certificates/178422.pem
I1105 10:03:33.023960 19703 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/178422.pem
I1105 10:03:33.028229 19703 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/178422.pem /etc/ssl/certs/3ec20f2e.0"
I1105 10:03:33.038224 19703 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1105 10:03:33.041604 19703 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1105 10:03:33.041640 19703 kubeadm.go:934] updating node {m03 192.169.0.7 8443 v1.31.2 docker true true} ...
I1105 10:03:33.041693 19703 kubeadm.go:946] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-213000-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.169.0.7
[Install]
config:
{KubernetesVersion:v1.31.2 ClusterName:ha-213000 Namespace:default APIServerHAVIP:192.169.0.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1105 10:03:33.041717 19703 kube-vip.go:115] generating kube-vip config ...
I1105 10:03:33.041764 19703 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"
I1105 10:03:33.054458 19703 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip
I1105 10:03:33.054499 19703 kube-vip.go:137] kube-vip config:
apiVersion: v1
kind: Pod
metadata:
creationTimestamp: null
name: kube-vip
namespace: kube-system
spec:
containers:
- args:
- manager
env:
- name: vip_arp
value: "true"
- name: port
value: "8443"
- name: vip_nodename
valueFrom:
fieldRef:
fieldPath: spec.nodeName
- name: vip_interface
value: eth0
- name: vip_cidr
value: "32"
- name: dns_mode
value: first
- name: cp_enable
value: "true"
- name: cp_namespace
value: kube-system
- name: vip_leaderelection
value: "true"
- name: vip_leasename
value: plndr-cp-lock
- name: vip_leaseduration
value: "5"
- name: vip_renewdeadline
value: "3"
- name: vip_retryperiod
value: "1"
- name: address
value: 192.169.0.254
- name: prometheus_server
value: :2112
- name : lb_enable
value: "true"
- name: lb_port
value: "8443"
image: ghcr.io/kube-vip/kube-vip:v0.8.6
imagePullPolicy: IfNotPresent
name: kube-vip
resources: {}
securityContext:
capabilities:
add:
- NET_ADMIN
- NET_RAW
volumeMounts:
- mountPath: /etc/kubernetes/admin.conf
name: kubeconfig
hostAliases:
- hostnames:
- kubernetes
ip: 127.0.0.1
hostNetwork: true
volumes:
- hostPath:
path: "/etc/kubernetes/admin.conf"
name: kubeconfig
status: {}
I1105 10:03:33.054566 19703 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.2
I1105 10:03:33.063806 19703 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.31.2: Process exited with status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/binaries/v1.31.2': No such file or directory
Initiating transfer...
I1105 10:03:33.063883 19703 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.31.2
I1105 10:03:33.072691 19703 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubectl.sha256
I1105 10:03:33.072692 19703 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubeadm.sha256
I1105 10:03:33.072707 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/linux/amd64/v1.31.2/kubectl -> /var/lib/minikube/binaries/v1.31.2/kubectl
I1105 10:03:33.072712 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/linux/amd64/v1.31.2/kubeadm -> /var/lib/minikube/binaries/v1.31.2/kubeadm
I1105 10:03:33.072691 19703 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubelet.sha256
I1105 10:03:33.072776 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1105 10:03:33.072833 19703 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubectl
I1105 10:03:33.072833 19703 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubeadm
I1105 10:03:33.084670 19703 vm_assets.go:164] NewFileAsset: /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/linux/amd64/v1.31.2/kubelet -> /var/lib/minikube/binaries/v1.31.2/kubelet
I1105 10:03:33.084705 19703 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubeadm: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubeadm: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubeadm': No such file or directory
I1105 10:03:33.084732 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/linux/amd64/v1.31.2/kubeadm --> /var/lib/minikube/binaries/v1.31.2/kubeadm (58290328 bytes)
I1105 10:03:33.084803 19703 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubectl: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubectl: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubectl': No such file or directory
I1105 10:03:33.084830 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/linux/amd64/v1.31.2/kubectl --> /var/lib/minikube/binaries/v1.31.2/kubectl (56381592 bytes)
I1105 10:03:33.084849 19703 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubelet
I1105 10:03:33.112916 19703 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubelet: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubelet: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubelet': No such file or directory
I1105 10:03:33.112953 19703 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/19910-17277/.minikube/cache/linux/amd64/v1.31.2/kubelet --> /var/lib/minikube/binaries/v1.31.2/kubelet (76902744 bytes)
I1105 10:03:33.638088 19703 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
I1105 10:03:33.646375 19703 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (311 bytes)
I1105 10:03:33.662178 19703 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1105 10:03:33.676109 19703 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1440 bytes)
I1105 10:03:33.690081 19703 ssh_runner.go:195] Run: grep 192.169.0.254 control-plane.minikube.internal$ /etc/hosts
I1105 10:03:33.693205 19703 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.169.0.254 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1105 10:03:33.703729 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:03:33.801135 19703 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1105 10:03:33.817719 19703 host.go:66] Checking if "ha-213000" exists ...
I1105 10:03:33.818043 19703 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1105 10:03:33.818070 19703 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1105 10:03:33.829754 19703 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:57737
I1105 10:03:33.830093 19703 main.go:141] libmachine: () Calling .GetVersion
I1105 10:03:33.830434 19703 main.go:141] libmachine: Using API Version 1
I1105 10:03:33.830444 19703 main.go:141] libmachine: () Calling .SetConfigRaw
I1105 10:03:33.830649 19703 main.go:141] libmachine: () Calling .GetMachineName
I1105 10:03:33.830744 19703 main.go:141] libmachine: (ha-213000) Calling .DriverName
I1105 10:03:33.830850 19703 start.go:317] joinCluster: &{Name:ha-213000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19883/minikube-v1.34.0-1730282777-19883-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1730282848-19883@sha256:e762c909ad2a507083ec25b1ad3091c71fc7d92824e4a659c9158bbfe5ae03d4 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 Clu
sterName:ha-213000 Namespace:default APIServerHAVIP:192.169.0.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.169.0.5 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.169.0.6 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.169.0.7 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingres
s-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Dis
ableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1105 10:03:33.830949 19703 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm token create --print-join-command --ttl=0"
I1105 10:03:33.830963 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHHostname
I1105 10:03:33.831038 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHPort
I1105 10:03:33.831160 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHKeyPath
I1105 10:03:33.831264 19703 main.go:141] libmachine: (ha-213000) Calling .GetSSHUsername
I1105 10:03:33.831351 19703 sshutil.go:53] new ssh client: &{IP:192.169.0.5 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/19910-17277/.minikube/machines/ha-213000/id_rsa Username:docker}
I1105 10:03:33.915396 19703 start.go:343] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.169.0.7 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
I1105 10:03:33.915427 19703 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 3af4oc.mrofw1iihstmy2lp --discovery-token-ca-cert-hash sha256:2aaa6cfcc57cd555da7aed58a5e5ed7a34a7fb597dea4022fdf5920ac62a4564 --ignore-preflight-errors=all --cri-socket unix:///var/run/cri-dockerd.sock --node-name=ha-213000-m03 --control-plane --apiserver-advertise-address=192.169.0.7 --apiserver-bind-port=8443"
I1105 10:04:05.463364 19703 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 3af4oc.mrofw1iihstmy2lp --discovery-token-ca-cert-hash sha256:2aaa6cfcc57cd555da7aed58a5e5ed7a34a7fb597dea4022fdf5920ac62a4564 --ignore-preflight-errors=all --cri-socket unix:///var/run/cri-dockerd.sock --node-name=ha-213000-m03 --control-plane --apiserver-advertise-address=192.169.0.7 --apiserver-bind-port=8443": (31.548185064s)
I1105 10:04:05.463394 19703 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
I1105 10:04:05.926039 19703 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-213000-m03 minikube.k8s.io/updated_at=2024_11_05T10_04_05_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=47b0afc9e70653f81ca813437c4c46b74450b911 minikube.k8s.io/name=ha-213000 minikube.k8s.io/primary=false
I1105 10:04:06.005817 19703 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-213000-m03 node-role.kubernetes.io/control-plane:NoSchedule-
I1105 10:04:06.089769 19703 start.go:319] duration metric: took 32.259206586s to joinCluster
I1105 10:04:06.089835 19703 start.go:235] Will wait 6m0s for node &{Name:m03 IP:192.169.0.7 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
I1105 10:04:06.090023 19703 config.go:182] Loaded profile config "ha-213000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1105 10:04:06.144884 19703 out.go:177] * Verifying Kubernetes components...
I1105 10:04:06.218462 19703 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1105 10:04:06.491890 19703 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1105 10:04:06.522724 19703 loader.go:395] Config loaded from file: /Users/jenkins/minikube-integration/19910-17277/kubeconfig
I1105 10:04:06.522981 19703 kapi.go:59] client config for ha-213000: &rest.Config{Host:"https://192.169.0.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/19910-17277/.minikube/profiles/ha-213000/client.key", CAFile:"/Users/jenkins/minikube-integration/19910-17277/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(ni
l)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x11e86e20), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
W1105 10:04:06.523027 19703 kubeadm.go:483] Overriding stale ClientConfig host https://192.169.0.254:8443 with https://192.169.0.5:8443
I1105 10:04:06.523216 19703 node_ready.go:35] waiting up to 6m0s for node "ha-213000-m03" to be "Ready" ...
I1105 10:04:06.523272 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:06.523278 19703 round_trippers.go:469] Request Headers:
I1105 10:04:06.523284 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:06.523289 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:06.525762 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:07.024768 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:07.024785 19703 round_trippers.go:469] Request Headers:
I1105 10:04:07.024792 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:07.024796 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:07.026838 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:07.523802 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:07.523816 19703 round_trippers.go:469] Request Headers:
I1105 10:04:07.523823 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:07.523827 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:07.525952 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:08.024543 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:08.024558 19703 round_trippers.go:469] Request Headers:
I1105 10:04:08.024565 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:08.024567 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:08.026818 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:08.523406 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:08.523421 19703 round_trippers.go:469] Request Headers:
I1105 10:04:08.523428 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:08.523431 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:08.525613 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:08.526028 19703 node_ready.go:53] node "ha-213000-m03" has status "Ready":"False"
I1105 10:04:09.023489 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:09.023507 19703 round_trippers.go:469] Request Headers:
I1105 10:04:09.023515 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:09.023518 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:09.025718 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:09.524490 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:09.524507 19703 round_trippers.go:469] Request Headers:
I1105 10:04:09.524536 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:09.524542 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:09.526550 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:04:10.024748 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:10.024763 19703 round_trippers.go:469] Request Headers:
I1105 10:04:10.024770 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:10.024773 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:10.026854 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:10.523405 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:10.523428 19703 round_trippers.go:469] Request Headers:
I1105 10:04:10.523434 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:10.523438 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:10.525879 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:10.526310 19703 node_ready.go:53] node "ha-213000-m03" has status "Ready":"False"
I1105 10:04:11.024586 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:11.024601 19703 round_trippers.go:469] Request Headers:
I1105 10:04:11.024608 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:11.024611 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:11.026801 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:11.524591 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:11.524616 19703 round_trippers.go:469] Request Headers:
I1105 10:04:11.524627 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:11.524633 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:11.528710 19703 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I1105 10:04:12.023846 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:12.023871 19703 round_trippers.go:469] Request Headers:
I1105 10:04:12.023892 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:12.023899 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:12.026343 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:12.523660 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:12.523678 19703 round_trippers.go:469] Request Headers:
I1105 10:04:12.523687 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:12.523692 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:12.526168 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:12.526545 19703 node_ready.go:53] node "ha-213000-m03" has status "Ready":"False"
I1105 10:04:13.024493 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:13.024549 19703 round_trippers.go:469] Request Headers:
I1105 10:04:13.024558 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:13.024562 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:13.026612 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:13.523333 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:13.523377 19703 round_trippers.go:469] Request Headers:
I1105 10:04:13.523386 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:13.523391 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:13.526060 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:14.023778 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:14.023813 19703 round_trippers.go:469] Request Headers:
I1105 10:04:14.023821 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:14.023826 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:14.026277 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:14.524791 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:14.524807 19703 round_trippers.go:469] Request Headers:
I1105 10:04:14.524814 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:14.524818 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:14.526944 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:14.527389 19703 node_ready.go:53] node "ha-213000-m03" has status "Ready":"False"
I1105 10:04:15.024235 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:15.024251 19703 round_trippers.go:469] Request Headers:
I1105 10:04:15.024257 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:15.024261 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:15.026360 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:15.523297 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:15.523315 19703 round_trippers.go:469] Request Headers:
I1105 10:04:15.523340 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:15.523344 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:15.525650 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:16.024088 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:16.024104 19703 round_trippers.go:469] Request Headers:
I1105 10:04:16.024111 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:16.024114 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:16.026234 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:16.524762 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:16.524781 19703 round_trippers.go:469] Request Headers:
I1105 10:04:16.524790 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:16.524794 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:16.527186 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:16.527528 19703 node_ready.go:53] node "ha-213000-m03" has status "Ready":"False"
I1105 10:04:17.024111 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:17.024127 19703 round_trippers.go:469] Request Headers:
I1105 10:04:17.024133 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:17.024137 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:17.026641 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:17.523462 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:17.523498 19703 round_trippers.go:469] Request Headers:
I1105 10:04:17.523506 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:17.523509 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:17.525790 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:18.023254 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:18.023271 19703 round_trippers.go:469] Request Headers:
I1105 10:04:18.023277 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:18.023280 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:18.025709 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:18.523323 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:18.523337 19703 round_trippers.go:469] Request Headers:
I1105 10:04:18.523343 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:18.523347 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:18.526016 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:19.023466 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:19.023481 19703 round_trippers.go:469] Request Headers:
I1105 10:04:19.023498 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:19.023501 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:19.026019 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:19.026436 19703 node_ready.go:53] node "ha-213000-m03" has status "Ready":"False"
I1105 10:04:19.523232 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:19.523250 19703 round_trippers.go:469] Request Headers:
I1105 10:04:19.523258 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:19.523262 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:19.525574 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:20.025183 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:20.025202 19703 round_trippers.go:469] Request Headers:
I1105 10:04:20.025211 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:20.025217 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:20.027796 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:20.524157 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:20.524199 19703 round_trippers.go:469] Request Headers:
I1105 10:04:20.524209 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:20.524214 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:20.526298 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:21.023312 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:21.023328 19703 round_trippers.go:469] Request Headers:
I1105 10:04:21.023335 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:21.023338 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:21.025776 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:21.525084 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:21.525110 19703 round_trippers.go:469] Request Headers:
I1105 10:04:21.525123 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:21.525129 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:21.528173 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:04:21.528632 19703 node_ready.go:53] node "ha-213000-m03" has status "Ready":"False"
I1105 10:04:22.023245 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:22.023263 19703 round_trippers.go:469] Request Headers:
I1105 10:04:22.023272 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:22.023276 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:22.025668 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:22.524560 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:22.524575 19703 round_trippers.go:469] Request Headers:
I1105 10:04:22.524580 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:22.524582 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:22.526635 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:22.527110 19703 node_ready.go:49] node "ha-213000-m03" has status "Ready":"True"
I1105 10:04:22.527120 19703 node_ready.go:38] duration metric: took 16.004036788s for node "ha-213000-m03" to be "Ready" ...
I1105 10:04:22.527128 19703 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1105 10:04:22.527166 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods
I1105 10:04:22.527172 19703 round_trippers.go:469] Request Headers:
I1105 10:04:22.527177 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:22.527182 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:22.533505 19703 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds
I1105 10:04:22.539225 19703 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-cv2cc" in "kube-system" namespace to be "Ready" ...
I1105 10:04:22.539271 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-cv2cc
I1105 10:04:22.539277 19703 round_trippers.go:469] Request Headers:
I1105 10:04:22.539283 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:22.539289 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:22.541288 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:04:22.541882 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:04:22.541890 19703 round_trippers.go:469] Request Headers:
I1105 10:04:22.541895 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:22.541898 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:22.543858 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:04:22.544129 19703 pod_ready.go:93] pod "coredns-7c65d6cfc9-cv2cc" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:22.544138 19703 pod_ready.go:82] duration metric: took 4.901387ms for pod "coredns-7c65d6cfc9-cv2cc" in "kube-system" namespace to be "Ready" ...
I1105 10:04:22.544145 19703 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-q96rw" in "kube-system" namespace to be "Ready" ...
I1105 10:04:22.544181 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-q96rw
I1105 10:04:22.544186 19703 round_trippers.go:469] Request Headers:
I1105 10:04:22.544191 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:22.544195 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:22.545938 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:04:22.546421 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:04:22.546429 19703 round_trippers.go:469] Request Headers:
I1105 10:04:22.546436 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:22.546439 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:22.548600 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:22.548988 19703 pod_ready.go:93] pod "coredns-7c65d6cfc9-q96rw" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:22.548997 19703 pod_ready.go:82] duration metric: took 4.847138ms for pod "coredns-7c65d6cfc9-q96rw" in "kube-system" namespace to be "Ready" ...
I1105 10:04:22.549007 19703 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:04:22.549053 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/etcd-ha-213000
I1105 10:04:22.549059 19703 round_trippers.go:469] Request Headers:
I1105 10:04:22.549065 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:22.549067 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:22.550912 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:04:22.551584 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:04:22.551591 19703 round_trippers.go:469] Request Headers:
I1105 10:04:22.551597 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:22.551600 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:22.553276 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:04:22.553666 19703 pod_ready.go:93] pod "etcd-ha-213000" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:22.553676 19703 pod_ready.go:82] duration metric: took 4.662923ms for pod "etcd-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:04:22.553683 19703 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:04:22.553721 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/etcd-ha-213000-m02
I1105 10:04:22.553726 19703 round_trippers.go:469] Request Headers:
I1105 10:04:22.553732 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:22.553735 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:22.555620 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:04:22.556112 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:04:22.556119 19703 round_trippers.go:469] Request Headers:
I1105 10:04:22.556124 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:22.556128 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:22.557964 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:04:22.558427 19703 pod_ready.go:93] pod "etcd-ha-213000-m02" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:22.558437 19703 pod_ready.go:82] duration metric: took 4.748625ms for pod "etcd-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:04:22.558444 19703 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-213000-m03" in "kube-system" namespace to be "Ready" ...
I1105 10:04:22.725676 19703 request.go:632] Waited for 167.192719ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/etcd-ha-213000-m03
I1105 10:04:22.725734 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/etcd-ha-213000-m03
I1105 10:04:22.725741 19703 round_trippers.go:469] Request Headers:
I1105 10:04:22.725750 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:22.725757 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:22.728337 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:22.924860 19703 request.go:632] Waited for 196.058895ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:22.925006 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:22.925029 19703 round_trippers.go:469] Request Headers:
I1105 10:04:22.925044 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:22.925054 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:22.929161 19703 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I1105 10:04:23.125347 19703 request.go:632] Waited for 65.258433ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/etcd-ha-213000-m03
I1105 10:04:23.125410 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/etcd-ha-213000-m03
I1105 10:04:23.125417 19703 round_trippers.go:469] Request Headers:
I1105 10:04:23.125424 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:23.125429 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:23.128075 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:23.326631 19703 request.go:632] Waited for 198.115235ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:23.326702 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:23.326713 19703 round_trippers.go:469] Request Headers:
I1105 10:04:23.326721 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:23.326726 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:23.329257 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:23.559388 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/etcd-ha-213000-m03
I1105 10:04:23.559410 19703 round_trippers.go:469] Request Headers:
I1105 10:04:23.559419 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:23.559423 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:23.561604 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:23.724668 19703 request.go:632] Waited for 162.701435ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:23.724727 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:23.724733 19703 round_trippers.go:469] Request Headers:
I1105 10:04:23.724740 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:23.724746 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:23.726755 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:04:24.059136 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/etcd-ha-213000-m03
I1105 10:04:24.059155 19703 round_trippers.go:469] Request Headers:
I1105 10:04:24.059188 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:24.059194 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:24.061686 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:24.125899 19703 request.go:632] Waited for 63.704238ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:24.126005 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:24.126016 19703 round_trippers.go:469] Request Headers:
I1105 10:04:24.126028 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:24.126034 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:24.129471 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:04:24.129800 19703 pod_ready.go:93] pod "etcd-ha-213000-m03" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:24.129809 19703 pod_ready.go:82] duration metric: took 1.571374275s for pod "etcd-ha-213000-m03" in "kube-system" namespace to be "Ready" ...
I1105 10:04:24.129820 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:04:24.325915 19703 request.go:632] Waited for 196.033511ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-213000
I1105 10:04:24.326035 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-213000
I1105 10:04:24.326046 19703 round_trippers.go:469] Request Headers:
I1105 10:04:24.326057 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:24.326064 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:24.329258 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:04:24.525894 19703 request.go:632] Waited for 195.976303ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:04:24.525950 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:04:24.525957 19703 round_trippers.go:469] Request Headers:
I1105 10:04:24.525965 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:24.525970 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:24.531038 19703 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I1105 10:04:24.531331 19703 pod_ready.go:93] pod "kube-apiserver-ha-213000" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:24.531341 19703 pod_ready.go:82] duration metric: took 401.519758ms for pod "kube-apiserver-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:04:24.531348 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:04:24.725411 19703 request.go:632] Waited for 194.029144ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-213000-m02
I1105 10:04:24.725452 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-213000-m02
I1105 10:04:24.725457 19703 round_trippers.go:469] Request Headers:
I1105 10:04:24.725484 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:24.725488 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:24.727336 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:04:24.924946 19703 request.go:632] Waited for 197.104111ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:04:24.925003 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:04:24.925010 19703 round_trippers.go:469] Request Headers:
I1105 10:04:24.925018 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:24.925024 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:24.927806 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:24.928044 19703 pod_ready.go:93] pod "kube-apiserver-ha-213000-m02" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:24.928052 19703 pod_ready.go:82] duration metric: took 396.702505ms for pod "kube-apiserver-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:04:24.928062 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-213000-m03" in "kube-system" namespace to be "Ready" ...
I1105 10:04:25.125637 19703 request.go:632] Waited for 197.516414ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-213000-m03
I1105 10:04:25.125722 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-213000-m03
I1105 10:04:25.125731 19703 round_trippers.go:469] Request Headers:
I1105 10:04:25.125739 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:25.125747 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:25.128388 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:25.325342 19703 request.go:632] Waited for 196.567129ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:25.325384 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:25.325390 19703 round_trippers.go:469] Request Headers:
I1105 10:04:25.325430 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:25.325437 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:25.327703 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:25.327989 19703 pod_ready.go:93] pod "kube-apiserver-ha-213000-m03" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:25.327998 19703 pod_ready.go:82] duration metric: took 399.934252ms for pod "kube-apiserver-ha-213000-m03" in "kube-system" namespace to be "Ready" ...
I1105 10:04:25.328005 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:04:25.526534 19703 request.go:632] Waited for 198.484556ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-213000
I1105 10:04:25.526593 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-213000
I1105 10:04:25.526601 19703 round_trippers.go:469] Request Headers:
I1105 10:04:25.526608 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:25.526614 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:25.528989 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:25.725913 19703 request.go:632] Waited for 196.422028ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:04:25.725987 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:04:25.725997 19703 round_trippers.go:469] Request Headers:
I1105 10:04:25.726008 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:25.726031 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:25.728724 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:25.729094 19703 pod_ready.go:93] pod "kube-controller-manager-ha-213000" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:25.729103 19703 pod_ready.go:82] duration metric: took 401.096776ms for pod "kube-controller-manager-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:04:25.729112 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:04:25.924767 19703 request.go:632] Waited for 195.60365ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-213000-m02
I1105 10:04:25.924865 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-213000-m02
I1105 10:04:25.924875 19703 round_trippers.go:469] Request Headers:
I1105 10:04:25.924888 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:25.924896 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:25.928404 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:04:26.125908 19703 request.go:632] Waited for 196.895961ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:04:26.125983 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:04:26.125991 19703 round_trippers.go:469] Request Headers:
I1105 10:04:26.125999 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:26.126005 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:26.128293 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:26.128631 19703 pod_ready.go:93] pod "kube-controller-manager-ha-213000-m02" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:26.128641 19703 pod_ready.go:82] duration metric: took 399.525738ms for pod "kube-controller-manager-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:04:26.128647 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-213000-m03" in "kube-system" namespace to be "Ready" ...
I1105 10:04:26.324632 19703 request.go:632] Waited for 195.949532ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-213000-m03
I1105 10:04:26.324692 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-213000-m03
I1105 10:04:26.324698 19703 round_trippers.go:469] Request Headers:
I1105 10:04:26.324704 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:26.324708 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:26.326997 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:26.525533 19703 request.go:632] Waited for 198.105799ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:26.525578 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:26.525606 19703 round_trippers.go:469] Request Headers:
I1105 10:04:26.525616 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:26.525621 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:26.529215 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:04:26.529581 19703 pod_ready.go:93] pod "kube-controller-manager-ha-213000-m03" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:26.529590 19703 pod_ready.go:82] duration metric: took 400.941913ms for pod "kube-controller-manager-ha-213000-m03" in "kube-system" namespace to be "Ready" ...
I1105 10:04:26.529597 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-5ldvg" in "kube-system" namespace to be "Ready" ...
I1105 10:04:26.726009 19703 request.go:632] Waited for 196.373053ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-proxy-5ldvg
I1105 10:04:26.726076 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-proxy-5ldvg
I1105 10:04:26.726082 19703 round_trippers.go:469] Request Headers:
I1105 10:04:26.726088 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:26.726092 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:26.728138 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:26.925481 19703 request.go:632] Waited for 196.839411ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:26.925524 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:26.925543 19703 round_trippers.go:469] Request Headers:
I1105 10:04:26.925555 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:26.925559 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:26.927642 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:26.927909 19703 pod_ready.go:93] pod "kube-proxy-5ldvg" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:26.927918 19703 pod_ready.go:82] duration metric: took 398.31947ms for pod "kube-proxy-5ldvg" in "kube-system" namespace to be "Ready" ...
I1105 10:04:26.927925 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-s52w5" in "kube-system" namespace to be "Ready" ...
I1105 10:04:27.124645 19703 request.go:632] Waited for 196.662774ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-proxy-s52w5
I1105 10:04:27.124698 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-proxy-s52w5
I1105 10:04:27.124740 19703 round_trippers.go:469] Request Headers:
I1105 10:04:27.124753 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:27.124761 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:27.128295 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:04:27.325739 19703 request.go:632] Waited for 196.804785ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:04:27.325845 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:04:27.325854 19703 round_trippers.go:469] Request Headers:
I1105 10:04:27.325862 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:27.325867 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:27.328452 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:27.328710 19703 pod_ready.go:93] pod "kube-proxy-s52w5" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:27.328719 19703 pod_ready.go:82] duration metric: took 400.792251ms for pod "kube-proxy-s52w5" in "kube-system" namespace to be "Ready" ...
I1105 10:04:27.328725 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-s8xxj" in "kube-system" namespace to be "Ready" ...
I1105 10:04:27.525473 19703 request.go:632] Waited for 196.70325ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-proxy-s8xxj
I1105 10:04:27.525570 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-proxy-s8xxj
I1105 10:04:27.525581 19703 round_trippers.go:469] Request Headers:
I1105 10:04:27.525593 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:27.525602 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:27.528326 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:27.725203 19703 request.go:632] Waited for 196.519889ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:04:27.725279 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:04:27.725285 19703 round_trippers.go:469] Request Headers:
I1105 10:04:27.725292 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:27.725297 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:27.727708 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:27.728131 19703 pod_ready.go:93] pod "kube-proxy-s8xxj" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:27.728140 19703 pod_ready.go:82] duration metric: took 399.413452ms for pod "kube-proxy-s8xxj" in "kube-system" namespace to be "Ready" ...
I1105 10:04:27.728146 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:04:27.924670 19703 request.go:632] Waited for 196.486132ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-213000
I1105 10:04:27.924745 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-213000
I1105 10:04:27.924768 19703 round_trippers.go:469] Request Headers:
I1105 10:04:27.924780 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:27.924785 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:27.926872 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:28.126299 19703 request.go:632] Waited for 199.099089ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:04:28.126434 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000
I1105 10:04:28.126444 19703 round_trippers.go:469] Request Headers:
I1105 10:04:28.126455 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:28.126469 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:28.129846 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:04:28.130229 19703 pod_ready.go:93] pod "kube-scheduler-ha-213000" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:28.130241 19703 pod_ready.go:82] duration metric: took 402.092729ms for pod "kube-scheduler-ha-213000" in "kube-system" namespace to be "Ready" ...
I1105 10:04:28.130250 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:04:28.325028 19703 request.go:632] Waited for 194.730914ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-213000-m02
I1105 10:04:28.325106 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-213000-m02
I1105 10:04:28.325115 19703 round_trippers.go:469] Request Headers:
I1105 10:04:28.325127 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:28.325137 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:28.327834 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:28.524776 19703 request.go:632] Waited for 196.527612ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:04:28.524860 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m02
I1105 10:04:28.524877 19703 round_trippers.go:469] Request Headers:
I1105 10:04:28.524889 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:28.524897 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:28.528055 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:04:28.528583 19703 pod_ready.go:93] pod "kube-scheduler-ha-213000-m02" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:28.528595 19703 pod_ready.go:82] duration metric: took 398.343246ms for pod "kube-scheduler-ha-213000-m02" in "kube-system" namespace to be "Ready" ...
I1105 10:04:28.528604 19703 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-213000-m03" in "kube-system" namespace to be "Ready" ...
I1105 10:04:28.724665 19703 request.go:632] Waited for 196.022312ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-213000-m03
I1105 10:04:28.724698 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-213000-m03
I1105 10:04:28.724704 19703 round_trippers.go:469] Request Headers:
I1105 10:04:28.724714 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:28.724740 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:28.726671 19703 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I1105 10:04:28.924585 19703 request.go:632] Waited for 197.482088ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:28.924621 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes/ha-213000-m03
I1105 10:04:28.924626 19703 round_trippers.go:469] Request Headers:
I1105 10:04:28.924638 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:28.924641 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:28.927175 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:28.927434 19703 pod_ready.go:93] pod "kube-scheduler-ha-213000-m03" in "kube-system" namespace has status "Ready":"True"
I1105 10:04:28.927445 19703 pod_ready.go:82] duration metric: took 398.83876ms for pod "kube-scheduler-ha-213000-m03" in "kube-system" namespace to be "Ready" ...
I1105 10:04:28.927453 19703 pod_ready.go:39] duration metric: took 6.40037569s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1105 10:04:28.927464 19703 api_server.go:52] waiting for apiserver process to appear ...
I1105 10:04:28.927539 19703 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1105 10:04:28.939767 19703 api_server.go:72] duration metric: took 22.850118644s to wait for apiserver process to appear ...
I1105 10:04:28.939780 19703 api_server.go:88] waiting for apiserver healthz status ...
I1105 10:04:28.939792 19703 api_server.go:253] Checking apiserver healthz at https://192.169.0.5:8443/healthz ...
I1105 10:04:28.942841 19703 api_server.go:279] https://192.169.0.5:8443/healthz returned 200:
ok
I1105 10:04:28.942878 19703 round_trippers.go:463] GET https://192.169.0.5:8443/version
I1105 10:04:28.942883 19703 round_trippers.go:469] Request Headers:
I1105 10:04:28.942889 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:28.942894 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:28.943424 19703 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds
I1105 10:04:28.943458 19703 api_server.go:141] control plane version: v1.31.2
I1105 10:04:28.943466 19703 api_server.go:131] duration metric: took 3.681494ms to wait for apiserver health ...
I1105 10:04:28.943471 19703 system_pods.go:43] waiting for kube-system pods to appear ...
I1105 10:04:29.125181 19703 request.go:632] Waited for 181.649913ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods
I1105 10:04:29.125250 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods
I1105 10:04:29.125257 19703 round_trippers.go:469] Request Headers:
I1105 10:04:29.125265 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:29.125273 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:29.129049 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:04:29.134047 19703 system_pods.go:59] 24 kube-system pods found
I1105 10:04:29.134060 19703 system_pods.go:61] "coredns-7c65d6cfc9-cv2cc" [b6d32d7c-e03f-4a60-a2eb-e81042e65e49] Running
I1105 10:04:29.134064 19703 system_pods.go:61] "coredns-7c65d6cfc9-q96rw" [cb820265-326d-4e02-b187-0f30754bcd99] Running
I1105 10:04:29.134067 19703 system_pods.go:61] "etcd-ha-213000" [1d431f2a-8064-4bc9-bc70-913243f83645] Running
I1105 10:04:29.134070 19703 system_pods.go:61] "etcd-ha-213000-m02" [da6eb444-2c2a-4c8a-82ab-13a543bf0fa0] Running
I1105 10:04:29.134073 19703 system_pods.go:61] "etcd-ha-213000-m03" [c436cc0a-5d4c-473d-90cb-fb3b834c9619] Running
I1105 10:04:29.134076 19703 system_pods.go:61] "kindnet-hppzk" [3f615ca1-027e-42fe-ad0c-943f7686805f] Running
I1105 10:04:29.134078 19703 system_pods.go:61] "kindnet-pf9hr" [320af5ac-d6b6-4fc4-ac52-1b35b9c81ce7] Running
I1105 10:04:29.134083 19703 system_pods.go:61] "kindnet-trfhn" [6f39544f-a014-444c-8ad7-779e1940d254] Running
I1105 10:04:29.134089 19703 system_pods.go:61] "kube-apiserver-ha-213000" [a32fee4d-29c9-4919-9554-351393c17408] Running
I1105 10:04:29.134092 19703 system_pods.go:61] "kube-apiserver-ha-213000-m02" [0e69e69b-f4a1-4c5b-a78b-d18411aecae8] Running
I1105 10:04:29.134095 19703 system_pods.go:61] "kube-apiserver-ha-213000-m03" [d02cef75-3c45-45bb-b7ec-3f499d518930] Running
I1105 10:04:29.134098 19703 system_pods.go:61] "kube-controller-manager-ha-213000" [0405dcb5-6322-47fe-b929-22f12fd80b1b] Running
I1105 10:04:29.134101 19703 system_pods.go:61] "kube-controller-manager-ha-213000-m02" [06d77930-6b69-471d-9139-f454d903c918] Running
I1105 10:04:29.134103 19703 system_pods.go:61] "kube-controller-manager-ha-213000-m03" [5dfd056c-cf27-470b-9d96-cf1ae48c02cd] Running
I1105 10:04:29.134106 19703 system_pods.go:61] "kube-proxy-5ldvg" [945c7b43-9b2e-4610-b203-74c4b971e981] Running
I1105 10:04:29.134109 19703 system_pods.go:61] "kube-proxy-s52w5" [08e6c33b-72c8-4277-9d0f-c8257490cc64] Running
I1105 10:04:29.134113 19703 system_pods.go:61] "kube-proxy-s8xxj" [416d3e9e-efe2-42fe-9a62-6bf5ebc884ae] Running
I1105 10:04:29.134116 19703 system_pods.go:61] "kube-scheduler-ha-213000" [ea19a8b5-3829-4b24-ac87-fd5f74b755d4] Running
I1105 10:04:29.134119 19703 system_pods.go:61] "kube-scheduler-ha-213000-m02" [f26961d7-33d3-417a-87fd-3c6911dcb46a] Running
I1105 10:04:29.134121 19703 system_pods.go:61] "kube-scheduler-ha-213000-m03" [428462e8-71f8-4cd6-920b-024e83e6251e] Running
I1105 10:04:29.134124 19703 system_pods.go:61] "kube-vip-ha-213000" [970e81e4-8295-4cc4-9b62-b943e6e6a003] Running
I1105 10:04:29.134126 19703 system_pods.go:61] "kube-vip-ha-213000-m02" [bb20bc57-fecb-4ff7-937e-59d4a6303c32] Running
I1105 10:04:29.134129 19703 system_pods.go:61] "kube-vip-ha-213000-m03" [4589347d-3131-41ad-822d-d41f3e03a634] Running
I1105 10:04:29.134131 19703 system_pods.go:61] "storage-provisioner" [e7f00930-b382-473c-be59-04504c6e23ff] Running
I1105 10:04:29.134136 19703 system_pods.go:74] duration metric: took 190.663227ms to wait for pod list to return data ...
I1105 10:04:29.134141 19703 default_sa.go:34] waiting for default service account to be created ...
I1105 10:04:29.325174 19703 request.go:632] Waited for 190.972254ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/default/serviceaccounts
I1105 10:04:29.325306 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/default/serviceaccounts
I1105 10:04:29.325317 19703 round_trippers.go:469] Request Headers:
I1105 10:04:29.325328 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:29.325334 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:29.328806 19703 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I1105 10:04:29.328877 19703 default_sa.go:45] found service account: "default"
I1105 10:04:29.328886 19703 default_sa.go:55] duration metric: took 194.742768ms for default service account to be created ...
I1105 10:04:29.328892 19703 system_pods.go:116] waiting for k8s-apps to be running ...
I1105 10:04:29.525825 19703 request.go:632] Waited for 196.894286ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods
I1105 10:04:29.525885 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/namespaces/kube-system/pods
I1105 10:04:29.525891 19703 round_trippers.go:469] Request Headers:
I1105 10:04:29.525900 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:29.525906 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:29.530238 19703 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I1105 10:04:29.535151 19703 system_pods.go:86] 24 kube-system pods found
I1105 10:04:29.535162 19703 system_pods.go:89] "coredns-7c65d6cfc9-cv2cc" [b6d32d7c-e03f-4a60-a2eb-e81042e65e49] Running
I1105 10:04:29.535166 19703 system_pods.go:89] "coredns-7c65d6cfc9-q96rw" [cb820265-326d-4e02-b187-0f30754bcd99] Running
I1105 10:04:29.535169 19703 system_pods.go:89] "etcd-ha-213000" [1d431f2a-8064-4bc9-bc70-913243f83645] Running
I1105 10:04:29.535173 19703 system_pods.go:89] "etcd-ha-213000-m02" [da6eb444-2c2a-4c8a-82ab-13a543bf0fa0] Running
I1105 10:04:29.535176 19703 system_pods.go:89] "etcd-ha-213000-m03" [c436cc0a-5d4c-473d-90cb-fb3b834c9619] Running
I1105 10:04:29.535179 19703 system_pods.go:89] "kindnet-hppzk" [3f615ca1-027e-42fe-ad0c-943f7686805f] Running
I1105 10:04:29.535182 19703 system_pods.go:89] "kindnet-pf9hr" [320af5ac-d6b6-4fc4-ac52-1b35b9c81ce7] Running
I1105 10:04:29.535186 19703 system_pods.go:89] "kindnet-trfhn" [6f39544f-a014-444c-8ad7-779e1940d254] Running
I1105 10:04:29.535189 19703 system_pods.go:89] "kube-apiserver-ha-213000" [a32fee4d-29c9-4919-9554-351393c17408] Running
I1105 10:04:29.535192 19703 system_pods.go:89] "kube-apiserver-ha-213000-m02" [0e69e69b-f4a1-4c5b-a78b-d18411aecae8] Running
I1105 10:04:29.535195 19703 system_pods.go:89] "kube-apiserver-ha-213000-m03" [d02cef75-3c45-45bb-b7ec-3f499d518930] Running
I1105 10:04:29.535198 19703 system_pods.go:89] "kube-controller-manager-ha-213000" [0405dcb5-6322-47fe-b929-22f12fd80b1b] Running
I1105 10:04:29.535203 19703 system_pods.go:89] "kube-controller-manager-ha-213000-m02" [06d77930-6b69-471d-9139-f454d903c918] Running
I1105 10:04:29.535206 19703 system_pods.go:89] "kube-controller-manager-ha-213000-m03" [5dfd056c-cf27-470b-9d96-cf1ae48c02cd] Running
I1105 10:04:29.535209 19703 system_pods.go:89] "kube-proxy-5ldvg" [945c7b43-9b2e-4610-b203-74c4b971e981] Running
I1105 10:04:29.535212 19703 system_pods.go:89] "kube-proxy-s52w5" [08e6c33b-72c8-4277-9d0f-c8257490cc64] Running
I1105 10:04:29.535214 19703 system_pods.go:89] "kube-proxy-s8xxj" [416d3e9e-efe2-42fe-9a62-6bf5ebc884ae] Running
I1105 10:04:29.535217 19703 system_pods.go:89] "kube-scheduler-ha-213000" [ea19a8b5-3829-4b24-ac87-fd5f74b755d4] Running
I1105 10:04:29.535220 19703 system_pods.go:89] "kube-scheduler-ha-213000-m02" [f26961d7-33d3-417a-87fd-3c6911dcb46a] Running
I1105 10:04:29.535224 19703 system_pods.go:89] "kube-scheduler-ha-213000-m03" [428462e8-71f8-4cd6-920b-024e83e6251e] Running
I1105 10:04:29.535226 19703 system_pods.go:89] "kube-vip-ha-213000" [970e81e4-8295-4cc4-9b62-b943e6e6a003] Running
I1105 10:04:29.535229 19703 system_pods.go:89] "kube-vip-ha-213000-m02" [bb20bc57-fecb-4ff7-937e-59d4a6303c32] Running
I1105 10:04:29.535232 19703 system_pods.go:89] "kube-vip-ha-213000-m03" [4589347d-3131-41ad-822d-d41f3e03a634] Running
I1105 10:04:29.535236 19703 system_pods.go:89] "storage-provisioner" [e7f00930-b382-473c-be59-04504c6e23ff] Running
I1105 10:04:29.535241 19703 system_pods.go:126] duration metric: took 206.346852ms to wait for k8s-apps to be running ...
I1105 10:04:29.535246 19703 system_svc.go:44] waiting for kubelet service to be running ....
I1105 10:04:29.535311 19703 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I1105 10:04:29.546979 19703 system_svc.go:56] duration metric: took 11.728241ms WaitForService to wait for kubelet
I1105 10:04:29.546999 19703 kubeadm.go:582] duration metric: took 23.457354958s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1105 10:04:29.547010 19703 node_conditions.go:102] verifying NodePressure condition ...
I1105 10:04:29.724995 19703 request.go:632] Waited for 177.933168ms due to client-side throttling, not priority and fairness, request: GET:https://192.169.0.5:8443/api/v1/nodes
I1105 10:04:29.725067 19703 round_trippers.go:463] GET https://192.169.0.5:8443/api/v1/nodes
I1105 10:04:29.725074 19703 round_trippers.go:469] Request Headers:
I1105 10:04:29.725082 19703 round_trippers.go:473] Accept: application/json, */*
I1105 10:04:29.725088 19703 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I1105 10:04:29.727706 19703 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I1105 10:04:29.728430 19703 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki
I1105 10:04:29.728439 19703 node_conditions.go:123] node cpu capacity is 2
I1105 10:04:29.728446 19703 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki
I1105 10:04:29.728449 19703 node_conditions.go:123] node cpu capacity is 2
I1105 10:04:29.728453 19703 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki
I1105 10:04:29.728456 19703 node_conditions.go:123] node cpu capacity is 2
I1105 10:04:29.728459 19703 node_conditions.go:105] duration metric: took 181.447674ms to run NodePressure ...
I1105 10:04:29.728466 19703 start.go:241] waiting for startup goroutines ...
I1105 10:04:29.728479 19703 start.go:255] writing updated cluster config ...
I1105 10:04:29.729489 19703 ssh_runner.go:195] Run: rm -f paused
I1105 10:04:29.979871 19703 start.go:600] kubectl: 1.30.2, cluster: 1.31.2 (minor skew: 1)
I1105 10:04:30.017888 19703 out.go:177] * Done! kubectl is now configured to use "ha-213000" cluster and "default" namespace by default
==> Docker <==
Nov 05 18:01:50 ha-213000 cri-dockerd[1127]: time="2024-11-05T18:01:50Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/8d756c554cb1804008ed0d83f76add780a56ab524ce9ad727444994833786ca2/resolv.conf as [nameserver 192.169.0.1]"
Nov 05 18:01:50 ha-213000 cri-dockerd[1127]: time="2024-11-05T18:01:50Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/14a06ee63dae33c8dba35c6c5dae9567da2ca60899210abc9f317c0880b139fc/resolv.conf as [nameserver 192.169.0.1]"
Nov 05 18:01:50 ha-213000 cri-dockerd[1127]: time="2024-11-05T18:01:50Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/fc924e17f3bb751fc1e52153e5ef02a65f98bbb979139ce33eaa22d0798983b8/resolv.conf as [nameserver 192.169.0.1]"
Nov 05 18:01:50 ha-213000 dockerd[1237]: time="2024-11-05T18:01:50.967239546Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Nov 05 18:01:50 ha-213000 dockerd[1237]: time="2024-11-05T18:01:50.967309107Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 05 18:01:50 ha-213000 dockerd[1237]: time="2024-11-05T18:01:50.967317540Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Nov 05 18:01:50 ha-213000 dockerd[1237]: time="2024-11-05T18:01:50.967390804Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Nov 05 18:01:51 ha-213000 dockerd[1237]: time="2024-11-05T18:01:51.107710141Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Nov 05 18:01:51 ha-213000 dockerd[1237]: time="2024-11-05T18:01:51.107910037Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 05 18:01:51 ha-213000 dockerd[1237]: time="2024-11-05T18:01:51.107968019Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Nov 05 18:01:51 ha-213000 dockerd[1237]: time="2024-11-05T18:01:51.108244444Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Nov 05 18:01:51 ha-213000 dockerd[1237]: time="2024-11-05T18:01:51.119482556Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Nov 05 18:01:51 ha-213000 dockerd[1237]: time="2024-11-05T18:01:51.119770623Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 05 18:01:51 ha-213000 dockerd[1237]: time="2024-11-05T18:01:51.119883235Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Nov 05 18:01:51 ha-213000 dockerd[1237]: time="2024-11-05T18:01:51.120049510Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Nov 05 18:04:31 ha-213000 dockerd[1237]: time="2024-11-05T18:04:31.619993345Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Nov 05 18:04:31 ha-213000 dockerd[1237]: time="2024-11-05T18:04:31.620106148Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 05 18:04:31 ha-213000 dockerd[1237]: time="2024-11-05T18:04:31.620120050Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Nov 05 18:04:31 ha-213000 dockerd[1237]: time="2024-11-05T18:04:31.620209774Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Nov 05 18:04:31 ha-213000 cri-dockerd[1127]: time="2024-11-05T18:04:31Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/a852f09c7c372466d6eaee2bbf93a0549f278dabf6e08a4bff1ae7c770405574/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local options ndots:5]"
Nov 05 18:04:33 ha-213000 cri-dockerd[1127]: time="2024-11-05T18:04:33Z" level=info msg="Stop pulling image gcr.io/k8s-minikube/busybox:1.28: Status: Downloaded newer image for gcr.io/k8s-minikube/busybox:1.28"
Nov 05 18:04:33 ha-213000 dockerd[1237]: time="2024-11-05T18:04:33.358121990Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Nov 05 18:04:33 ha-213000 dockerd[1237]: time="2024-11-05T18:04:33.358264406Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 05 18:04:33 ha-213000 dockerd[1237]: time="2024-11-05T18:04:33.358298713Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Nov 05 18:04:33 ha-213000 dockerd[1237]: time="2024-11-05T18:04:33.358445332Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
13c126a54f1e3 gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12 3 minutes ago Running busybox 0 a852f09c7c372 busybox-7dff88458-q5j74
655c6025b3ad3 c69fa2e9cbf5f 6 minutes ago Running coredns 0 fc924e17f3bb7 coredns-7c65d6cfc9-cv2cc
478b52af51d4c c69fa2e9cbf5f 6 minutes ago Running coredns 0 14a06ee63dae3 coredns-7c65d6cfc9-q96rw
a696b9219e867 6e38f40d628db 6 minutes ago Running storage-provisioner 0 8d756c554cb18 storage-provisioner
c15d829a94cc1 kindest/kindnetd@sha256:cddd34f7d74bf898f14080ed61e322a492689043dae46e93106c013373d68d16 6 minutes ago Running kindnet-cni 0 fc1560dd926ec kindnet-hppzk
1707dd1e7b710 505d571f5fd56 6 minutes ago Running kube-proxy 0 c677886629450 kube-proxy-s8xxj
e133549e344f8 ghcr.io/kube-vip/kube-vip@sha256:1ba8e6e7fe678a8779986a6b88a1f391c63f7fe3edd34b167dceed3f66e8c87e 6 minutes ago Running kube-vip 0 c50c39a35d466 kube-vip-ha-213000
a3c0c64a3782d 9499c9960544e 6 minutes ago Running kube-apiserver 0 c31f45140546c kube-apiserver-ha-213000
0ea9be13ab8cd 847c7bc1a5418 6 minutes ago Running kube-scheduler 0 e5947d7e736c7 kube-scheduler-ha-213000
968f538b61d4e 2e96e5913fc06 6 minutes ago Running etcd 0 75b49749f37e9 etcd-ha-213000
3abc7a0629ac1 0486b6c53a1b5 6 minutes ago Running kube-controller-manager 0 356e1160051cf kube-controller-manager-ha-213000
==> coredns [478b52af51d4] <==
[INFO] 10.244.0.4:55854 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000091157s
[INFO] 10.244.0.4:46292 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000064292s
[INFO] 10.244.0.4:40657 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000075287s
[INFO] 10.244.0.4:40797 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000047063s
[INFO] 10.244.0.4:57944 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000092384s
[INFO] 10.244.2.2:46924 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000091299s
[INFO] 10.244.2.2:58313 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000054156s
[INFO] 10.244.2.2:60784 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000097833s
[INFO] 10.244.2.2:45453 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000050266s
[INFO] 10.244.2.2:34445 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000089937s
[INFO] 10.244.2.2:47005 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000097467s
[INFO] 10.244.1.2:50221 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000057047s
[INFO] 10.244.1.2:57677 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000089203s
[INFO] 10.244.0.4:55860 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000068653s
[INFO] 10.244.2.2:43135 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000074016s
[INFO] 10.244.2.2:55939 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000120434s
[INFO] 10.244.2.2:50062 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00004236s
[INFO] 10.244.1.2:47130 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000093036s
[INFO] 10.244.1.2:36124 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000107815s
[INFO] 10.244.1.2:47802 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.0000854s
[INFO] 10.244.1.2:50939 - 5 "PTR IN 1.0.169.192.in-addr.arpa. udp 42 false 512" NOERROR qr,aa,rd 102 0.000076401s
[INFO] 10.244.0.4:52439 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000046668s
[INFO] 10.244.0.4:59917 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000065899s
[INFO] 10.244.2.2:54610 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000146586s
[INFO] 10.244.2.2:44903 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000045712s
==> coredns [655c6025b3ad] <==
linux/amd64, go1.21.11, a6338e9
[INFO] 127.0.0.1:41565 - 52279 "HINFO IN 3928448342492679704.6484769811595158491. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.01055942s
[INFO] 10.244.1.2:44772 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.001930473s
[INFO] 10.244.1.2:55396 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 140 0.173730652s
[INFO] 10.244.1.2:55075 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 60 0.046822424s
[INFO] 10.244.2.2:46916 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 140 0.000083419s
[INFO] 10.244.2.2:50720 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 60 0.00010115s
[INFO] 10.244.1.2:40476 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000129724s
[INFO] 10.244.1.2:38997 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000096588s
[INFO] 10.244.1.2:47386 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000084243s
[INFO] 10.244.0.4:36440 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 111 0.000654701s
[INFO] 10.244.0.4:54567 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000087223s
[INFO] 10.244.0.4:51050 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000103169s
[INFO] 10.244.2.2:55487 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 111 0.00066824s
[INFO] 10.244.2.2:46388 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000075057s
[INFO] 10.244.1.2:44219 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000153172s
[INFO] 10.244.1.2:57067 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00012789s
[INFO] 10.244.0.4:39514 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000159605s
[INFO] 10.244.0.4:48601 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000049327s
[INFO] 10.244.0.4:42037 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000113025s
[INFO] 10.244.2.2:54065 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000100908s
[INFO] 10.244.0.4:48546 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000091627s
[INFO] 10.244.0.4:58260 - 5 "PTR IN 1.0.169.192.in-addr.arpa. udp 42 false 512" NOERROR qr,aa,rd 102 0.000121652s
[INFO] 10.244.2.2:59084 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000090378s
[INFO] 10.244.2.2:46960 - 5 "PTR IN 1.0.169.192.in-addr.arpa. udp 42 false 512" NOERROR qr,aa,rd 102 0.000044449s
==> describe nodes <==
Name: ha-213000
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-213000
kubernetes.io/os=linux
minikube.k8s.io/commit=47b0afc9e70653f81ca813437c4c46b74450b911
minikube.k8s.io/name=ha-213000
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_11_05T10_01_27_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 05 Nov 2024 18:01:23 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-213000
AcquireTime: <unset>
RenewTime: Tue, 05 Nov 2024 18:07:56 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Tue, 05 Nov 2024 18:05:01 +0000 Tue, 05 Nov 2024 18:01:22 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Tue, 05 Nov 2024 18:05:01 +0000 Tue, 05 Nov 2024 18:01:22 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Tue, 05 Nov 2024 18:05:01 +0000 Tue, 05 Nov 2024 18:01:22 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Tue, 05 Nov 2024 18:05:01 +0000 Tue, 05 Nov 2024 18:01:50 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.169.0.5
Hostname: ha-213000
Capacity:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 2164336Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 2164336Ki
pods: 110
System Info:
Machine ID: a564c48e26a04536b809c68ac140133d
System UUID: 17364deb-0000-0000-8a00-7267ff6ac6e0
Boot ID: a364bf87-b805-465e-9b8e-7bb15a7511fd
Kernel Version: 5.10.207
OS Image: Buildroot 2023.02.9
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://27.3.1
Kubelet Version: v1.31.2
Kube-Proxy Version: v1.31.2
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-7dff88458-q5j74 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3m30s
kube-system coredns-7c65d6cfc9-cv2cc 100m (5%) 0 (0%) 70Mi (3%) 170Mi (8%) 6m31s
kube-system coredns-7c65d6cfc9-q96rw 100m (5%) 0 (0%) 70Mi (3%) 170Mi (8%) 6m31s
kube-system etcd-ha-213000 100m (5%) 0 (0%) 100Mi (4%) 0 (0%) 6m35s
kube-system kindnet-hppzk 100m (5%) 100m (5%) 50Mi (2%) 50Mi (2%) 6m31s
kube-system kube-apiserver-ha-213000 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m35s
kube-system kube-controller-manager-ha-213000 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m37s
kube-system kube-proxy-s8xxj 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m31s
kube-system kube-scheduler-ha-213000 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m37s
kube-system kube-vip-ha-213000 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m37s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m30s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%) 100m (5%)
memory 290Mi (13%) 390Mi (18%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m28s kube-proxy
Normal NodeHasSufficientPID 6m42s (x7 over 6m42s) kubelet Node ha-213000 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m42s kubelet Updated Node Allocatable limit across pods
Normal Starting 6m42s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 6m42s (x8 over 6m42s) kubelet Node ha-213000 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m42s (x8 over 6m42s) kubelet Node ha-213000 status is now: NodeHasNoDiskPressure
Normal Starting 6m35s kubelet Starting kubelet.
Normal NodeAllocatableEnforced 6m35s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m35s kubelet Node ha-213000 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m35s kubelet Node ha-213000 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m35s kubelet Node ha-213000 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m32s node-controller Node ha-213000 event: Registered Node ha-213000 in Controller
Normal NodeReady 6m11s kubelet Node ha-213000 status is now: NodeReady
Normal RegisteredNode 5m5s node-controller Node ha-213000 event: Registered Node ha-213000 in Controller
Normal RegisteredNode 3m51s node-controller Node ha-213000 event: Registered Node ha-213000 in Controller
Name: ha-213000-m02
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-213000-m02
kubernetes.io/os=linux
minikube.k8s.io/commit=47b0afc9e70653f81ca813437c4c46b74450b911
minikube.k8s.io/name=ha-213000
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_11_05T10_02_51_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 05 Nov 2024 18:02:49 +0000
Taints: node.kubernetes.io/unreachable:NoExecute
node.kubernetes.io/unreachable:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: ha-213000-m02
AcquireTime: <unset>
RenewTime: Tue, 05 Nov 2024 18:05:32 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure Unknown Tue, 05 Nov 2024 18:04:51 +0000 Tue, 05 Nov 2024 18:06:15 +0000 NodeStatusUnknown Kubelet stopped posting node status.
DiskPressure Unknown Tue, 05 Nov 2024 18:04:51 +0000 Tue, 05 Nov 2024 18:06:15 +0000 NodeStatusUnknown Kubelet stopped posting node status.
PIDPressure Unknown Tue, 05 Nov 2024 18:04:51 +0000 Tue, 05 Nov 2024 18:06:15 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Ready Unknown Tue, 05 Nov 2024 18:04:51 +0000 Tue, 05 Nov 2024 18:06:15 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Addresses:
InternalIP: 192.169.0.6
Hostname: ha-213000-m02
Capacity:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 2164336Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 2164336Ki
pods: 110
System Info:
Machine ID: fe9d6fab7c594c258d6faf081338352a
System UUID: 8475486e-0000-0000-b8b0-772de8e0415c
Boot ID: 648e1173-cbdb-42eb-9fce-79e6f778bcc4
Kernel Version: 5.10.207
OS Image: Buildroot 2023.02.9
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://27.3.1
Kubelet Version: v1.31.2
Kube-Proxy Version: v1.31.2
PodCIDR: 10.244.1.0/24
PodCIDRs: 10.244.1.0/24
Non-terminated Pods: (8 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-7dff88458-89r49 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3m30s
kube-system etcd-ha-213000-m02 100m (5%) 0 (0%) 100Mi (4%) 0 (0%) 5m10s
kube-system kindnet-pf9hr 100m (5%) 100m (5%) 50Mi (2%) 50Mi (2%) 5m12s
kube-system kube-apiserver-ha-213000-m02 250m (12%) 0 (0%) 0 (0%) 0 (0%) 5m11s
kube-system kube-controller-manager-ha-213000-m02 200m (10%) 0 (0%) 0 (0%) 0 (0%) 5m11s
kube-system kube-proxy-s52w5 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m12s
kube-system kube-scheduler-ha-213000-m02 100m (5%) 0 (0%) 0 (0%) 0 (0%) 5m11s
kube-system kube-vip-ha-213000-m02 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m8s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%) 100m (5%)
memory 150Mi (7%) 50Mi (2%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 5m8s kube-proxy
Normal NodeHasSufficientMemory 5m12s (x8 over 5m12s) kubelet Node ha-213000-m02 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m12s (x8 over 5m12s) kubelet Node ha-213000-m02 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 5m12s (x7 over 5m12s) kubelet Node ha-213000-m02 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m12s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 5m11s node-controller Node ha-213000-m02 event: Registered Node ha-213000-m02 in Controller
Normal RegisteredNode 5m5s node-controller Node ha-213000-m02 event: Registered Node ha-213000-m02 in Controller
Normal RegisteredNode 3m51s node-controller Node ha-213000-m02 event: Registered Node ha-213000-m02 in Controller
Normal NodeNotReady 106s node-controller Node ha-213000-m02 status is now: NodeNotReady
Name: ha-213000-m03
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-213000-m03
kubernetes.io/os=linux
minikube.k8s.io/commit=47b0afc9e70653f81ca813437c4c46b74450b911
minikube.k8s.io/name=ha-213000
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_11_05T10_04_05_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 05 Nov 2024 18:04:03 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-213000-m03
AcquireTime: <unset>
RenewTime: Tue, 05 Nov 2024 18:07:59 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Tue, 05 Nov 2024 18:05:04 +0000 Tue, 05 Nov 2024 18:04:03 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Tue, 05 Nov 2024 18:05:04 +0000 Tue, 05 Nov 2024 18:04:03 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Tue, 05 Nov 2024 18:05:04 +0000 Tue, 05 Nov 2024 18:04:03 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Tue, 05 Nov 2024 18:05:04 +0000 Tue, 05 Nov 2024 18:04:22 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.169.0.7
Hostname: ha-213000-m03
Capacity:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 2164336Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 2164336Ki
pods: 110
System Info:
Machine ID: 36fce1bb5353483a8c61e47d06795490
System UUID: 9e834703-0000-0000-a798-2d165259ce86
Boot ID: 52f0306a-86b9-41a1-bf8e-c6bebad66edd
Kernel Version: 5.10.207
OS Image: Buildroot 2023.02.9
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://27.3.1
Kubelet Version: v1.31.2
Kube-Proxy Version: v1.31.2
PodCIDR: 10.244.2.0/24
PodCIDRs: 10.244.2.0/24
Non-terminated Pods: (8 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-7dff88458-x9hwg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3m30s
kube-system etcd-ha-213000-m03 100m (5%) 0 (0%) 100Mi (4%) 0 (0%) 3m56s
kube-system kindnet-trfhn 100m (5%) 100m (5%) 50Mi (2%) 50Mi (2%) 3m58s
kube-system kube-apiserver-ha-213000-m03 250m (12%) 0 (0%) 0 (0%) 0 (0%) 3m56s
kube-system kube-controller-manager-ha-213000-m03 200m (10%) 0 (0%) 0 (0%) 0 (0%) 3m54s
kube-system kube-proxy-5ldvg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3m58s
kube-system kube-scheduler-ha-213000-m03 100m (5%) 0 (0%) 0 (0%) 0 (0%) 3m53s
kube-system kube-vip-ha-213000-m03 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3m54s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%) 100m (5%)
memory 150Mi (7%) 50Mi (2%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 3m54s kube-proxy
Normal NodeHasSufficientMemory 3m58s (x8 over 3m58s) kubelet Node ha-213000-m03 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 3m58s (x8 over 3m58s) kubelet Node ha-213000-m03 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 3m58s (x7 over 3m58s) kubelet Node ha-213000-m03 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 3m58s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 3m56s node-controller Node ha-213000-m03 event: Registered Node ha-213000-m03 in Controller
Normal RegisteredNode 3m55s node-controller Node ha-213000-m03 event: Registered Node ha-213000-m03 in Controller
Normal RegisteredNode 3m51s node-controller Node ha-213000-m03 event: Registered Node ha-213000-m03 in Controller
Name: ha-213000-m04
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ha-213000-m04
kubernetes.io/os=linux
minikube.k8s.io/commit=47b0afc9e70653f81ca813437c4c46b74450b911
minikube.k8s.io/name=ha-213000
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2024_11_05T10_04_59_0700
minikube.k8s.io/version=v1.34.0
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 05 Nov 2024 18:04:59 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-213000-m04
AcquireTime: <unset>
RenewTime: Tue, 05 Nov 2024 18:07:51 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Tue, 05 Nov 2024 18:05:29 +0000 Tue, 05 Nov 2024 18:04:59 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Tue, 05 Nov 2024 18:05:29 +0000 Tue, 05 Nov 2024 18:04:59 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Tue, 05 Nov 2024 18:05:29 +0000 Tue, 05 Nov 2024 18:04:59 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Tue, 05 Nov 2024 18:05:29 +0000 Tue, 05 Nov 2024 18:05:21 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.169.0.8
Hostname: ha-213000-m04
Capacity:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 2164336Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17734596Ki
hugepages-2Mi: 0
memory: 2164336Ki
pods: 110
System Info:
Machine ID: 9dbfab1abbaa466d920d386afdae83f4
System UUID: 70724edc-0000-0000-935c-43ebcacd790c
Boot ID: 7277bbeb-aa13-4ef8-b3e3-22ba82158b7a
Kernel Version: 5.10.207
OS Image: Buildroot 2023.02.9
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://27.3.1
Kubelet Version: v1.31.2
Kube-Proxy Version: v1.31.2
PodCIDR: 10.244.3.0/24
PodCIDRs: 10.244.3.0/24
Non-terminated Pods: (2 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system kindnet-p4bx6 100m (5%) 100m (5%) 50Mi (2%) 50Mi (2%) 3m2s
kube-system kube-proxy-m45pk 0 (0%) 0 (0%) 0 (0%) 0 (0%) 3m2s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (5%) 100m (5%)
memory 50Mi (2%) 50Mi (2%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 2m54s kube-proxy
Normal NodeHasSufficientMemory 3m2s (x2 over 3m3s) kubelet Node ha-213000-m04 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 3m2s (x2 over 3m3s) kubelet Node ha-213000-m04 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 3m2s (x2 over 3m3s) kubelet Node ha-213000-m04 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 3m2s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 3m1s node-controller Node ha-213000-m04 event: Registered Node ha-213000-m04 in Controller
Normal RegisteredNode 3m1s node-controller Node ha-213000-m04 event: Registered Node ha-213000-m04 in Controller
Normal RegisteredNode 3m node-controller Node ha-213000-m04 event: Registered Node ha-213000-m04 in Controller
Normal NodeReady 2m40s kubelet Node ha-213000-m04 status is now: NodeReady
==> dmesg <==
[ +2.822548] systemd-fstab-generator[127]: Ignoring "noauto" option for root device
[Nov 5 18:01] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000004] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000000] NFSD: Unable to initialize client recovery tracking! (-2)
[ +3.371107] systemd-fstab-generator[504]: Ignoring "noauto" option for root device
[ +0.098303] systemd-fstab-generator[518]: Ignoring "noauto" option for root device
[ +1.766719] systemd-fstab-generator[770]: Ignoring "noauto" option for root device
[ +0.299452] systemd-fstab-generator[839]: Ignoring "noauto" option for root device
[ +0.101798] systemd-fstab-generator[851]: Ignoring "noauto" option for root device
[ +0.116525] systemd-fstab-generator[865]: Ignoring "noauto" option for root device
[ +2.427440] systemd-fstab-generator[1080]: Ignoring "noauto" option for root device
[ +0.092436] systemd-fstab-generator[1092]: Ignoring "noauto" option for root device
[ +0.099684] systemd-fstab-generator[1104]: Ignoring "noauto" option for root device
[ +0.061433] kauditd_printk_skb: 233 callbacks suppressed
[ +0.078398] systemd-fstab-generator[1119]: Ignoring "noauto" option for root device
[ +3.438367] systemd-fstab-generator[1223]: Ignoring "noauto" option for root device
[ +2.210589] kauditd_printk_skb: 56 callbacks suppressed
[ +0.377139] systemd-fstab-generator[1479]: Ignoring "noauto" option for root device
[ +3.489712] systemd-fstab-generator[1610]: Ignoring "noauto" option for root device
[ +1.395421] kauditd_printk_skb: 80 callbacks suppressed
[ +5.860785] systemd-fstab-generator[2101]: Ignoring "noauto" option for root device
[ +0.083307] kauditd_printk_skb: 40 callbacks suppressed
[ +6.458645] kauditd_printk_skb: 12 callbacks suppressed
[ +17.344532] kauditd_printk_skb: 38 callbacks suppressed
[Nov 5 18:02] kauditd_printk_skb: 26 callbacks suppressed
==> etcd [968f538b61d4] <==
{"level":"warn","ts":"2024-11-05T18:07:34.774002Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"585aaf1d56a73c02","rtt":"713.08µs","error":"dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:35.466979Z","caller":"etcdserver/cluster_util.go:294","msg":"failed to reach the peer URL","address":"https://192.169.0.6:2380/version","remote-member-id":"585aaf1d56a73c02","error":"Get \"https://192.169.0.6:2380/version\": dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:35.467077Z","caller":"etcdserver/cluster_util.go:158","msg":"failed to get version","remote-member-id":"585aaf1d56a73c02","error":"Get \"https://192.169.0.6:2380/version\": dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:39.468800Z","caller":"etcdserver/cluster_util.go:294","msg":"failed to reach the peer URL","address":"https://192.169.0.6:2380/version","remote-member-id":"585aaf1d56a73c02","error":"Get \"https://192.169.0.6:2380/version\": dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:39.468851Z","caller":"etcdserver/cluster_util.go:158","msg":"failed to get version","remote-member-id":"585aaf1d56a73c02","error":"Get \"https://192.169.0.6:2380/version\": dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:39.774640Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"585aaf1d56a73c02","rtt":"713.08µs","error":"dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:39.774659Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"585aaf1d56a73c02","rtt":"6.613506ms","error":"dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:43.472095Z","caller":"etcdserver/cluster_util.go:294","msg":"failed to reach the peer URL","address":"https://192.169.0.6:2380/version","remote-member-id":"585aaf1d56a73c02","error":"Get \"https://192.169.0.6:2380/version\": dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:43.472267Z","caller":"etcdserver/cluster_util.go:158","msg":"failed to get version","remote-member-id":"585aaf1d56a73c02","error":"Get \"https://192.169.0.6:2380/version\": dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:44.775772Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"585aaf1d56a73c02","rtt":"6.613506ms","error":"dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:44.775850Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"585aaf1d56a73c02","rtt":"713.08µs","error":"dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:47.474289Z","caller":"etcdserver/cluster_util.go:294","msg":"failed to reach the peer URL","address":"https://192.169.0.6:2380/version","remote-member-id":"585aaf1d56a73c02","error":"Get \"https://192.169.0.6:2380/version\": dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:47.474371Z","caller":"etcdserver/cluster_util.go:158","msg":"failed to get version","remote-member-id":"585aaf1d56a73c02","error":"Get \"https://192.169.0.6:2380/version\": dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:49.776765Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"585aaf1d56a73c02","rtt":"713.08µs","error":"dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:49.776821Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"585aaf1d56a73c02","rtt":"6.613506ms","error":"dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:51.478515Z","caller":"etcdserver/cluster_util.go:294","msg":"failed to reach the peer URL","address":"https://192.169.0.6:2380/version","remote-member-id":"585aaf1d56a73c02","error":"Get \"https://192.169.0.6:2380/version\": dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:51.478565Z","caller":"etcdserver/cluster_util.go:158","msg":"failed to get version","remote-member-id":"585aaf1d56a73c02","error":"Get \"https://192.169.0.6:2380/version\": dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:54.777722Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"585aaf1d56a73c02","rtt":"6.613506ms","error":"dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:54.777784Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"585aaf1d56a73c02","rtt":"713.08µs","error":"dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:55.479532Z","caller":"etcdserver/cluster_util.go:294","msg":"failed to reach the peer URL","address":"https://192.169.0.6:2380/version","remote-member-id":"585aaf1d56a73c02","error":"Get \"https://192.169.0.6:2380/version\": dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:55.479668Z","caller":"etcdserver/cluster_util.go:158","msg":"failed to get version","remote-member-id":"585aaf1d56a73c02","error":"Get \"https://192.169.0.6:2380/version\": dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:59.481512Z","caller":"etcdserver/cluster_util.go:294","msg":"failed to reach the peer URL","address":"https://192.169.0.6:2380/version","remote-member-id":"585aaf1d56a73c02","error":"Get \"https://192.169.0.6:2380/version\": dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:59.481564Z","caller":"etcdserver/cluster_util.go:158","msg":"failed to get version","remote-member-id":"585aaf1d56a73c02","error":"Get \"https://192.169.0.6:2380/version\": dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:59.778796Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"585aaf1d56a73c02","rtt":"713.08µs","error":"dial tcp 192.169.0.6:2380: connect: connection refused"}
{"level":"warn","ts":"2024-11-05T18:07:59.778823Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"585aaf1d56a73c02","rtt":"6.613506ms","error":"dial tcp 192.169.0.6:2380: connect: connection refused"}
==> kernel <==
18:08:01 up 7 min, 0 users, load average: 0.27, 0.34, 0.18
Linux ha-213000 5.10.207 #1 SMP Wed Oct 30 13:38:35 UTC 2024 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2023.02.9"
==> kindnet [c15d829a94cc] <==
I1105 18:07:27.422022 1 main.go:324] Node ha-213000-m02 has CIDR [10.244.1.0/24]
I1105 18:07:37.414652 1 main.go:297] Handling node with IPs: map[192.169.0.8:{}]
I1105 18:07:37.414680 1 main.go:324] Node ha-213000-m04 has CIDR [10.244.3.0/24]
I1105 18:07:37.414837 1 main.go:297] Handling node with IPs: map[192.169.0.5:{}]
I1105 18:07:37.414873 1 main.go:301] handling current node
I1105 18:07:37.414884 1 main.go:297] Handling node with IPs: map[192.169.0.6:{}]
I1105 18:07:37.414910 1 main.go:324] Node ha-213000-m02 has CIDR [10.244.1.0/24]
I1105 18:07:37.414980 1 main.go:297] Handling node with IPs: map[192.169.0.7:{}]
I1105 18:07:37.415014 1 main.go:324] Node ha-213000-m03 has CIDR [10.244.2.0/24]
I1105 18:07:47.420917 1 main.go:297] Handling node with IPs: map[192.169.0.5:{}]
I1105 18:07:47.420936 1 main.go:301] handling current node
I1105 18:07:47.420946 1 main.go:297] Handling node with IPs: map[192.169.0.6:{}]
I1105 18:07:47.420949 1 main.go:324] Node ha-213000-m02 has CIDR [10.244.1.0/24]
I1105 18:07:47.421047 1 main.go:297] Handling node with IPs: map[192.169.0.7:{}]
I1105 18:07:47.421051 1 main.go:324] Node ha-213000-m03 has CIDR [10.244.2.0/24]
I1105 18:07:47.421211 1 main.go:297] Handling node with IPs: map[192.169.0.8:{}]
I1105 18:07:47.421219 1 main.go:324] Node ha-213000-m04 has CIDR [10.244.3.0/24]
I1105 18:07:57.414448 1 main.go:297] Handling node with IPs: map[192.169.0.5:{}]
I1105 18:07:57.414512 1 main.go:301] handling current node
I1105 18:07:57.414523 1 main.go:297] Handling node with IPs: map[192.169.0.6:{}]
I1105 18:07:57.414528 1 main.go:324] Node ha-213000-m02 has CIDR [10.244.1.0/24]
I1105 18:07:57.414708 1 main.go:297] Handling node with IPs: map[192.169.0.7:{}]
I1105 18:07:57.414734 1 main.go:324] Node ha-213000-m03 has CIDR [10.244.2.0/24]
I1105 18:07:57.414784 1 main.go:297] Handling node with IPs: map[192.169.0.8:{}]
I1105 18:07:57.414811 1 main.go:324] Node ha-213000-m04 has CIDR [10.244.3.0/24]
==> kube-apiserver [a3c0c64a3782] <==
I1105 18:01:24.508797 1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}
W1105 18:01:24.512609 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.169.0.5]
I1105 18:01:24.513340 1 controller.go:615] quota admission added evaluator for: endpoints
I1105 18:01:24.515760 1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1105 18:01:25.122836 1 controller.go:615] quota admission added evaluator for: serviceaccounts
I1105 18:01:26.576236 1 controller.go:615] quota admission added evaluator for: deployments.apps
I1105 18:01:26.588108 1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}
I1105 18:01:26.594865 1 controller.go:615] quota admission added evaluator for: daemonsets.apps
I1105 18:01:30.774314 1 controller.go:615] quota admission added evaluator for: replicasets.apps
I1105 18:01:30.832293 1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps
E1105 18:04:35.148097 1 conn.go:339] Error on socket receive: read tcp 192.169.0.254:8443->192.169.0.1:57771: use of closed network connection
E1105 18:04:35.373995 1 conn.go:339] Error on socket receive: read tcp 192.169.0.254:8443->192.169.0.1:57773: use of closed network connection
E1105 18:04:35.583158 1 conn.go:339] Error on socket receive: read tcp 192.169.0.254:8443->192.169.0.1:57775: use of closed network connection
E1105 18:04:35.792755 1 conn.go:339] Error on socket receive: read tcp 192.169.0.254:8443->192.169.0.1:57777: use of closed network connection
E1105 18:04:35.994700 1 conn.go:339] Error on socket receive: read tcp 192.169.0.254:8443->192.169.0.1:57779: use of closed network connection
E1105 18:04:36.197292 1 conn.go:339] Error on socket receive: read tcp 192.169.0.254:8443->192.169.0.1:57781: use of closed network connection
E1105 18:04:36.403420 1 conn.go:339] Error on socket receive: read tcp 192.169.0.254:8443->192.169.0.1:57783: use of closed network connection
E1105 18:04:36.603032 1 conn.go:339] Error on socket receive: read tcp 192.169.0.254:8443->192.169.0.1:57785: use of closed network connection
E1105 18:04:36.809398 1 conn.go:339] Error on socket receive: read tcp 192.169.0.254:8443->192.169.0.1:57787: use of closed network connection
E1105 18:04:37.166464 1 conn.go:339] Error on socket receive: read tcp 192.169.0.254:8443->192.169.0.1:57790: use of closed network connection
E1105 18:04:37.374005 1 conn.go:339] Error on socket receive: read tcp 192.169.0.254:8443->192.169.0.1:57792: use of closed network connection
E1105 18:04:37.593134 1 conn.go:339] Error on socket receive: read tcp 192.169.0.254:8443->192.169.0.1:57794: use of closed network connection
E1105 18:04:37.798340 1 conn.go:339] Error on socket receive: read tcp 192.169.0.254:8443->192.169.0.1:57796: use of closed network connection
E1105 18:04:37.996915 1 conn.go:339] Error on socket receive: read tcp 192.169.0.254:8443->192.169.0.1:57798: use of closed network connection
E1105 18:04:38.199615 1 conn.go:339] Error on socket receive: read tcp 192.169.0.254:8443->192.169.0.1:57800: use of closed network connection
==> kube-controller-manager [3abc7a0629ac] <==
I1105 18:04:59.206231 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m04"
I1105 18:04:59.206302 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m04"
I1105 18:04:59.622575 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m04"
I1105 18:04:59.926061 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m04"
I1105 18:05:00.639227 1 node_lifecycle_controller.go:884] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-213000-m04"
I1105 18:05:00.668381 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m04"
I1105 18:05:00.863718 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m04"
I1105 18:05:00.938911 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m04"
I1105 18:05:01.879354 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000"
I1105 18:05:01.917330 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m04"
I1105 18:05:02.023557 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m04"
I1105 18:05:04.331384 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m03"
I1105 18:05:09.430571 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m04"
I1105 18:05:21.686438 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m04"
I1105 18:05:21.687560 1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-213000-m04"
I1105 18:05:21.698524 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m04"
I1105 18:05:21.928429 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m04"
I1105 18:05:29.675436 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m04"
I1105 18:06:15.656491 1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-213000-m04"
I1105 18:06:15.656514 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m02"
I1105 18:06:15.666046 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m02"
I1105 18:06:15.680720 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-7dff88458" duration="6.448781ms"
I1105 18:06:15.680907 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-7dff88458" duration="122.823µs"
I1105 18:06:15.906178 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m02"
I1105 18:06:20.788789 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-213000-m02"
==> kube-proxy [1707dd1e7b71] <==
add table ip kube-proxy
^^^^^^^^^^^^^^^^^^^^^^^^
>
E1105 18:01:32.964306 1 proxier.go:734] "Error cleaning up nftables rules" err=<
could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported
add table ip6 kube-proxy
^^^^^^^^^^^^^^^^^^^^^^^^^
>
I1105 18:01:32.975224 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.169.0.5"]
E1105 18:01:32.975302 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1105 18:01:33.004972 1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"
I1105 18:01:33.005019 1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"
I1105 18:01:33.005036 1 server_linux.go:169] "Using iptables Proxier"
I1105 18:01:33.007241 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1105 18:01:33.007726 1 server.go:483] "Version info" version="v1.31.2"
I1105 18:01:33.007754 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1105 18:01:33.009040 1 config.go:199] "Starting service config controller"
I1105 18:01:33.009388 1 shared_informer.go:313] Waiting for caches to sync for service config
I1105 18:01:33.009596 1 config.go:105] "Starting endpoint slice config controller"
I1105 18:01:33.009623 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I1105 18:01:33.010305 1 config.go:328] "Starting node config controller"
I1105 18:01:33.010330 1 shared_informer.go:313] Waiting for caches to sync for node config
I1105 18:01:33.110597 1 shared_informer.go:320] Caches are synced for node config
I1105 18:01:33.110614 1 shared_informer.go:320] Caches are synced for service config
I1105 18:01:33.110623 1 shared_informer.go:320] Caches are synced for endpoint slice config
==> kube-scheduler [0ea9be13ab8c] <==
E1105 18:01:24.259190 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
I1105 18:01:26.254727 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
E1105 18:04:03.280280 1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-trfhn\": pod kindnet-trfhn is already assigned to node \"ha-213000-m03\"" plugin="DefaultBinder" pod="kube-system/kindnet-trfhn" node="ha-213000-m03"
E1105 18:04:03.285002 1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod 6f39544f-a014-444c-8ad7-779e1940d254(kube-system/kindnet-trfhn) wasn't assumed so cannot be forgotten" pod="kube-system/kindnet-trfhn"
E1105 18:04:03.285696 1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-trfhn\": pod kindnet-trfhn is already assigned to node \"ha-213000-m03\"" pod="kube-system/kindnet-trfhn"
I1105 18:04:03.285865 1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-trfhn" node="ha-213000-m03"
I1105 18:04:31.258177 1 cache.go:503] "Pod was added to a different node than it was assumed" podKey="69f86bc8-78ea-4277-b688-fd445c4f8f6e" pod="default/busybox-7dff88458-89r49" assumedNode="ha-213000-m02" currentNode="ha-213000-m03"
I1105 18:04:31.268574 1 cache.go:503] "Pod was added to a different node than it was assumed" podKey="3a5c2f7c-8906-4561-8875-8736f45e3fda" pod="default/busybox-7dff88458-x9hwg" assumedNode="ha-213000-m03" currentNode="ha-213000-m02"
E1105 18:04:31.273427 1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-89r49\": pod busybox-7dff88458-89r49 is already assigned to node \"ha-213000-m02\"" plugin="DefaultBinder" pod="default/busybox-7dff88458-89r49" node="ha-213000-m03"
E1105 18:04:31.273527 1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod 69f86bc8-78ea-4277-b688-fd445c4f8f6e(default/busybox-7dff88458-89r49) was assumed on ha-213000-m03 but assigned to ha-213000-m02" pod="default/busybox-7dff88458-89r49"
E1105 18:04:31.273547 1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-89r49\": pod busybox-7dff88458-89r49 is already assigned to node \"ha-213000-m02\"" pod="default/busybox-7dff88458-89r49"
I1105 18:04:31.273836 1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-7dff88458-89r49" node="ha-213000-m02"
I1105 18:04:31.281777 1 cache.go:503] "Pod was added to a different node than it was assumed" podKey="7f2e1057-5c45-4255-9c8e-d1eba882f2e5" pod="default/busybox-7dff88458-q5j74" assumedNode="ha-213000" currentNode="ha-213000-m03"
E1105 18:04:31.287338 1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-x9hwg\": pod busybox-7dff88458-x9hwg is already assigned to node \"ha-213000-m03\"" plugin="DefaultBinder" pod="default/busybox-7dff88458-x9hwg" node="ha-213000-m02"
E1105 18:04:31.287388 1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod 3a5c2f7c-8906-4561-8875-8736f45e3fda(default/busybox-7dff88458-x9hwg) was assumed on ha-213000-m02 but assigned to ha-213000-m03" pod="default/busybox-7dff88458-x9hwg"
E1105 18:04:31.287401 1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-x9hwg\": pod busybox-7dff88458-x9hwg is already assigned to node \"ha-213000-m03\"" pod="default/busybox-7dff88458-x9hwg"
I1105 18:04:31.287615 1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-7dff88458-x9hwg" node="ha-213000-m03"
E1105 18:04:31.291529 1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-q5j74\": pod busybox-7dff88458-q5j74 is already assigned to node \"ha-213000\"" plugin="DefaultBinder" pod="default/busybox-7dff88458-q5j74" node="ha-213000-m03"
E1105 18:04:31.291599 1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod 7f2e1057-5c45-4255-9c8e-d1eba882f2e5(default/busybox-7dff88458-q5j74) was assumed on ha-213000-m03 but assigned to ha-213000" pod="default/busybox-7dff88458-q5j74"
E1105 18:04:31.291701 1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-q5j74\": pod busybox-7dff88458-q5j74 is already assigned to node \"ha-213000\"" pod="default/busybox-7dff88458-q5j74"
I1105 18:04:31.291992 1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-7dff88458-q5j74" node="ha-213000"
E1105 18:04:59.242744 1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-r2bx5\": pod kube-proxy-r2bx5 is already assigned to node \"ha-213000-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-r2bx5" node="ha-213000-m04"
E1105 18:04:59.242812 1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-r2bx5\": pod kube-proxy-r2bx5 is already assigned to node \"ha-213000-m04\"" pod="kube-system/kube-proxy-r2bx5"
E1105 18:04:59.243648 1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-4qmgf\": pod kindnet-4qmgf is already assigned to node \"ha-213000-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-4qmgf" node="ha-213000-m04"
E1105 18:04:59.243714 1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-4qmgf\": pod kindnet-4qmgf is already assigned to node \"ha-213000-m04\"" pod="kube-system/kindnet-4qmgf"
==> kubelet <==
Nov 05 18:03:27 ha-213000 kubelet[2108]: > table="nat" chain="KUBE-KUBELET-CANARY"
Nov 05 18:04:27 ha-213000 kubelet[2108]: E1105 18:04:27.199259 2108 iptables.go:577] "Could not set up iptables canary" err=<
Nov 05 18:04:27 ha-213000 kubelet[2108]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.
Nov 05 18:04:27 ha-213000 kubelet[2108]: ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Nov 05 18:04:27 ha-213000 kubelet[2108]: Perhaps ip6tables or your kernel needs to be upgraded.
Nov 05 18:04:27 ha-213000 kubelet[2108]: > table="nat" chain="KUBE-KUBELET-CANARY"
Nov 05 18:04:31 ha-213000 kubelet[2108]: I1105 18:04:31.275013 2108 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/storage-provisioner" podStartSLOduration=180.274999296 podStartE2EDuration="3m0.274999296s" podCreationTimestamp="2024-11-05 18:01:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2024-11-05 18:01:51.416826219 +0000 UTC m=+24.377833961" watchObservedRunningTime="2024-11-05 18:04:31.274999296 +0000 UTC m=+184.236007040"
Nov 05 18:04:31 ha-213000 kubelet[2108]: I1105 18:04:31.374929 2108 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88s2k\" (UniqueName: \"kubernetes.io/projected/7f2e1057-5c45-4255-9c8e-d1eba882f2e5-kube-api-access-88s2k\") pod \"busybox-7dff88458-q5j74\" (UID: \"7f2e1057-5c45-4255-9c8e-d1eba882f2e5\") " pod="default/busybox-7dff88458-q5j74"
Nov 05 18:04:34 ha-213000 kubelet[2108]: I1105 18:04:34.308278 2108 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/busybox-7dff88458-q5j74" podStartSLOduration=1.766756631 podStartE2EDuration="3.308264067s" podCreationTimestamp="2024-11-05 18:04:31 +0000 UTC" firstStartedPulling="2024-11-05 18:04:31.760833399 +0000 UTC m=+184.721841133" lastFinishedPulling="2024-11-05 18:04:33.302340832 +0000 UTC m=+186.263348569" observedRunningTime="2024-11-05 18:04:34.308023413 +0000 UTC m=+187.269031168" watchObservedRunningTime="2024-11-05 18:04:34.308264067 +0000 UTC m=+187.269271805"
Nov 05 18:04:36 ha-213000 kubelet[2108]: E1105 18:04:36.603308 2108 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:54556->127.0.0.1:37937: write tcp 127.0.0.1:54556->127.0.0.1:37937: write: broken pipe
Nov 05 18:05:27 ha-213000 kubelet[2108]: E1105 18:05:27.199657 2108 iptables.go:577] "Could not set up iptables canary" err=<
Nov 05 18:05:27 ha-213000 kubelet[2108]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.
Nov 05 18:05:27 ha-213000 kubelet[2108]: ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Nov 05 18:05:27 ha-213000 kubelet[2108]: Perhaps ip6tables or your kernel needs to be upgraded.
Nov 05 18:05:27 ha-213000 kubelet[2108]: > table="nat" chain="KUBE-KUBELET-CANARY"
Nov 05 18:06:27 ha-213000 kubelet[2108]: E1105 18:06:27.202597 2108 iptables.go:577] "Could not set up iptables canary" err=<
Nov 05 18:06:27 ha-213000 kubelet[2108]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.
Nov 05 18:06:27 ha-213000 kubelet[2108]: ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Nov 05 18:06:27 ha-213000 kubelet[2108]: Perhaps ip6tables or your kernel needs to be upgraded.
Nov 05 18:06:27 ha-213000 kubelet[2108]: > table="nat" chain="KUBE-KUBELET-CANARY"
Nov 05 18:07:27 ha-213000 kubelet[2108]: E1105 18:07:27.199645 2108 iptables.go:577] "Could not set up iptables canary" err=<
Nov 05 18:07:27 ha-213000 kubelet[2108]: error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.
Nov 05 18:07:27 ha-213000 kubelet[2108]: ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)
Nov 05 18:07:27 ha-213000 kubelet[2108]: Perhaps ip6tables or your kernel needs to be upgraded.
Nov 05 18:07:27 ha-213000 kubelet[2108]: > table="nat" chain="KUBE-KUBELET-CANARY"
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-darwin-amd64 status --format={{.APIServer}} -p ha-213000 -n ha-213000
helpers_test.go:261: (dbg) Run: kubectl --context ha-213000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (3.50s)