=== RUN TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:281: (dbg) Run: out/minikube-darwin-amd64 node list -p multinode-293000
multinode_test.go:288: (dbg) Run: out/minikube-darwin-amd64 stop -p multinode-293000
E0222 20:43:24.004642 3041 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/ingress-addon-legacy-327000/client.crt: no such file or directory
multinode_test.go:288: (dbg) Done: out/minikube-darwin-amd64 stop -p multinode-293000: (18.39129257s)
multinode_test.go:293: (dbg) Run: out/minikube-darwin-amd64 start -p multinode-293000 --wait=true -v=8 --alsologtostderr
E0222 20:45:40.153231 3041 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/ingress-addon-legacy-327000/client.crt: no such file or directory
E0222 20:46:07.845376 3041 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/ingress-addon-legacy-327000/client.crt: no such file or directory
E0222 20:46:15.249346 3041 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/addons-454000/client.crt: no such file or directory
multinode_test.go:293: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-293000 --wait=true -v=8 --alsologtostderr: exit status 90 (2m56.094187062s)
-- stdout --
* [multinode-293000] minikube v1.29.0 on Darwin 13.2
- MINIKUBE_LOCATION=15909
- KUBECONFIG=/Users/jenkins/minikube-integration/15909-2565/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/15909-2565/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the hyperkit driver based on existing profile
* Starting control plane node multinode-293000 in cluster multinode-293000
* Restarting existing hyperkit VM for "multinode-293000" ...
* Preparing Kubernetes v1.26.1 on Docker 20.10.23 ...
* Configuring CNI (Container Networking Interface) ...
* Enabled addons:
* Verifying Kubernetes components...
* Starting worker node multinode-293000-m02 in cluster multinode-293000
* Restarting existing hyperkit VM for "multinode-293000-m02" ...
* Found network options:
- NO_PROXY=192.168.64.12
* Preparing Kubernetes v1.26.1 on Docker 20.10.23 ...
- env NO_PROXY=192.168.64.12
* Verifying Kubernetes components...
* Starting worker node multinode-293000-m03 in cluster multinode-293000
* Restarting existing hyperkit VM for "multinode-293000-m03" ...
* Found network options:
- NO_PROXY=192.168.64.12,192.168.64.13
-- /stdout --
** stderr **
I0222 20:43:26.571790 6226 out.go:296] Setting OutFile to fd 1 ...
I0222 20:43:26.572506 6226 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0222 20:43:26.572514 6226 out.go:309] Setting ErrFile to fd 2...
I0222 20:43:26.572519 6226 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0222 20:43:26.572724 6226 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/15909-2565/.minikube/bin
I0222 20:43:26.574408 6226 out.go:303] Setting JSON to false
I0222 20:43:26.595005 6226 start.go:125] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2580,"bootTime":1677124826,"procs":398,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.2","kernelVersion":"22.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
W0222 20:43:26.595103 6226 start.go:133] gopshost.Virtualization returned error: not implemented yet
I0222 20:43:26.616534 6226 out.go:177] * [multinode-293000] minikube v1.29.0 on Darwin 13.2
I0222 20:43:26.660552 6226 notify.go:220] Checking for updates...
I0222 20:43:26.660585 6226 out.go:177] - MINIKUBE_LOCATION=15909
I0222 20:43:26.682586 6226 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:43:26.704372 6226 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0222 20:43:26.726540 6226 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0222 20:43:26.748401 6226 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15909-2565/.minikube
I0222 20:43:26.790331 6226 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0222 20:43:26.812189 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:43:26.812281 6226 driver.go:365] Setting default libvirt URI to qemu:///system
I0222 20:43:26.812952 6226 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0222 20:43:26.813047 6226 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0222 20:43:26.820505 6226 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51502
I0222 20:43:26.820870 6226 main.go:141] libmachine: () Calling .GetVersion
I0222 20:43:26.821299 6226 main.go:141] libmachine: Using API Version 1
I0222 20:43:26.821310 6226 main.go:141] libmachine: () Calling .SetConfigRaw
I0222 20:43:26.821516 6226 main.go:141] libmachine: () Calling .GetMachineName
I0222 20:43:26.821625 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:26.849111 6226 out.go:177] * Using the hyperkit driver based on existing profile
I0222 20:43:26.892321 6226 start.go:296] selected driver: hyperkit
I0222 20:43:26.892350 6226 start.go:857] validating driver "hyperkit" against &{Name:multinode-293000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15849/minikube-v1.29.0-1676568791-15849-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete
sConfig:{KubernetesVersion:v1.26.1 ClusterName:multinode-293000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.12 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.64.14 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false
inaccel:false ingress:false ingress-dns:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath
: SocketVMnetPath: StaticIP:}
I0222 20:43:26.892545 6226 start.go:868] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0222 20:43:26.892650 6226 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0222 20:43:26.892856 6226 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/15909-2565/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
I0222 20:43:26.900688 6226 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.29.0
I0222 20:43:26.904982 6226 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0222 20:43:26.904998 6226 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
I0222 20:43:26.907798 6226 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0222 20:43:26.907833 6226 cni.go:84] Creating CNI manager for ""
I0222 20:43:26.907842 6226 cni.go:136] 3 nodes found, recommending kindnet
I0222 20:43:26.907852 6226 start_flags.go:319] config:
{Name:multinode-293000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15849/minikube-v1.29.0-1676568791-15849-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.26.1 ClusterName:multinode-293000 Namespace:default
APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.12 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.64.14 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false istio:false istio-provisioner:false
kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:}
I0222 20:43:26.907989 6226 iso.go:125] acquiring lock: {Name:mk3854eabdabf4511fd5a0e2c749dfea43fa973a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0222 20:43:26.951255 6226 out.go:177] * Starting control plane node multinode-293000 in cluster multinode-293000
I0222 20:43:26.972438 6226 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0222 20:43:26.972592 6226 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/15909-2565/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4
I0222 20:43:26.972620 6226 cache.go:57] Caching tarball of preloaded images
I0222 20:43:26.972801 6226 preload.go:174] Found /Users/jenkins/minikube-integration/15909-2565/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0222 20:43:26.972819 6226 cache.go:60] Finished verifying existence of preloaded tar for v1.26.1 on docker
I0222 20:43:26.973021 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:43:26.973745 6226 cache.go:193] Successfully downloaded all kic artifacts
I0222 20:43:26.973793 6226 start.go:364] acquiring machines lock for multinode-293000: {Name:mk88cf87535f73dae2b0686647d170168e328899 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0222 20:43:26.973920 6226 start.go:368] acquired machines lock for "multinode-293000" in 108.426µs
I0222 20:43:26.973959 6226 start.go:96] Skipping create...Using existing machine configuration
I0222 20:43:26.973971 6226 fix.go:55] fixHost starting:
I0222 20:43:26.974413 6226 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0222 20:43:26.974452 6226 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0222 20:43:26.981789 6226 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51504
I0222 20:43:26.982126 6226 main.go:141] libmachine: () Calling .GetVersion
I0222 20:43:26.982531 6226 main.go:141] libmachine: Using API Version 1
I0222 20:43:26.982551 6226 main.go:141] libmachine: () Calling .SetConfigRaw
I0222 20:43:26.982808 6226 main.go:141] libmachine: () Calling .GetMachineName
I0222 20:43:26.982930 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:26.983032 6226 main.go:141] libmachine: (multinode-293000) Calling .GetState
I0222 20:43:26.983110 6226 main.go:141] libmachine: (multinode-293000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:43:26.983183 6226 main.go:141] libmachine: (multinode-293000) DBG | hyperkit pid from json: 5686
I0222 20:43:26.984025 6226 main.go:141] libmachine: (multinode-293000) DBG | hyperkit pid 5686 missing from process table
I0222 20:43:26.984069 6226 fix.go:103] recreateIfNeeded on multinode-293000: state=Stopped err=<nil>
I0222 20:43:26.984087 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
W0222 20:43:26.984164 6226 fix.go:129] unexpected machine state, will restart: <nil>
I0222 20:43:27.026377 6226 out.go:177] * Restarting existing hyperkit VM for "multinode-293000" ...
I0222 20:43:27.047429 6226 main.go:141] libmachine: (multinode-293000) Calling .Start
I0222 20:43:27.047715 6226 main.go:141] libmachine: (multinode-293000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:43:27.047767 6226 main.go:141] libmachine: (multinode-293000) minikube might have been shutdown in an unclean way, the hyperkit pid file still exists: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/hyperkit.pid
I0222 20:43:27.049816 6226 main.go:141] libmachine: (multinode-293000) DBG | hyperkit pid 5686 missing from process table
I0222 20:43:27.049829 6226 main.go:141] libmachine: (multinode-293000) DBG | pid 5686 is in state "Stopped"
I0222 20:43:27.049860 6226 main.go:141] libmachine: (multinode-293000) DBG | Removing stale pid file /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/hyperkit.pid...
I0222 20:43:27.050116 6226 main.go:141] libmachine: (multinode-293000) DBG | Using UUID 1ad0122c-b334-11ed-affa-149d997fca88
I0222 20:43:27.160146 6226 main.go:141] libmachine: (multinode-293000) DBG | Generated MAC 8e:8:26:1e:84:48
I0222 20:43:27.160178 6226 main.go:141] libmachine: (multinode-293000) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000
I0222 20:43:27.160305 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"1ad0122c-b334-11ed-affa-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0004a1f20)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/bzimage", Initrd:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Proce
ss)(nil)}
I0222 20:43:27.160332 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"1ad0122c-b334-11ed-affa-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0004a1f20)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/bzimage", Initrd:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Proce
ss)(nil)}
I0222 20:43:27.160427 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "1ad0122c-b334-11ed-affa-149d997fca88", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/multinode-293000.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/tty,log=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/bzimage,/Users/jenkins/minikube-integration/1590
9-2565/.minikube/machines/multinode-293000/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000"}
I0222 20:43:27.160488 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U 1ad0122c-b334-11ed-affa-149d997fca88 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/multinode-293000.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/tty,log=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/console-ring -f kexec,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/bzimage,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/initrd,earlyprintk=
serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000"
I0222 20:43:27.160505 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 DEBUG: hyperkit: Redirecting stdout/stderr to logger
I0222 20:43:27.161929 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 DEBUG: hyperkit: Pid is 6239
I0222 20:43:27.162331 6226 main.go:141] libmachine: (multinode-293000) DBG | Attempt 0
I0222 20:43:27.162349 6226 main.go:141] libmachine: (multinode-293000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:43:27.162440 6226 main.go:141] libmachine: (multinode-293000) DBG | hyperkit pid from json: 6239
I0222 20:43:27.163844 6226 main.go:141] libmachine: (multinode-293000) DBG | Searching for 8e:8:26:1e:84:48 in /var/db/dhcpd_leases ...
I0222 20:43:27.163900 6226 main.go:141] libmachine: (multinode-293000) DBG | Found 13 entries in /var/db/dhcpd_leases!
I0222 20:43:27.163924 6226 main.go:141] libmachine: (multinode-293000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.14 HWAddress:66:3a:f:a5:79:1d ID:1,66:3a:f:a5:79:1d Lease:0x63f6eeed}
I0222 20:43:27.163941 6226 main.go:141] libmachine: (multinode-293000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.13 HWAddress:f6:5a:53:47:16:21 ID:1,f6:5a:53:47:16:21 Lease:0x63f83fd9}
I0222 20:43:27.163968 6226 main.go:141] libmachine: (multinode-293000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.12 HWAddress:8e:8:26:1e:84:48 ID:1,8e:8:26:1e:84:48 Lease:0x63f83f9d}
I0222 20:43:27.163986 6226 main.go:141] libmachine: (multinode-293000) DBG | Found match: 8e:8:26:1e:84:48
I0222 20:43:27.164006 6226 main.go:141] libmachine: (multinode-293000) DBG | IP: 192.168.64.12
I0222 20:43:27.164044 6226 main.go:141] libmachine: (multinode-293000) Calling .GetConfigRaw
I0222 20:43:27.164674 6226 main.go:141] libmachine: (multinode-293000) Calling .GetIP
I0222 20:43:27.164869 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:43:27.165191 6226 machine.go:88] provisioning docker machine ...
I0222 20:43:27.165201 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:27.165308 6226 main.go:141] libmachine: (multinode-293000) Calling .GetMachineName
I0222 20:43:27.165401 6226 buildroot.go:166] provisioning hostname "multinode-293000"
I0222 20:43:27.165413 6226 main.go:141] libmachine: (multinode-293000) Calling .GetMachineName
I0222 20:43:27.165512 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:27.165587 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:27.165655 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:27.165726 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:27.165803 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:27.165972 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:43:27.166338 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.12 22 <nil> <nil>}
I0222 20:43:27.166350 6226 main.go:141] libmachine: About to run SSH command:
sudo hostname multinode-293000 && echo "multinode-293000" | sudo tee /etc/hostname
I0222 20:43:27.168464 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: Using fd 5 for I/O notifications
I0222 20:43:27.230026 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD
I0222 20:43:27.230641 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I0222 20:43:27.230657 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I0222 20:43:27.230672 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I0222 20:43:27.230680 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I0222 20:43:27.587799 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0
I0222 20:43:27.587814 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0
I0222 20:43:27.691835 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I0222 20:43:27.691858 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I0222 20:43:27.691877 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I0222 20:43:27.691922 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I0222 20:43:27.692917 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1
I0222 20:43:27.692931 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1
I0222 20:43:32.224775 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:32 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1
I0222 20:43:32.224819 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:32 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1
I0222 20:43:32.224830 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:32 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1
I0222 20:43:38.260390 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-293000
I0222 20:43:38.260419 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:38.260588 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:38.260684 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.260786 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.260875 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:38.261011 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:43:38.261323 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.12 22 <nil> <nil>}
I0222 20:43:38.261337 6226 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smultinode-293000' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-293000/g' /etc/hosts;
else
echo '127.0.1.1 multinode-293000' | sudo tee -a /etc/hosts;
fi
fi
I0222 20:43:38.338767 6226 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0222 20:43:38.338785 6226 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/15909-2565/.minikube CaCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15909-2565/.minikube}
I0222 20:43:38.338797 6226 buildroot.go:174] setting up certificates
I0222 20:43:38.338806 6226 provision.go:83] configureAuth start
I0222 20:43:38.338814 6226 main.go:141] libmachine: (multinode-293000) Calling .GetMachineName
I0222 20:43:38.338953 6226 main.go:141] libmachine: (multinode-293000) Calling .GetIP
I0222 20:43:38.339067 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:38.339151 6226 provision.go:138] copyHostCerts
I0222 20:43:38.339183 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem
I0222 20:43:38.339247 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem, removing ...
I0222 20:43:38.339255 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem
I0222 20:43:38.339369 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem (1082 bytes)
I0222 20:43:38.339557 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem
I0222 20:43:38.339594 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem, removing ...
I0222 20:43:38.339599 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem
I0222 20:43:38.339662 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem (1123 bytes)
I0222 20:43:38.339777 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem
I0222 20:43:38.339806 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem, removing ...
I0222 20:43:38.339810 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem
I0222 20:43:38.339867 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem (1679 bytes)
I0222 20:43:38.339984 6226 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem org=jenkins.multinode-293000 san=[192.168.64.12 192.168.64.12 localhost 127.0.0.1 minikube multinode-293000]
I0222 20:43:38.504197 6226 provision.go:172] copyRemoteCerts
I0222 20:43:38.504311 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0222 20:43:38.504340 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:38.504603 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:38.504802 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.504986 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:38.505151 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.12 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/id_rsa Username:docker}
I0222 20:43:38.548689 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0222 20:43:38.548761 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0222 20:43:38.563997 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem -> /etc/docker/server.pem
I0222 20:43:38.564055 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0222 20:43:38.579172 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0222 20:43:38.579225 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0222 20:43:38.594132 6226 provision.go:86] duration metric: configureAuth took 255.318104ms
I0222 20:43:38.594142 6226 buildroot.go:189] setting minikube options for container-runtime
I0222 20:43:38.594311 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:43:38.594325 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:38.594454 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:38.594540 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:38.594613 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.594702 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.594795 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:38.594905 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:43:38.595199 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.12 22 <nil> <nil>}
I0222 20:43:38.595207 6226 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0222 20:43:38.669265 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I0222 20:43:38.669282 6226 buildroot.go:70] root file system type: tmpfs
I0222 20:43:38.669355 6226 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0222 20:43:38.669374 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:38.669505 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:38.669596 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.669703 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.669794 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:38.669936 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:43:38.670251 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.12 22 <nil> <nil>}
I0222 20:43:38.670296 6226 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0222 20:43:38.752131 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0222 20:43:38.752151 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:38.752287 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:38.752383 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.752486 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.752572 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:38.752712 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:43:38.753026 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.12 22 <nil> <nil>}
I0222 20:43:38.753040 6226 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0222 20:43:39.349118 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I0222 20:43:39.349133 6226 machine.go:91] provisioned docker machine in 12.184156232s
I0222 20:43:39.349143 6226 start.go:300] post-start starting for "multinode-293000" (driver="hyperkit")
I0222 20:43:39.349148 6226 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0222 20:43:39.349160 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:39.349346 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0222 20:43:39.349358 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:39.349458 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:39.349564 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:39.349664 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:39.349753 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.12 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/id_rsa Username:docker}
I0222 20:43:39.393286 6226 ssh_runner.go:195] Run: cat /etc/os-release
I0222 20:43:39.395698 6226 command_runner.go:130] > NAME=Buildroot
I0222 20:43:39.395707 6226 command_runner.go:130] > VERSION=2021.02.12-1-g41e8300-dirty
I0222 20:43:39.395714 6226 command_runner.go:130] > ID=buildroot
I0222 20:43:39.395719 6226 command_runner.go:130] > VERSION_ID=2021.02.12
I0222 20:43:39.395723 6226 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"
I0222 20:43:39.395796 6226 info.go:137] Remote host: Buildroot 2021.02.12
I0222 20:43:39.395808 6226 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15909-2565/.minikube/addons for local assets ...
I0222 20:43:39.395888 6226 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15909-2565/.minikube/files for local assets ...
I0222 20:43:39.396044 6226 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> 30412.pem in /etc/ssl/certs
I0222 20:43:39.396050 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> /etc/ssl/certs/30412.pem
I0222 20:43:39.396219 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0222 20:43:39.401645 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem --> /etc/ssl/certs/30412.pem (1708 bytes)
I0222 20:43:39.417241 6226 start.go:303] post-start completed in 68.09182ms
I0222 20:43:39.417256 6226 fix.go:57] fixHost completed within 12.44351438s
I0222 20:43:39.417278 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:39.417415 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:39.417506 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:39.417599 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:39.417680 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:39.417814 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:43:39.418122 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.12 22 <nil> <nil>}
I0222 20:43:39.418130 6226 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0222 20:43:39.491162 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: 1677127419.600291426
I0222 20:43:39.491173 6226 fix.go:207] guest clock: 1677127419.600291426
I0222 20:43:39.491179 6226 fix.go:220] Guest: 2023-02-22 20:43:39.600291426 -0800 PST Remote: 2023-02-22 20:43:39.417261 -0800 PST m=+12.881213575 (delta=183.030426ms)
I0222 20:43:39.491203 6226 fix.go:191] guest clock delta is within tolerance: 183.030426ms
I0222 20:43:39.491207 6226 start.go:83] releasing machines lock for "multinode-293000", held for 12.517503173s
I0222 20:43:39.491226 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:39.491360 6226 main.go:141] libmachine: (multinode-293000) Calling .GetIP
I0222 20:43:39.491455 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:39.491769 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:39.491873 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:39.491954 6226 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0222 20:43:39.491981 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:39.492022 6226 ssh_runner.go:195] Run: cat /version.json
I0222 20:43:39.492033 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:39.492087 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:39.492137 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:39.492181 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:39.492228 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:39.492278 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:39.492311 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:39.492390 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.12 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/id_rsa Username:docker}
I0222 20:43:39.492404 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.12 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/id_rsa Username:docker}
I0222 20:43:39.575623 6226 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.
I0222 20:43:39.576473 6226 command_runner.go:130] > {"iso_version": "v1.29.0-1676568791-15849", "kicbase_version": "v0.0.37-1675980448-15752", "minikube_version": "v1.29.0", "commit": "cf7ad99382c4b89a2ffa286b1101797332265ce3"}
I0222 20:43:39.576650 6226 ssh_runner.go:195] Run: systemctl --version
I0222 20:43:39.580817 6226 command_runner.go:130] > systemd 247 (247)
I0222 20:43:39.580835 6226 command_runner.go:130] > -PAM -AUDIT -SELINUX -IMA -APPARMOR -SMACK -SYSVINIT -UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ +LZ4 -ZSTD +SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid
I0222 20:43:39.580895 6226 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0222 20:43:39.584185 6226 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory
W0222 20:43:39.584226 6226 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0222 20:43:39.584270 6226 ssh_runner.go:195] Run: which cri-dockerd
I0222 20:43:39.586408 6226 command_runner.go:130] > /usr/bin/cri-dockerd
I0222 20:43:39.586619 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0222 20:43:39.592621 6226 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (135 bytes)
I0222 20:43:39.603984 6226 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0222 20:43:39.614204 6226 command_runner.go:139] > /etc/cni/net.d/87-podman-bridge.conflist,
I0222 20:43:39.614240 6226 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0222 20:43:39.614248 6226 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0222 20:43:39.614331 6226 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0222 20:43:39.631097 6226 command_runner.go:130] > registry.k8s.io/kube-apiserver:v1.26.1
I0222 20:43:39.631110 6226 command_runner.go:130] > registry.k8s.io/kube-controller-manager:v1.26.1
I0222 20:43:39.631114 6226 command_runner.go:130] > registry.k8s.io/kube-scheduler:v1.26.1
I0222 20:43:39.631118 6226 command_runner.go:130] > registry.k8s.io/kube-proxy:v1.26.1
I0222 20:43:39.631123 6226 command_runner.go:130] > registry.k8s.io/etcd:3.5.6-0
I0222 20:43:39.631126 6226 command_runner.go:130] > registry.k8s.io/pause:3.9
I0222 20:43:39.631131 6226 command_runner.go:130] > kindest/kindnetd:v20221004-44d545d1
I0222 20:43:39.631136 6226 command_runner.go:130] > registry.k8s.io/coredns/coredns:v1.9.3
I0222 20:43:39.631140 6226 command_runner.go:130] > registry.k8s.io/pause:3.6
I0222 20:43:39.631144 6226 command_runner.go:130] > gcr.io/k8s-minikube/storage-provisioner:v5
I0222 20:43:39.631148 6226 command_runner.go:130] > gcr.io/k8s-minikube/busybox:1.28
I0222 20:43:39.632084 6226 docker.go:630] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.26.1
registry.k8s.io/kube-controller-manager:v1.26.1
registry.k8s.io/kube-scheduler:v1.26.1
registry.k8s.io/kube-proxy:v1.26.1
registry.k8s.io/etcd:3.5.6-0
registry.k8s.io/pause:3.9
kindest/kindnetd:v20221004-44d545d1
registry.k8s.io/coredns/coredns:v1.9.3
registry.k8s.io/pause:3.6
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28
-- /stdout --
I0222 20:43:39.632095 6226 docker.go:560] Images already preloaded, skipping extraction
I0222 20:43:39.632103 6226 start.go:485] detecting cgroup driver to use...
I0222 20:43:39.632179 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
image-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0222 20:43:39.644074 6226 command_runner.go:130] > runtime-endpoint: unix:///run/containerd/containerd.sock
I0222 20:43:39.644084 6226 command_runner.go:130] > image-endpoint: unix:///run/containerd/containerd.sock
I0222 20:43:39.644379 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0222 20:43:39.651211 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0222 20:43:39.657975 6226 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I0222 20:43:39.658023 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0222 20:43:39.664809 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0222 20:43:39.671543 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0222 20:43:39.678136 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0222 20:43:39.684800 6226 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0222 20:43:39.691736 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0222 20:43:39.698576 6226 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0222 20:43:39.704661 6226 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1
I0222 20:43:39.704819 6226 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0222 20:43:39.710820 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:43:39.793782 6226 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0222 20:43:39.806804 6226 start.go:485] detecting cgroup driver to use...
I0222 20:43:39.806881 6226 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0222 20:43:39.815801 6226 command_runner.go:130] > # /usr/lib/systemd/system/docker.service
I0222 20:43:39.816408 6226 command_runner.go:130] > [Unit]
I0222 20:43:39.816416 6226 command_runner.go:130] > Description=Docker Application Container Engine
I0222 20:43:39.816423 6226 command_runner.go:130] > Documentation=https://docs.docker.com
I0222 20:43:39.816428 6226 command_runner.go:130] > After=network.target minikube-automount.service docker.socket
I0222 20:43:39.816434 6226 command_runner.go:130] > Requires= minikube-automount.service docker.socket
I0222 20:43:39.816440 6226 command_runner.go:130] > StartLimitBurst=3
I0222 20:43:39.816445 6226 command_runner.go:130] > StartLimitIntervalSec=60
I0222 20:43:39.816448 6226 command_runner.go:130] > [Service]
I0222 20:43:39.816452 6226 command_runner.go:130] > Type=notify
I0222 20:43:39.816455 6226 command_runner.go:130] > Restart=on-failure
I0222 20:43:39.816461 6226 command_runner.go:130] > # This file is a systemd drop-in unit that inherits from the base dockerd configuration.
I0222 20:43:39.816468 6226 command_runner.go:130] > # The base configuration already specifies an 'ExecStart=...' command. The first directive
I0222 20:43:39.816476 6226 command_runner.go:130] > # here is to clear out that command inherited from the base configuration. Without this,
I0222 20:43:39.816482 6226 command_runner.go:130] > # the command from the base configuration and the command specified here are treated as
I0222 20:43:39.816490 6226 command_runner.go:130] > # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
I0222 20:43:39.816495 6226 command_runner.go:130] > # will catch this invalid input and refuse to start the service with an error like:
I0222 20:43:39.816501 6226 command_runner.go:130] > # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
I0222 20:43:39.816509 6226 command_runner.go:130] > # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
I0222 20:43:39.816515 6226 command_runner.go:130] > # container runtimes. If left unlimited, it may result in OOM issues with MySQL.
I0222 20:43:39.816519 6226 command_runner.go:130] > ExecStart=
I0222 20:43:39.816560 6226 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
I0222 20:43:39.816568 6226 command_runner.go:130] > ExecReload=/bin/kill -s HUP $MAINPID
I0222 20:43:39.816574 6226 command_runner.go:130] > # Having non-zero Limit*s causes performance problems due to accounting overhead
I0222 20:43:39.816580 6226 command_runner.go:130] > # in the kernel. We recommend using cgroups to do container-local accounting.
I0222 20:43:39.816585 6226 command_runner.go:130] > LimitNOFILE=infinity
I0222 20:43:39.816588 6226 command_runner.go:130] > LimitNPROC=infinity
I0222 20:43:39.816593 6226 command_runner.go:130] > LimitCORE=infinity
I0222 20:43:39.816598 6226 command_runner.go:130] > # Uncomment TasksMax if your systemd version supports it.
I0222 20:43:39.816603 6226 command_runner.go:130] > # Only systemd 226 and above support this version.
I0222 20:43:39.816606 6226 command_runner.go:130] > TasksMax=infinity
I0222 20:43:39.816615 6226 command_runner.go:130] > TimeoutStartSec=0
I0222 20:43:39.816624 6226 command_runner.go:130] > # set delegate yes so that systemd does not reset the cgroups of docker containers
I0222 20:43:39.816631 6226 command_runner.go:130] > Delegate=yes
I0222 20:43:39.816638 6226 command_runner.go:130] > # kill only the docker process, not all processes in the cgroup
I0222 20:43:39.816643 6226 command_runner.go:130] > KillMode=process
I0222 20:43:39.816646 6226 command_runner.go:130] > [Install]
I0222 20:43:39.816672 6226 command_runner.go:130] > WantedBy=multi-user.target
I0222 20:43:39.816747 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0222 20:43:39.826301 6226 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0222 20:43:39.839122 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0222 20:43:39.847417 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0222 20:43:39.856517 6226 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0222 20:43:39.877822 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0222 20:43:39.887392 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
image-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0222 20:43:39.899027 6226 command_runner.go:130] > runtime-endpoint: unix:///var/run/cri-dockerd.sock
I0222 20:43:39.899037 6226 command_runner.go:130] > image-endpoint: unix:///var/run/cri-dockerd.sock
I0222 20:43:39.899456 6226 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0222 20:43:39.985910 6226 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0222 20:43:40.079370 6226 docker.go:529] configuring docker to use "cgroupfs" as cgroup driver...
I0222 20:43:40.079387 6226 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
I0222 20:43:40.090365 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:43:40.185069 6226 ssh_runner.go:195] Run: sudo systemctl restart docker
I0222 20:43:41.464168 6226 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.279103152s)
I0222 20:43:41.464228 6226 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0222 20:43:41.546266 6226 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0222 20:43:41.630286 6226 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0222 20:43:41.711916 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:43:41.796591 6226 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0222 20:43:41.811953 6226 start.go:532] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0222 20:43:41.812041 6226 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0222 20:43:41.815730 6226 command_runner.go:130] > File: /var/run/cri-dockerd.sock
I0222 20:43:41.815748 6226 command_runner.go:130] > Size: 0 Blocks: 0 IO Block: 4096 socket
I0222 20:43:41.815756 6226 command_runner.go:130] > Device: 16h/22d Inode: 873 Links: 1
I0222 20:43:41.815763 6226 command_runner.go:130] > Access: (0660/srw-rw----) Uid: ( 0/ root) Gid: ( 1000/ docker)
I0222 20:43:41.815769 6226 command_runner.go:130] > Access: 2023-02-23 04:43:41.918868999 +0000
I0222 20:43:41.815773 6226 command_runner.go:130] > Modify: 2023-02-23 04:43:41.918868999 +0000
I0222 20:43:41.815778 6226 command_runner.go:130] > Change: 2023-02-23 04:43:41.920868999 +0000
I0222 20:43:41.815782 6226 command_runner.go:130] > Birth: -
I0222 20:43:41.815897 6226 start.go:553] Will wait 60s for crictl version
I0222 20:43:41.815949 6226 ssh_runner.go:195] Run: which crictl
I0222 20:43:41.818294 6226 command_runner.go:130] > /usr/bin/crictl
I0222 20:43:41.818565 6226 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0222 20:43:41.875368 6226 command_runner.go:130] > Version: 0.1.0
I0222 20:43:41.875390 6226 command_runner.go:130] > RuntimeName: docker
I0222 20:43:41.875401 6226 command_runner.go:130] > RuntimeVersion: 20.10.23
I0222 20:43:41.875406 6226 command_runner.go:130] > RuntimeApiVersion: v1alpha2
I0222 20:43:41.876347 6226 start.go:569] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 20.10.23
RuntimeApiVersion: v1alpha2
I0222 20:43:41.876413 6226 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0222 20:43:41.895913 6226 command_runner.go:130] > 20.10.23
I0222 20:43:41.896698 6226 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0222 20:43:41.915652 6226 command_runner.go:130] > 20.10.23
I0222 20:43:41.960013 6226 out.go:204] * Preparing Kubernetes v1.26.1 on Docker 20.10.23 ...
I0222 20:43:41.960093 6226 main.go:141] libmachine: (multinode-293000) Calling .GetIP
I0222 20:43:41.960476 6226 ssh_runner.go:195] Run: grep 192.168.64.1 host.minikube.internal$ /etc/hosts
I0222 20:43:41.964505 6226 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.64.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0222 20:43:41.972321 6226 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0222 20:43:41.972389 6226 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0222 20:43:41.987675 6226 command_runner.go:130] > registry.k8s.io/kube-apiserver:v1.26.1
I0222 20:43:41.987687 6226 command_runner.go:130] > registry.k8s.io/kube-controller-manager:v1.26.1
I0222 20:43:41.987691 6226 command_runner.go:130] > registry.k8s.io/kube-scheduler:v1.26.1
I0222 20:43:41.987695 6226 command_runner.go:130] > registry.k8s.io/kube-proxy:v1.26.1
I0222 20:43:41.987703 6226 command_runner.go:130] > registry.k8s.io/etcd:3.5.6-0
I0222 20:43:41.987707 6226 command_runner.go:130] > registry.k8s.io/pause:3.9
I0222 20:43:41.987713 6226 command_runner.go:130] > kindest/kindnetd:v20221004-44d545d1
I0222 20:43:41.987720 6226 command_runner.go:130] > registry.k8s.io/coredns/coredns:v1.9.3
I0222 20:43:41.987723 6226 command_runner.go:130] > registry.k8s.io/pause:3.6
I0222 20:43:41.987727 6226 command_runner.go:130] > gcr.io/k8s-minikube/storage-provisioner:v5
I0222 20:43:41.987733 6226 command_runner.go:130] > gcr.io/k8s-minikube/busybox:1.28
I0222 20:43:41.988448 6226 docker.go:630] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.26.1
registry.k8s.io/kube-controller-manager:v1.26.1
registry.k8s.io/kube-scheduler:v1.26.1
registry.k8s.io/kube-proxy:v1.26.1
registry.k8s.io/etcd:3.5.6-0
registry.k8s.io/pause:3.9
kindest/kindnetd:v20221004-44d545d1
registry.k8s.io/coredns/coredns:v1.9.3
registry.k8s.io/pause:3.6
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28
-- /stdout --
I0222 20:43:41.988457 6226 docker.go:560] Images already preloaded, skipping extraction
I0222 20:43:41.988531 6226 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0222 20:43:42.004559 6226 command_runner.go:130] > registry.k8s.io/kube-apiserver:v1.26.1
I0222 20:43:42.004572 6226 command_runner.go:130] > registry.k8s.io/kube-controller-manager:v1.26.1
I0222 20:43:42.004577 6226 command_runner.go:130] > registry.k8s.io/kube-scheduler:v1.26.1
I0222 20:43:42.004580 6226 command_runner.go:130] > registry.k8s.io/kube-proxy:v1.26.1
I0222 20:43:42.004602 6226 command_runner.go:130] > registry.k8s.io/etcd:3.5.6-0
I0222 20:43:42.004609 6226 command_runner.go:130] > registry.k8s.io/pause:3.9
I0222 20:43:42.004615 6226 command_runner.go:130] > kindest/kindnetd:v20221004-44d545d1
I0222 20:43:42.004619 6226 command_runner.go:130] > registry.k8s.io/coredns/coredns:v1.9.3
I0222 20:43:42.004623 6226 command_runner.go:130] > registry.k8s.io/pause:3.6
I0222 20:43:42.004629 6226 command_runner.go:130] > gcr.io/k8s-minikube/storage-provisioner:v5
I0222 20:43:42.004634 6226 command_runner.go:130] > gcr.io/k8s-minikube/busybox:1.28
I0222 20:43:42.005240 6226 docker.go:630] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.26.1
registry.k8s.io/kube-controller-manager:v1.26.1
registry.k8s.io/kube-scheduler:v1.26.1
registry.k8s.io/kube-proxy:v1.26.1
registry.k8s.io/etcd:3.5.6-0
registry.k8s.io/pause:3.9
kindest/kindnetd:v20221004-44d545d1
registry.k8s.io/coredns/coredns:v1.9.3
registry.k8s.io/pause:3.6
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28
-- /stdout --
I0222 20:43:42.005255 6226 cache_images.go:84] Images are preloaded, skipping loading
I0222 20:43:42.005323 6226 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0222 20:43:42.025980 6226 command_runner.go:130] > cgroupfs
I0222 20:43:42.026673 6226 cni.go:84] Creating CNI manager for ""
I0222 20:43:42.026682 6226 cni.go:136] 3 nodes found, recommending kindnet
I0222 20:43:42.026694 6226 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0222 20:43:42.026707 6226 kubeadm.go:172] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.64.12 APIServerPort:8443 KubernetesVersion:v1.26.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:multinode-293000 NodeName:multinode-293000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.64.12"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.64.12 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/
etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m]}
I0222 20:43:42.026804 6226 kubeadm.go:177] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.64.12
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/cri-dockerd.sock
name: "multinode-293000"
kubeletExtraArgs:
node-ip: 192.168.64.12
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.64.12"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.26.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0222 20:43:42.026871 6226 kubeadm.go:968] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.26.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=/var/run/cri-dockerd.sock --hostname-override=multinode-293000 --image-service-endpoint=/var/run/cri-dockerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.64.12
[Install]
config:
{KubernetesVersion:v1.26.1 ClusterName:multinode-293000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0222 20:43:42.026928 6226 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.26.1
I0222 20:43:42.032829 6226 command_runner.go:130] > kubeadm
I0222 20:43:42.032839 6226 command_runner.go:130] > kubectl
I0222 20:43:42.032842 6226 command_runner.go:130] > kubelet
I0222 20:43:42.033092 6226 binaries.go:44] Found k8s binaries, skipping transfer
I0222 20:43:42.033140 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0222 20:43:42.039287 6226 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (449 bytes)
I0222 20:43:42.050135 6226 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0222 20:43:42.060840 6226 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2095 bytes)
I0222 20:43:42.072650 6226 ssh_runner.go:195] Run: grep 192.168.64.12 control-plane.minikube.internal$ /etc/hosts
I0222 20:43:42.074820 6226 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.64.12 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0222 20:43:42.082179 6226 certs.go:56] Setting up /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000 for IP: 192.168.64.12
I0222 20:43:42.082194 6226 certs.go:186] acquiring lock for shared ca certs: {Name:mk146a2279536341f0de1f1926bcacb2037bedc8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 20:43:42.082333 6226 certs.go:195] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.key
I0222 20:43:42.082381 6226 certs.go:195] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.key
I0222 20:43:42.082474 6226 certs.go:311] skipping minikube-user signed cert generation: /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.key
I0222 20:43:42.082546 6226 certs.go:311] skipping minikube signed cert generation: /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/apiserver.key.546ed142
I0222 20:43:42.082606 6226 certs.go:311] skipping aggregator signed cert generation: /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/proxy-client.key
I0222 20:43:42.082612 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0222 20:43:42.082639 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0222 20:43:42.082671 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0222 20:43:42.082690 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0222 20:43:42.082711 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0222 20:43:42.082729 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0222 20:43:42.082746 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0222 20:43:42.082770 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0222 20:43:42.082857 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041.pem (1338 bytes)
W0222 20:43:42.082896 6226 certs.go:397] ignoring /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041_empty.pem, impossibly tiny 0 bytes
I0222 20:43:42.082907 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem (1679 bytes)
I0222 20:43:42.082947 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem (1082 bytes)
I0222 20:43:42.082982 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem (1123 bytes)
I0222 20:43:42.083013 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem (1679 bytes)
I0222 20:43:42.083081 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem (1708 bytes)
I0222 20:43:42.083114 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0222 20:43:42.083134 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041.pem -> /usr/share/ca-certificates/3041.pem
I0222 20:43:42.083151 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> /usr/share/ca-certificates/30412.pem
I0222 20:43:42.083589 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0222 20:43:42.099446 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0222 20:43:42.114840 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0222 20:43:42.130180 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0222 20:43:42.145438 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0222 20:43:42.160941 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0222 20:43:42.176105 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0222 20:43:42.191277 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0222 20:43:42.206868 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0222 20:43:42.222232 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041.pem --> /usr/share/ca-certificates/3041.pem (1338 bytes)
I0222 20:43:42.237579 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem --> /usr/share/ca-certificates/30412.pem (1708 bytes)
I0222 20:43:42.252442 6226 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0222 20:43:42.263261 6226 ssh_runner.go:195] Run: openssl version
I0222 20:43:42.266506 6226 command_runner.go:130] > OpenSSL 1.1.1n 15 Mar 2022
I0222 20:43:42.266722 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0222 20:43:42.273692 6226 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0222 20:43:42.276402 6226 command_runner.go:130] > -rw-r--r-- 1 root root 1111 Feb 23 04:23 /usr/share/ca-certificates/minikubeCA.pem
I0222 20:43:42.276606 6226 certs.go:444] hashing: -rw-r--r-- 1 root root 1111 Feb 23 04:23 /usr/share/ca-certificates/minikubeCA.pem
I0222 20:43:42.276642 6226 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0222 20:43:42.279832 6226 command_runner.go:130] > b5213941
I0222 20:43:42.280052 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0222 20:43:42.287421 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3041.pem && ln -fs /usr/share/ca-certificates/3041.pem /etc/ssl/certs/3041.pem"
I0222 20:43:42.294372 6226 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3041.pem
I0222 20:43:42.296997 6226 command_runner.go:130] > -rw-r--r-- 1 root root 1338 Feb 23 04:28 /usr/share/ca-certificates/3041.pem
I0222 20:43:42.297216 6226 certs.go:444] hashing: -rw-r--r-- 1 root root 1338 Feb 23 04:28 /usr/share/ca-certificates/3041.pem
I0222 20:43:42.297250 6226 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3041.pem
I0222 20:43:42.300434 6226 command_runner.go:130] > 51391683
I0222 20:43:42.300633 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/3041.pem /etc/ssl/certs/51391683.0"
I0222 20:43:42.307555 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/30412.pem && ln -fs /usr/share/ca-certificates/30412.pem /etc/ssl/certs/30412.pem"
I0222 20:43:42.314683 6226 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/30412.pem
I0222 20:43:42.317434 6226 command_runner.go:130] > -rw-r--r-- 1 root root 1708 Feb 23 04:28 /usr/share/ca-certificates/30412.pem
I0222 20:43:42.317588 6226 certs.go:444] hashing: -rw-r--r-- 1 root root 1708 Feb 23 04:28 /usr/share/ca-certificates/30412.pem
I0222 20:43:42.317624 6226 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/30412.pem
I0222 20:43:42.320889 6226 command_runner.go:130] > 3ec20f2e
I0222 20:43:42.321096 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/30412.pem /etc/ssl/certs/3ec20f2e.0"
I0222 20:43:42.328054 6226 kubeadm.go:401] StartCluster: {Name:multinode-293000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15849/minikube-v1.29.0-1676568791-15849-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVer
sion:v1.26.1 ClusterName:multinode-293000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.12 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.64.14 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false in
gress:false ingress-dns:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPat
h: StaticIP:}
I0222 20:43:42.328164 6226 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0222 20:43:42.343540 6226 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0222 20:43:42.350116 6226 command_runner.go:130] > /var/lib/kubelet/config.yaml
I0222 20:43:42.350125 6226 command_runner.go:130] > /var/lib/kubelet/kubeadm-flags.env
I0222 20:43:42.350129 6226 command_runner.go:130] > /var/lib/minikube/etcd:
I0222 20:43:42.350133 6226 command_runner.go:130] > member
I0222 20:43:42.350317 6226 kubeadm.go:416] found existing configuration files, will attempt cluster restart
I0222 20:43:42.350330 6226 kubeadm.go:633] restartCluster start
I0222 20:43:42.350367 6226 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0222 20:43:42.357233 6226 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0222 20:43:42.357530 6226 kubeconfig.go:135] verify returned: extract IP: "multinode-293000" does not appear in /Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:43:42.357600 6226 kubeconfig.go:146] "multinode-293000" context is missing from /Users/jenkins/minikube-integration/15909-2565/kubeconfig - will repair!
I0222 20:43:42.357792 6226 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15909-2565/kubeconfig: {Name:mk1b06a800cd80c445d8288b4dd64f07b28a1499 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 20:43:42.358329 6226 loader.go:373] Config loaded from file: /Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:43:42.358518 6226 kapi.go:59] client config for multinode-293000: &rest.Config{Host:"https://192.168.64.12:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.key", CAFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next
Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x25472a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0222 20:43:42.359010 6226 cert_rotation.go:137] Starting client certificate rotation controller
I0222 20:43:42.359180 6226 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0222 20:43:42.365172 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:42.365212 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:42.373534 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:42.875625 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:42.875749 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:42.886815 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:43.375660 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:43.375814 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:43.387317 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:43.874172 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:43.874281 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:43.885806 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:44.375611 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:44.375765 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:44.386712 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:44.874971 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:44.875085 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:44.888686 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:45.374369 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:45.374535 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:45.385806 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:45.873525 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:45.873683 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:45.883145 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:46.375640 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:46.375882 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:46.386443 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:46.874175 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:46.874328 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:46.885341 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:47.374561 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:47.374679 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:47.385135 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:47.875579 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:47.875730 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:47.886171 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:48.373525 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:48.373645 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:48.383963 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:48.873896 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:48.874131 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:48.884516 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:49.373531 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:49.373738 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:49.384005 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:49.875538 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:49.875700 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:49.886141 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:50.374383 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:50.374529 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:50.384613 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:50.875681 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:50.875784 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:50.887907 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:51.374313 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:51.374535 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:51.385345 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:51.874892 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:51.875005 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:51.885197 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:52.375469 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:52.375620 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:52.386849 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:52.386859 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:52.386902 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:52.395506 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:52.395517 6226 kubeadm.go:608] needs reconfigure: apiserver error: timed out waiting for the condition
I0222 20:43:52.395525 6226 kubeadm.go:1120] stopping kube-system containers ...
I0222 20:43:52.395582 6226 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0222 20:43:52.412517 6226 command_runner.go:130] > 6dd7f81ec2fa
I0222 20:43:52.412529 6226 command_runner.go:130] > ca2f5eddf90f
I0222 20:43:52.412532 6226 command_runner.go:130] > 81e5dea5bf26
I0222 20:43:52.412542 6226 command_runner.go:130] > 949ea4d7145b
I0222 20:43:52.412546 6226 command_runner.go:130] > 0c8255290780
I0222 20:43:52.412549 6226 command_runner.go:130] > 1684370ceee7
I0222 20:43:52.412552 6226 command_runner.go:130] > 41f088cd951f
I0222 20:43:52.412561 6226 command_runner.go:130] > 6d623202802d
I0222 20:43:52.412565 6226 command_runner.go:130] > 84e0fe46ac29
I0222 20:43:52.412573 6226 command_runner.go:130] > dedc068e64af
I0222 20:43:52.412580 6226 command_runner.go:130] > 7efc215d8e68
I0222 20:43:52.412585 6226 command_runner.go:130] > dba4607b22f4
I0222 20:43:52.412590 6226 command_runner.go:130] > 141cda940cdc
I0222 20:43:52.412593 6226 command_runner.go:130] > 7bd801790b1a
I0222 20:43:52.412598 6226 command_runner.go:130] > 0d2b73b122a0
I0222 20:43:52.412602 6226 command_runner.go:130] > 9c9e2bb93c68
I0222 20:43:52.413278 6226 docker.go:456] Stopping containers: [6dd7f81ec2fa ca2f5eddf90f 81e5dea5bf26 949ea4d7145b 0c8255290780 1684370ceee7 41f088cd951f 6d623202802d 84e0fe46ac29 dedc068e64af 7efc215d8e68 dba4607b22f4 141cda940cdc 7bd801790b1a 0d2b73b122a0 9c9e2bb93c68]
I0222 20:43:52.413350 6226 ssh_runner.go:195] Run: docker stop 6dd7f81ec2fa ca2f5eddf90f 81e5dea5bf26 949ea4d7145b 0c8255290780 1684370ceee7 41f088cd951f 6d623202802d 84e0fe46ac29 dedc068e64af 7efc215d8e68 dba4607b22f4 141cda940cdc 7bd801790b1a 0d2b73b122a0 9c9e2bb93c68
I0222 20:43:52.435900 6226 command_runner.go:130] > 6dd7f81ec2fa
I0222 20:43:52.435912 6226 command_runner.go:130] > ca2f5eddf90f
I0222 20:43:52.435916 6226 command_runner.go:130] > 81e5dea5bf26
I0222 20:43:52.435919 6226 command_runner.go:130] > 949ea4d7145b
I0222 20:43:52.435930 6226 command_runner.go:130] > 0c8255290780
I0222 20:43:52.435934 6226 command_runner.go:130] > 1684370ceee7
I0222 20:43:52.435937 6226 command_runner.go:130] > 41f088cd951f
I0222 20:43:52.435941 6226 command_runner.go:130] > 6d623202802d
I0222 20:43:52.435957 6226 command_runner.go:130] > 84e0fe46ac29
I0222 20:43:52.435962 6226 command_runner.go:130] > dedc068e64af
I0222 20:43:52.435965 6226 command_runner.go:130] > 7efc215d8e68
I0222 20:43:52.435969 6226 command_runner.go:130] > dba4607b22f4
I0222 20:43:52.435973 6226 command_runner.go:130] > 141cda940cdc
I0222 20:43:52.435976 6226 command_runner.go:130] > 7bd801790b1a
I0222 20:43:52.435979 6226 command_runner.go:130] > 0d2b73b122a0
I0222 20:43:52.435982 6226 command_runner.go:130] > 9c9e2bb93c68
I0222 20:43:52.436872 6226 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0222 20:43:52.448112 6226 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0222 20:43:52.454335 6226 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
I0222 20:43:52.454345 6226 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
I0222 20:43:52.454355 6226 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
I0222 20:43:52.454364 6226 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0222 20:43:52.454454 6226 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0222 20:43:52.454495 6226 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0222 20:43:52.460811 6226 kubeadm.go:710] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
I0222 20:43:52.460819 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0222 20:43:52.532734 6226 command_runner.go:130] > [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0222 20:43:52.532890 6226 command_runner.go:130] > [certs] Using existing ca certificate authority
I0222 20:43:52.533124 6226 command_runner.go:130] > [certs] Using existing apiserver certificate and key on disk
I0222 20:43:52.533447 6226 command_runner.go:130] > [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0222 20:43:52.533717 6226 command_runner.go:130] > [certs] Using existing front-proxy-ca certificate authority
I0222 20:43:52.533952 6226 command_runner.go:130] > [certs] Using existing front-proxy-client certificate and key on disk
I0222 20:43:52.534671 6226 command_runner.go:130] > [certs] Using existing etcd/ca certificate authority
I0222 20:43:52.535138 6226 command_runner.go:130] > [certs] Using existing etcd/server certificate and key on disk
I0222 20:43:52.535453 6226 command_runner.go:130] > [certs] Using existing etcd/peer certificate and key on disk
I0222 20:43:52.535836 6226 command_runner.go:130] > [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0222 20:43:52.536142 6226 command_runner.go:130] > [certs] Using existing apiserver-etcd-client certificate and key on disk
I0222 20:43:52.536391 6226 command_runner.go:130] > [certs] Using the existing "sa" key
I0222 20:43:52.537237 6226 command_runner.go:130] ! W0223 04:43:52.647786 1266 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!
I0222 20:43:52.537330 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0222 20:43:52.582900 6226 command_runner.go:130] > [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0222 20:43:52.691744 6226 command_runner.go:130] > [kubeconfig] Writing "admin.conf" kubeconfig file
I0222 20:43:52.794934 6226 command_runner.go:130] > [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0222 20:43:52.885520 6226 command_runner.go:130] > [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0222 20:43:53.265580 6226 command_runner.go:130] > [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0222 20:43:53.267597 6226 command_runner.go:130] ! W0223 04:43:52.695178 1272 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!
I0222 20:43:53.267634 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0222 20:43:53.323061 6226 command_runner.go:130] > [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0222 20:43:53.323938 6226 command_runner.go:130] > [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0222 20:43:53.324099 6226 command_runner.go:130] > [kubelet-start] Starting the kubelet
I0222 20:43:53.413765 6226 command_runner.go:130] ! W0223 04:43:53.426370 1278 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!
I0222 20:43:53.413785 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0222 20:43:53.459259 6226 command_runner.go:130] > [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0222 20:43:53.459272 6226 command_runner.go:130] > [control-plane] Creating static Pod manifest for "kube-apiserver"
I0222 20:43:53.460937 6226 command_runner.go:130] > [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0222 20:43:53.462920 6226 command_runner.go:130] > [control-plane] Creating static Pod manifest for "kube-scheduler"
I0222 20:43:53.466443 6226 command_runner.go:130] ! W0223 04:43:53.574681 1300 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!
I0222 20:43:53.466459 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0222 20:43:53.519036 6226 command_runner.go:130] > [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0222 20:43:53.521797 6226 command_runner.go:130] ! W0223 04:43:53.633648 1310 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!
I0222 20:43:53.521821 6226 api_server.go:51] waiting for apiserver process to appear ...
I0222 20:43:53.521872 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0222 20:43:54.033742 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0222 20:43:54.534304 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0222 20:43:55.034441 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0222 20:43:55.533672 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0222 20:43:55.543442 6226 command_runner.go:130] > 1661
I0222 20:43:55.543645 6226 api_server.go:71] duration metric: took 2.021859074s to wait for apiserver process to appear ...
I0222 20:43:55.543656 6226 api_server.go:87] waiting for apiserver healthz status ...
I0222 20:43:55.543666 6226 api_server.go:252] Checking apiserver healthz at https://192.168.64.12:8443/healthz ...
I0222 20:43:58.456609 6226 api_server.go:278] https://192.168.64.12:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0222 20:43:58.456641 6226 api_server.go:102] status: https://192.168.64.12:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0222 20:43:58.958958 6226 api_server.go:252] Checking apiserver healthz at https://192.168.64.12:8443/healthz ...
I0222 20:43:58.964560 6226 api_server.go:278] https://192.168.64.12:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W0222 20:43:58.964574 6226 api_server.go:102] status: https://192.168.64.12:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I0222 20:43:59.457367 6226 api_server.go:252] Checking apiserver healthz at https://192.168.64.12:8443/healthz ...
I0222 20:43:59.461714 6226 api_server.go:278] https://192.168.64.12:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W0222 20:43:59.461731 6226 api_server.go:102] status: https://192.168.64.12:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I0222 20:43:59.956687 6226 api_server.go:252] Checking apiserver healthz at https://192.168.64.12:8443/healthz ...
I0222 20:43:59.962161 6226 api_server.go:278] https://192.168.64.12:8443/healthz returned 200:
ok
I0222 20:43:59.962219 6226 round_trippers.go:463] GET https://192.168.64.12:8443/version
I0222 20:43:59.962223 6226 round_trippers.go:469] Request Headers:
I0222 20:43:59.962231 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:43:59.962240 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:43:59.967731 6226 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0222 20:43:59.967742 6226 round_trippers.go:577] Response Headers:
I0222 20:43:59.967748 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:43:59.967753 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:43:59.967758 6226 round_trippers.go:580] Content-Length: 263
I0222 20:43:59.967763 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:00 GMT
I0222 20:43:59.967767 6226 round_trippers.go:580] Audit-Id: 18f93eac-ade5-4f2c-9a4b-fc7727bccd66
I0222 20:43:59.967772 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:43:59.967777 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:43:59.967794 6226 request.go:1171] Response Body: {
"major": "1",
"minor": "26",
"gitVersion": "v1.26.1",
"gitCommit": "8f94681cd294aa8cfd3407b8191f6c70214973a4",
"gitTreeState": "clean",
"buildDate": "2023-01-18T15:51:25Z",
"goVersion": "go1.19.5",
"compiler": "gc",
"platform": "linux/amd64"
}
I0222 20:43:59.967838 6226 api_server.go:140] control plane version: v1.26.1
I0222 20:43:59.967846 6226 api_server.go:130] duration metric: took 4.424266038s to wait for apiserver health ...
I0222 20:43:59.967851 6226 cni.go:84] Creating CNI manager for ""
I0222 20:43:59.967857 6226 cni.go:136] 3 nodes found, recommending kindnet
I0222 20:43:59.989987 6226 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0222 20:44:00.011252 6226 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0222 20:44:00.015234 6226 command_runner.go:130] > File: /opt/cni/bin/portmap
I0222 20:44:00.015247 6226 command_runner.go:130] > Size: 2798344 Blocks: 5472 IO Block: 4096 regular file
I0222 20:44:00.015252 6226 command_runner.go:130] > Device: 11h/17d Inode: 3542 Links: 1
I0222 20:44:00.015257 6226 command_runner.go:130] > Access: (0755/-rwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root)
I0222 20:44:00.015261 6226 command_runner.go:130] > Access: 2023-02-23 04:43:35.438869016 +0000
I0222 20:44:00.015266 6226 command_runner.go:130] > Modify: 2023-02-16 22:59:55.000000000 +0000
I0222 20:44:00.015271 6226 command_runner.go:130] > Change: 2023-02-23 04:43:33.465142217 +0000
I0222 20:44:00.015278 6226 command_runner.go:130] > Birth: -
I0222 20:44:00.015635 6226 cni.go:181] applying CNI manifest using /var/lib/minikube/binaries/v1.26.1/kubectl ...
I0222 20:44:00.015644 6226 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2428 bytes)
I0222 20:44:00.050119 6226 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.26.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0222 20:44:01.028716 6226 command_runner.go:130] > clusterrole.rbac.authorization.k8s.io/kindnet unchanged
I0222 20:44:01.030963 6226 command_runner.go:130] > clusterrolebinding.rbac.authorization.k8s.io/kindnet unchanged
I0222 20:44:01.032685 6226 command_runner.go:130] > serviceaccount/kindnet unchanged
I0222 20:44:01.045765 6226 command_runner.go:130] > daemonset.apps/kindnet configured
I0222 20:44:01.047289 6226 system_pods.go:43] waiting for kube-system pods to appear ...
I0222 20:44:01.047350 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:44:01.047355 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.047362 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.047368 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.050625 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:01.050635 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.050641 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.050646 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.050654 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.050661 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.050667 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.050672 6226 round_trippers.go:580] Audit-Id: 7de3f617-39b3-4130-b85b-c99ca5d82f3f
I0222 20:44:01.051622 6226 request.go:1171] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"713"},"items":[{"metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"403","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f
:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 82454 chars]
I0222 20:44:01.054470 6226 system_pods.go:59] 12 kube-system pods found
I0222 20:44:01.054481 6226 system_pods.go:61] "coredns-787d4945fb-b28zh" [307635d3-a26b-4eff-be8a-9d65e1f996c3] Running
I0222 20:44:01.054494 6226 system_pods.go:61] "etcd-multinode-293000" [2363a307-e6f7-4025-ae02-4920adde4561] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0222 20:44:01.054499 6226 system_pods.go:61] "kindnet-bzxtr" [b3092ad6-e39a-43f2-8a95-ead97184aa40] Running
I0222 20:44:01.054502 6226 system_pods.go:61] "kindnet-nm7kn" [061817b8-aa21-408e-b432-53850cf8eb6d] Running
I0222 20:44:01.054506 6226 system_pods.go:61] "kindnet-rrx46" [df2ad52c-df28-46f4-b739-812ad756ed0e] Running
I0222 20:44:01.054510 6226 system_pods.go:61] "kube-apiserver-multinode-293000" [bb2fc1a3-12c1-4854-8f8c-3c1c5664067c] Running
I0222 20:44:01.054514 6226 system_pods.go:61] "kube-controller-manager-multinode-293000" [e60be5dc-4ed1-4a87-b03c-2ac01b03001d] Running
I0222 20:44:01.054518 6226 system_pods.go:61] "kube-proxy-bj985" [36f7816d-0b3e-4210-be32-907bf62dfa61] Running
I0222 20:44:01.054524 6226 system_pods.go:61] "kube-proxy-pxq2s" [0ce24b37-1ce7-4772-b40d-5f88f10aaa4b] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0222 20:44:01.054528 6226 system_pods.go:61] "kube-proxy-qmsbf" [98395ed9-2055-48e0-8d84-b931dfc0d9c7] Running
I0222 20:44:01.054532 6226 system_pods.go:61] "kube-scheduler-multinode-293000" [deb74301-35df-47d1-a8a9-f59943186666] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0222 20:44:01.054536 6226 system_pods.go:61] "storage-provisioner" [2e7410db-637a-4d25-9f92-f5e551a32c8d] Running
I0222 20:44:01.054540 6226 system_pods.go:74] duration metric: took 7.244514ms to wait for pod list to return data ...
I0222 20:44:01.054546 6226 node_conditions.go:102] verifying NodePressure condition ...
I0222 20:44:01.054577 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes
I0222 20:44:01.054582 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.054587 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.054593 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.056582 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.056591 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.056596 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.056601 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.056607 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.056635 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.056644 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.056654 6226 round_trippers.go:580] Audit-Id: beb5ae1e-578b-4292-b55b-1c3284f144b8
I0222 20:44:01.056964 6226 request.go:1171] Response Body: {"kind":"NodeList","apiVersion":"v1","metadata":{"resourceVersion":"713"},"items":[{"metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFiel
ds":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time" [truncated 16454 chars]
I0222 20:44:01.057495 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:44:01.057510 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:44:01.057520 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:44:01.057524 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:44:01.057528 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:44:01.057532 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:44:01.057536 6226 node_conditions.go:105] duration metric: took 2.986334ms to run NodePressure ...
I0222 20:44:01.057546 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0222 20:44:01.159557 6226 command_runner.go:130] > [addons] Applied essential addon: CoreDNS
I0222 20:44:01.188402 6226 command_runner.go:130] > [addons] Applied essential addon: kube-proxy
I0222 20:44:01.189315 6226 command_runner.go:130] ! W0223 04:44:01.225890 2467 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!
I0222 20:44:01.189334 6226 kubeadm.go:769] waiting for restarted kubelet to initialise ...
I0222 20:44:01.189386 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods?labelSelector=tier%3Dcontrol-plane
I0222 20:44:01.189391 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.189397 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.189403 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.191389 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.191416 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.191428 6226 round_trippers.go:580] Audit-Id: c06f9c08-f04d-4cd6-8686-f9a2911e9932
I0222 20:44:01.191436 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.191442 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.191447 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.191452 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.191457 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.191692 6226 request.go:1171] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"715"},"items":[{"metadata":{"name":"etcd-multinode-293000","namespace":"kube-system","uid":"2363a307-e6f7-4025-ae02-4920adde4561","resourceVersion":"710","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.64.12:2379","kubernetes.io/config.hash":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.mirror":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.seen":"2023-02-23T04:40:26.073140598Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations
":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-client-urls":{},"f:ku [truncated 28779 chars]
I0222 20:44:01.192382 6226 kubeadm.go:784] kubelet initialised
I0222 20:44:01.192391 6226 kubeadm.go:785] duration metric: took 3.049214ms waiting for restarted kubelet to initialise ...
I0222 20:44:01.192398 6226 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0222 20:44:01.192429 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:44:01.192434 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.192440 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.192446 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.197287 6226 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0222 20:44:01.197301 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.197308 6226 round_trippers.go:580] Audit-Id: 5f613e84-3ed8-4792-b249-494ab1a89f6a
I0222 20:44:01.197314 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.197319 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.197324 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.197329 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.197338 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.198197 6226 request.go:1171] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"715"},"items":[{"metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"403","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f
:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 82454 chars]
I0222 20:44:01.200006 6226 pod_ready.go:78] waiting up to 4m0s for pod "coredns-787d4945fb-b28zh" in "kube-system" namespace to be "Ready" ...
I0222 20:44:01.200047 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:01.200052 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.200058 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.200065 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.201732 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.201742 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.201748 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.201754 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.201759 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.201763 6226 round_trippers.go:580] Audit-Id: 3c2ff47e-a83f-4ded-97c5-53691cd74ab8
I0222 20:44:01.201768 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.201773 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.201962 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"403","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6281 chars]
I0222 20:44:01.202223 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:01.202229 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.202236 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.202241 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.203613 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.203621 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.203629 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.203636 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.203645 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.203652 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.203660 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.203681 6226 round_trippers.go:580] Audit-Id: 9c7d0a9d-463a-4a1e-9948-7ddff31182d6
I0222 20:44:01.203763 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:01.203941 6226 pod_ready.go:97] node "multinode-293000" hosting pod "coredns-787d4945fb-b28zh" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.203950 6226 pod_ready.go:81] duration metric: took 3.932953ms waiting for pod "coredns-787d4945fb-b28zh" in "kube-system" namespace to be "Ready" ...
E0222 20:44:01.203955 6226 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-293000" hosting pod "coredns-787d4945fb-b28zh" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.203960 6226 pod_ready.go:78] waiting up to 4m0s for pod "etcd-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:01.203988 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/etcd-multinode-293000
I0222 20:44:01.203993 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.203998 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.204004 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.205574 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.205583 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.205591 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.205598 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.205604 6226 round_trippers.go:580] Audit-Id: e0413176-5c02-4b99-9cc0-b1f84e7b1546
I0222 20:44:01.205609 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.205614 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.205621 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.205800 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"etcd-multinode-293000","namespace":"kube-system","uid":"2363a307-e6f7-4025-ae02-4920adde4561","resourceVersion":"710","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.64.12:2379","kubernetes.io/config.hash":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.mirror":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.seen":"2023-02-23T04:40:26.073140598Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-c
lient-urls":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config [truncated 6279 chars]
I0222 20:44:01.206020 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:01.206026 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.206032 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.206038 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.207190 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.207198 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.207205 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.207212 6226 round_trippers.go:580] Audit-Id: 214f65cb-1e18-4ebc-b471-8214e2bb8a7b
I0222 20:44:01.207220 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.207226 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.207232 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.207237 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.207353 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:01.207522 6226 pod_ready.go:97] node "multinode-293000" hosting pod "etcd-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.207529 6226 pod_ready.go:81] duration metric: took 3.565343ms waiting for pod "etcd-multinode-293000" in "kube-system" namespace to be "Ready" ...
E0222 20:44:01.207535 6226 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-293000" hosting pod "etcd-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.207543 6226 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:01.207569 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-multinode-293000
I0222 20:44:01.207573 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.207579 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.207585 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.209410 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.209419 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.209424 6226 round_trippers.go:580] Audit-Id: bb45a18b-8d80-4512-852f-2519e059fa21
I0222 20:44:01.209428 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.209433 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.209444 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.209452 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.209458 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.209525 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-apiserver-multinode-293000","namespace":"kube-system","uid":"bb2fc1a3-12c1-4854-8f8c-3c1c5664067c","resourceVersion":"280","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-apiserver","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.64.12:8443","kubernetes.io/config.hash":"578ff397a5454283a55e183c76494192","kubernetes.io/config.mirror":"578ff397a5454283a55e183c76494192","kubernetes.io/config.seen":"2023-02-23T04:40:26.073157361Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kub
ernetes.io/kube-apiserver.advertise-address.endpoint":{},"f:kubernetes. [truncated 7383 chars]
I0222 20:44:01.209743 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:01.209749 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.209755 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.209760 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.211408 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.211418 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.211426 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.211434 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.211442 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.211448 6226 round_trippers.go:580] Audit-Id: 9c96ca23-ee87-404e-815c-df5c29ddccb4
I0222 20:44:01.211454 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.211458 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.211519 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:01.211690 6226 pod_ready.go:97] node "multinode-293000" hosting pod "kube-apiserver-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.211697 6226 pod_ready.go:81] duration metric: took 4.148979ms waiting for pod "kube-apiserver-multinode-293000" in "kube-system" namespace to be "Ready" ...
E0222 20:44:01.211702 6226 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-293000" hosting pod "kube-apiserver-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.211708 6226 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:01.248188 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-multinode-293000
I0222 20:44:01.248213 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.248226 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.248236 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.251464 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:01.251479 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.251487 6226 round_trippers.go:580] Audit-Id: f0985089-3bc7-4d27-9543-950d01930293
I0222 20:44:01.251493 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.251500 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.251508 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.251515 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.251522 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.251616 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-controller-manager-multinode-293000","namespace":"kube-system","uid":"e60be5dc-4ed1-4a87-b03c-2ac01b03001d","resourceVersion":"284","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-controller-manager","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"02b271251b67ef9dd552c569d01153ca","kubernetes.io/config.mirror":"02b271251b67ef9dd552c569d01153ca","kubernetes.io/config.seen":"2023-02-23T04:40:26.073158360Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.i
o/config.seen":{},"f:kubernetes.io/config.source":{}},"f:labels":{".":{ [truncated 6953 chars]
I0222 20:44:01.448799 6226 request.go:622] Waited for 196.844818ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:01.448895 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:01.448903 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.448912 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.448920 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.450814 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.450829 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.450838 6226 round_trippers.go:580] Audit-Id: f5d4a6ed-aaca-45eb-bd13-7a22da3cbc58
I0222 20:44:01.450848 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.450856 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.450863 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.450869 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.450876 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.451046 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:01.451245 6226 pod_ready.go:97] node "multinode-293000" hosting pod "kube-controller-manager-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.451252 6226 pod_ready.go:81] duration metric: took 239.544938ms waiting for pod "kube-controller-manager-multinode-293000" in "kube-system" namespace to be "Ready" ...
E0222 20:44:01.451261 6226 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-293000" hosting pod "kube-controller-manager-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.451266 6226 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-bj985" in "kube-system" namespace to be "Ready" ...
I0222 20:44:01.648242 6226 request.go:622] Waited for 196.929726ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bj985
I0222 20:44:01.648321 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bj985
I0222 20:44:01.648376 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.648389 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.648400 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.650924 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:01.650937 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.650944 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.650951 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.650957 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.650963 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.650970 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.650976 6226 round_trippers.go:580] Audit-Id: 187ad684-c4c7-4ca4-8e05-b3a2b6dd5f7f
I0222 20:44:01.651072 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-bj985","generateName":"kube-proxy-","namespace":"kube-system","uid":"36f7816d-0b3e-4210-be32-907bf62dfa61","resourceVersion":"687","creationTimestamp":"2023-02-23T04:42:15Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:42:15Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5746 chars]
I0222 20:44:01.847734 6226 request.go:622] Waited for 196.335031ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m03
I0222 20:44:01.847782 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m03
I0222 20:44:01.847790 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.847804 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.847870 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.850476 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:01.850492 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.850500 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.850517 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.850529 6226 round_trippers.go:580] Audit-Id: 80462e2b-f0e3-496c-a59c-14fc1c1589fd
I0222 20:44:01.850536 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.850543 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.850549 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.850862 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m03","uid":"181ccd63-a7fc-412c-bfee-446a1e65f4b4","resourceVersion":"698","creationTimestamp":"2023-02-23T04:42:56Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m03","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:42:56Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{
}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 4449 chars]
I0222 20:44:01.851096 6226 pod_ready.go:92] pod "kube-proxy-bj985" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:01.851104 6226 pod_ready.go:81] duration metric: took 399.840597ms waiting for pod "kube-proxy-bj985" in "kube-system" namespace to be "Ready" ...
I0222 20:44:01.851112 6226 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-pxq2s" in "kube-system" namespace to be "Ready" ...
I0222 20:44:02.047828 6226 request.go:622] Waited for 196.675284ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pxq2s
I0222 20:44:02.047953 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pxq2s
I0222 20:44:02.047963 6226 round_trippers.go:469] Request Headers:
I0222 20:44:02.047974 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:02.047984 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:02.050086 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:02.050103 6226 round_trippers.go:577] Response Headers:
I0222 20:44:02.050112 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:02 GMT
I0222 20:44:02.050121 6226 round_trippers.go:580] Audit-Id: 179a24a9-633b-47e8-841f-e7f77779419e
I0222 20:44:02.050128 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:02.050135 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:02.050145 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:02.050153 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:02.050258 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-pxq2s","generateName":"kube-proxy-","namespace":"kube-system","uid":"0ce24b37-1ce7-4772-b40d-5f88f10aaa4b","resourceVersion":"713","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5928 chars]
I0222 20:44:02.247652 6226 request.go:622] Waited for 197.141439ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:02.247696 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:02.247705 6226 round_trippers.go:469] Request Headers:
I0222 20:44:02.247715 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:02.247724 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:02.249789 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:02.249800 6226 round_trippers.go:577] Response Headers:
I0222 20:44:02.249806 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:02 GMT
I0222 20:44:02.249811 6226 round_trippers.go:580] Audit-Id: 46a96ced-4686-4338-bd8c-df0e916d3b91
I0222 20:44:02.249817 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:02.249822 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:02.249827 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:02.249833 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:02.249931 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:02.250124 6226 pod_ready.go:97] node "multinode-293000" hosting pod "kube-proxy-pxq2s" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:02.250132 6226 pod_ready.go:81] duration metric: took 399.021836ms waiting for pod "kube-proxy-pxq2s" in "kube-system" namespace to be "Ready" ...
E0222 20:44:02.250138 6226 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-293000" hosting pod "kube-proxy-pxq2s" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:02.250142 6226 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-qmsbf" in "kube-system" namespace to be "Ready" ...
I0222 20:44:02.449307 6226 request.go:622] Waited for 199.109206ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qmsbf
I0222 20:44:02.449377 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qmsbf
I0222 20:44:02.449385 6226 round_trippers.go:469] Request Headers:
I0222 20:44:02.449398 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:02.449410 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:02.452330 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:02.452345 6226 round_trippers.go:577] Response Headers:
I0222 20:44:02.452354 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:02.452363 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:02.452373 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:02.452385 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:02 GMT
I0222 20:44:02.452395 6226 round_trippers.go:580] Audit-Id: 3caf1443-a48b-490f-bf3b-ca725ce7bdc3
I0222 20:44:02.452407 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:02.452525 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-qmsbf","generateName":"kube-proxy-","namespace":"kube-system","uid":"98395ed9-2055-48e0-8d84-b931dfc0d9c7","resourceVersion":"486","creationTimestamp":"2023-02-23T04:41:26Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:41:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5541 chars]
I0222 20:44:02.649394 6226 request.go:622] Waited for 196.531343ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:44:02.649492 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:44:02.649579 6226 round_trippers.go:469] Request Headers:
I0222 20:44:02.649593 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:02.649617 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:02.652277 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:02.652293 6226 round_trippers.go:577] Response Headers:
I0222 20:44:02.652304 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:02 GMT
I0222 20:44:02.652316 6226 round_trippers.go:580] Audit-Id: c4fc2f38-4eee-462a-974b-e66e95b9037f
I0222 20:44:02.652327 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:02.652336 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:02.652344 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:02.652355 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:02.652508 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"f968bf76-422f-4a90-ba94-df00a7b8efaa","resourceVersion":"592","creationTimestamp":"2023-02-23T04:41:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:41:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:41:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.ku
bernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f [truncated 4512 chars]
I0222 20:44:02.652744 6226 pod_ready.go:92] pod "kube-proxy-qmsbf" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:02.652752 6226 pod_ready.go:81] duration metric: took 402.611768ms waiting for pod "kube-proxy-qmsbf" in "kube-system" namespace to be "Ready" ...
I0222 20:44:02.652759 6226 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:02.847410 6226 request.go:622] Waited for 194.572177ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-293000
I0222 20:44:02.847440 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-293000
I0222 20:44:02.847444 6226 round_trippers.go:469] Request Headers:
I0222 20:44:02.847450 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:02.847457 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:02.848938 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:02.848951 6226 round_trippers.go:577] Response Headers:
I0222 20:44:02.848957 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:02.848964 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:02.848971 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:02 GMT
I0222 20:44:02.848978 6226 round_trippers.go:580] Audit-Id: 7dd9c3a4-81b6-4c62-8a6a-4e31d939609e
I0222 20:44:02.848984 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:02.848990 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:02.849069 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-scheduler-multinode-293000","namespace":"kube-system","uid":"deb74301-35df-47d1-a8a9-f59943186666","resourceVersion":"711","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-scheduler","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"ef6d7c628504525048f2a505fc91f554","kubernetes.io/config.mirror":"ef6d7c628504525048f2a505fc91f554","kubernetes.io/config.seen":"2023-02-23T04:40:26.073159188Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.io/config.seen":{},
"f:kubernetes.io/config.source":{}},"f:labels":{".":{},"f:component":{} [truncated 5132 chars]
I0222 20:44:03.048426 6226 request.go:622] Waited for 199.069828ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:03.048470 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:03.048476 6226 round_trippers.go:469] Request Headers:
I0222 20:44:03.048483 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:03.048490 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:03.050125 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:03.050135 6226 round_trippers.go:577] Response Headers:
I0222 20:44:03.050141 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:03 GMT
I0222 20:44:03.050146 6226 round_trippers.go:580] Audit-Id: a5f0fa1a-6552-4b63-8aeb-a0000aad5b2a
I0222 20:44:03.050151 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:03.050156 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:03.050161 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:03.050166 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:03.050291 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:03.050492 6226 pod_ready.go:97] node "multinode-293000" hosting pod "kube-scheduler-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:03.050500 6226 pod_ready.go:81] duration metric: took 397.742199ms waiting for pod "kube-scheduler-multinode-293000" in "kube-system" namespace to be "Ready" ...
E0222 20:44:03.050506 6226 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-293000" hosting pod "kube-scheduler-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:03.050511 6226 pod_ready.go:38] duration metric: took 1.858141947s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0222 20:44:03.050521 6226 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0222 20:44:03.058289 6226 command_runner.go:130] > -16
I0222 20:44:03.058535 6226 ops.go:34] apiserver oom_adj: -16
I0222 20:44:03.058543 6226 kubeadm.go:637] restartCluster took 20.708584507s
I0222 20:44:03.058547 6226 kubeadm.go:403] StartCluster complete in 20.730876089s
I0222 20:44:03.058560 6226 settings.go:142] acquiring lock: {Name:mkc26232b9c6921321370d16721303c6a865ce03 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 20:44:03.058636 6226 settings.go:150] Updating kubeconfig: /Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:44:03.058981 6226 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15909-2565/kubeconfig: {Name:mk1b06a800cd80c445d8288b4dd64f07b28a1499 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 20:44:03.059212 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.26.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0222 20:44:03.059258 6226 addons.go:489] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false volumesnapshots:false]
I0222 20:44:03.059390 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:44:03.134470 6226 out.go:177] * Enabled addons:
I0222 20:44:03.059611 6226 loader.go:373] Config loaded from file: /Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:44:03.157202 6226 addons.go:492] enable addons completed in 97.945344ms: enabled=[]
I0222 20:44:03.157458 6226 kapi.go:59] client config for multinode-293000: &rest.Config{Host:"https://192.168.64.12:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.key", CAFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next
Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x25472a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0222 20:44:03.157716 6226 round_trippers.go:463] GET https://192.168.64.12:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale
I0222 20:44:03.157722 6226 round_trippers.go:469] Request Headers:
I0222 20:44:03.157728 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:03.157734 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:03.159333 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:03.159343 6226 round_trippers.go:577] Response Headers:
I0222 20:44:03.159349 6226 round_trippers.go:580] Audit-Id: 8009df31-a020-41db-ad81-9cc892a99ba6
I0222 20:44:03.159353 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:03.159359 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:03.159363 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:03.159369 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:03.159373 6226 round_trippers.go:580] Content-Length: 291
I0222 20:44:03.159378 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:03 GMT
I0222 20:44:03.159389 6226 request.go:1171] Response Body: {"kind":"Scale","apiVersion":"autoscaling/v1","metadata":{"name":"coredns","namespace":"kube-system","uid":"b913bddd-effc-42b2-b71d-0d3159053b5a","resourceVersion":"714","creationTimestamp":"2023-02-23T04:40:25Z"},"spec":{"replicas":1},"status":{"replicas":1,"selector":"k8s-app=kube-dns"}}
I0222 20:44:03.159506 6226 kapi.go:248] "coredns" deployment in "kube-system" namespace and "multinode-293000" context rescaled to 1 replicas
I0222 20:44:03.159522 6226 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.64.12 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0222 20:44:03.180379 6226 out.go:177] * Verifying Kubernetes components...
I0222 20:44:03.166483 6226 command_runner.go:130] > apiVersion: v1
I0222 20:44:03.180398 6226 command_runner.go:130] > data:
I0222 20:44:03.201476 6226 command_runner.go:130] > Corefile: |
I0222 20:44:03.201490 6226 command_runner.go:130] > .:53 {
I0222 20:44:03.201498 6226 command_runner.go:130] > log
I0222 20:44:03.201506 6226 command_runner.go:130] > errors
I0222 20:44:03.201511 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0222 20:44:03.201514 6226 command_runner.go:130] > health {
I0222 20:44:03.201528 6226 command_runner.go:130] > lameduck 5s
I0222 20:44:03.201536 6226 command_runner.go:130] > }
I0222 20:44:03.201543 6226 command_runner.go:130] > ready
I0222 20:44:03.201552 6226 command_runner.go:130] > kubernetes cluster.local in-addr.arpa ip6.arpa {
I0222 20:44:03.201560 6226 command_runner.go:130] > pods insecure
I0222 20:44:03.201570 6226 command_runner.go:130] > fallthrough in-addr.arpa ip6.arpa
I0222 20:44:03.201578 6226 command_runner.go:130] > ttl 30
I0222 20:44:03.201585 6226 command_runner.go:130] > }
I0222 20:44:03.201598 6226 command_runner.go:130] > prometheus :9153
I0222 20:44:03.201605 6226 command_runner.go:130] > hosts {
I0222 20:44:03.201615 6226 command_runner.go:130] > 192.168.64.1 host.minikube.internal
I0222 20:44:03.201622 6226 command_runner.go:130] > fallthrough
I0222 20:44:03.201629 6226 command_runner.go:130] > }
I0222 20:44:03.201637 6226 command_runner.go:130] > forward . /etc/resolv.conf {
I0222 20:44:03.201661 6226 command_runner.go:130] > max_concurrent 1000
I0222 20:44:03.201670 6226 command_runner.go:130] > }
I0222 20:44:03.201677 6226 command_runner.go:130] > cache 30
I0222 20:44:03.201694 6226 command_runner.go:130] > loop
I0222 20:44:03.201704 6226 command_runner.go:130] > reload
I0222 20:44:03.201712 6226 command_runner.go:130] > loadbalance
I0222 20:44:03.201719 6226 command_runner.go:130] > }
I0222 20:44:03.201728 6226 command_runner.go:130] > kind: ConfigMap
I0222 20:44:03.201736 6226 command_runner.go:130] > metadata:
I0222 20:44:03.201746 6226 command_runner.go:130] > creationTimestamp: "2023-02-23T04:40:25Z"
I0222 20:44:03.201753 6226 command_runner.go:130] > name: coredns
I0222 20:44:03.201761 6226 command_runner.go:130] > namespace: kube-system
I0222 20:44:03.201770 6226 command_runner.go:130] > resourceVersion: "358"
I0222 20:44:03.201778 6226 command_runner.go:130] > uid: 260fccb1-07e1-4dd1-a16e-c119751deab5
I0222 20:44:03.201873 6226 start.go:894] CoreDNS already contains "host.minikube.internal" host record, skipping...
I0222 20:44:03.212458 6226 node_ready.go:35] waiting up to 6m0s for node "multinode-293000" to be "Ready" ...
I0222 20:44:03.248276 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:03.248304 6226 round_trippers.go:469] Request Headers:
I0222 20:44:03.248351 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:03.248362 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:03.251161 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:03.251174 6226 round_trippers.go:577] Response Headers:
I0222 20:44:03.251183 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:03.251190 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:03.251198 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:03.251206 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:03.251213 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:03 GMT
I0222 20:44:03.251221 6226 round_trippers.go:580] Audit-Id: d4352317-ebee-4107-8feb-36b01a3bdd49
I0222 20:44:03.251418 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:03.751854 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:03.751869 6226 round_trippers.go:469] Request Headers:
I0222 20:44:03.751878 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:03.751883 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:03.753583 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:03.753592 6226 round_trippers.go:577] Response Headers:
I0222 20:44:03.753599 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:03.753613 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:03 GMT
I0222 20:44:03.753618 6226 round_trippers.go:580] Audit-Id: 207fa3df-77bf-45b1-a610-8d39066be0cf
I0222 20:44:03.753624 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:03.753629 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:03.753634 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:03.753781 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:04.251823 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:04.251837 6226 round_trippers.go:469] Request Headers:
I0222 20:44:04.251895 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:04.251902 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:04.253299 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:04.253312 6226 round_trippers.go:577] Response Headers:
I0222 20:44:04.253321 6226 round_trippers.go:580] Audit-Id: ead978f5-409c-4404-9a7d-92dad80bf5a6
I0222 20:44:04.253338 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:04.253348 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:04.253362 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:04.253369 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:04.253376 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:04 GMT
I0222 20:44:04.253446 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:04.752594 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:04.752614 6226 round_trippers.go:469] Request Headers:
I0222 20:44:04.752626 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:04.752636 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:04.755724 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:04.755738 6226 round_trippers.go:577] Response Headers:
I0222 20:44:04.755746 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:04 GMT
I0222 20:44:04.755752 6226 round_trippers.go:580] Audit-Id: 114fc980-a27d-482a-8a30-97e0d1b07115
I0222 20:44:04.755758 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:04.755766 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:04.755772 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:04.755778 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:04.755927 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:05.252211 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:05.252222 6226 round_trippers.go:469] Request Headers:
I0222 20:44:05.252229 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:05.252234 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:05.253502 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:05.253512 6226 round_trippers.go:577] Response Headers:
I0222 20:44:05.253517 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:05.253522 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:05.253528 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:05.253532 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:05 GMT
I0222 20:44:05.253537 6226 round_trippers.go:580] Audit-Id: 092f8203-8f2e-4582-a098-ce3a1e44e8cc
I0222 20:44:05.253544 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:05.253622 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:05.253814 6226 node_ready.go:58] node "multinode-293000" has status "Ready":"False"
I0222 20:44:05.752210 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:05.752223 6226 round_trippers.go:469] Request Headers:
I0222 20:44:05.752230 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:05.752238 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:05.753723 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:05.753735 6226 round_trippers.go:577] Response Headers:
I0222 20:44:05.753740 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:05.753745 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:05.753750 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:05.753754 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:05.753761 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:05 GMT
I0222 20:44:05.753770 6226 round_trippers.go:580] Audit-Id: 53f81b02-cf84-4b98-862d-0645a1d3d84f
I0222 20:44:05.753912 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:06.251699 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:06.251713 6226 round_trippers.go:469] Request Headers:
I0222 20:44:06.251720 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:06.251725 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:06.252931 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:06.252945 6226 round_trippers.go:577] Response Headers:
I0222 20:44:06.252953 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:06 GMT
I0222 20:44:06.252960 6226 round_trippers.go:580] Audit-Id: b3a9b71e-713e-4c81-8de2-ce30f2535f55
I0222 20:44:06.252967 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:06.252971 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:06.252976 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:06.252981 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:06.253134 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:06.753392 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:06.753417 6226 round_trippers.go:469] Request Headers:
I0222 20:44:06.753429 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:06.753439 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:06.756228 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:06.756249 6226 round_trippers.go:577] Response Headers:
I0222 20:44:06.756261 6226 round_trippers.go:580] Audit-Id: a768fa84-c79d-4255-bb70-088fa70fe09c
I0222 20:44:06.756270 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:06.756281 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:06.756291 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:06.756300 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:06.756310 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:06 GMT
I0222 20:44:06.756418 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:07.253198 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:07.253210 6226 round_trippers.go:469] Request Headers:
I0222 20:44:07.253216 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:07.253221 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:07.254796 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:07.254807 6226 round_trippers.go:577] Response Headers:
I0222 20:44:07.254812 6226 round_trippers.go:580] Audit-Id: 3dadfcd1-3841-4f2e-ae07-c27ebdb6878e
I0222 20:44:07.254818 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:07.254823 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:07.254827 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:07.254833 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:07.254838 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:07 GMT
I0222 20:44:07.254937 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:07.255117 6226 node_ready.go:49] node "multinode-293000" has status "Ready":"True"
I0222 20:44:07.255126 6226 node_ready.go:38] duration metric: took 4.042728512s waiting for node "multinode-293000" to be "Ready" ...
I0222 20:44:07.255132 6226 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0222 20:44:07.255164 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:44:07.255168 6226 round_trippers.go:469] Request Headers:
I0222 20:44:07.255174 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:07.255179 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:07.257736 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:07.257747 6226 round_trippers.go:577] Response Headers:
I0222 20:44:07.257754 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:07.257762 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:07.257769 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:07 GMT
I0222 20:44:07.257777 6226 round_trippers.go:580] Audit-Id: b747a605-b6d4-472d-a4d9-a25fd49c01bf
I0222 20:44:07.257784 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:07.257792 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:07.259253 6226 request.go:1171] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"753"},"items":[{"metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f
:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 83345 chars]
I0222 20:44:07.261040 6226 pod_ready.go:78] waiting up to 6m0s for pod "coredns-787d4945fb-b28zh" in "kube-system" namespace to be "Ready" ...
I0222 20:44:07.261075 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:07.261080 6226 round_trippers.go:469] Request Headers:
I0222 20:44:07.261085 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:07.261091 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:07.262279 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:07.262286 6226 round_trippers.go:577] Response Headers:
I0222 20:44:07.262291 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:07 GMT
I0222 20:44:07.262296 6226 round_trippers.go:580] Audit-Id: 2f9b4c1f-3ee0-4999-9274-c7b8e6a14c28
I0222 20:44:07.262301 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:07.262306 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:07.262311 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:07.262316 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:07.262459 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:07.262700 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:07.262707 6226 round_trippers.go:469] Request Headers:
I0222 20:44:07.262713 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:07.262719 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:07.263704 6226 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds
I0222 20:44:07.263722 6226 round_trippers.go:577] Response Headers:
I0222 20:44:07.263734 6226 round_trippers.go:580] Audit-Id: f4fcc4eb-f82d-45e3-a5b6-8f80a3e63cf1
I0222 20:44:07.263741 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:07.263749 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:07.263755 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:07.263764 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:07.263770 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:07 GMT
I0222 20:44:07.263842 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:07.766208 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:07.766235 6226 round_trippers.go:469] Request Headers:
I0222 20:44:07.766247 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:07.766257 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:07.768924 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:07.768942 6226 round_trippers.go:577] Response Headers:
I0222 20:44:07.768954 6226 round_trippers.go:580] Audit-Id: 76b78dcf-1d83-40ee-a846-bdaec0ca930e
I0222 20:44:07.768964 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:07.768977 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:07.768989 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:07.768998 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:07.769005 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:07 GMT
I0222 20:44:07.769175 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:07.769635 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:07.769643 6226 round_trippers.go:469] Request Headers:
I0222 20:44:07.769651 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:07.769658 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:07.771087 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:07.771096 6226 round_trippers.go:577] Response Headers:
I0222 20:44:07.771102 6226 round_trippers.go:580] Audit-Id: 97f8a2b7-0f36-4f34-9bce-4a9caa93ff09
I0222 20:44:07.771118 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:07.771130 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:07.771135 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:07.771143 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:07.771148 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:07 GMT
I0222 20:44:07.771255 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:08.264685 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:08.264708 6226 round_trippers.go:469] Request Headers:
I0222 20:44:08.264721 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:08.264731 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:08.266923 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:08.266939 6226 round_trippers.go:577] Response Headers:
I0222 20:44:08.266950 6226 round_trippers.go:580] Audit-Id: f70f1885-06ef-4345-bde4-3055634c0693
I0222 20:44:08.266961 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:08.266973 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:08.266982 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:08.266994 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:08.267004 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:08 GMT
I0222 20:44:08.267120 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:08.267469 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:08.267478 6226 round_trippers.go:469] Request Headers:
I0222 20:44:08.267486 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:08.267493 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:08.268968 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:08.268978 6226 round_trippers.go:577] Response Headers:
I0222 20:44:08.268991 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:08 GMT
I0222 20:44:08.269001 6226 round_trippers.go:580] Audit-Id: c7f88d5d-8676-434d-afd9-eba4b33756d9
I0222 20:44:08.269013 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:08.269021 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:08.269027 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:08.269031 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:08.269144 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:08.764328 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:08.764357 6226 round_trippers.go:469] Request Headers:
I0222 20:44:08.764369 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:08.764380 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:08.767276 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:08.767292 6226 round_trippers.go:577] Response Headers:
I0222 20:44:08.767300 6226 round_trippers.go:580] Audit-Id: 45c16ec4-fdee-450f-9250-6578d52046c4
I0222 20:44:08.767307 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:08.767314 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:08.767322 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:08.767330 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:08.767338 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:08 GMT
I0222 20:44:08.767501 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:08.767859 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:08.767868 6226 round_trippers.go:469] Request Headers:
I0222 20:44:08.767876 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:08.767895 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:08.769486 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:08.769499 6226 round_trippers.go:577] Response Headers:
I0222 20:44:08.769505 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:08.769510 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:08.769514 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:08.769520 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:08.769525 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:08 GMT
I0222 20:44:08.769531 6226 round_trippers.go:580] Audit-Id: 173c44a0-e1f8-4e55-9e23-155bf8c03223
I0222 20:44:08.769587 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:09.264956 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:09.264982 6226 round_trippers.go:469] Request Headers:
I0222 20:44:09.264994 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:09.265006 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:09.268574 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:09.268589 6226 round_trippers.go:577] Response Headers:
I0222 20:44:09.268597 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:09.268604 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:09.268611 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:09.268642 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:09 GMT
I0222 20:44:09.268655 6226 round_trippers.go:580] Audit-Id: f79dc78a-64f1-46c0-8354-12a6a5d6104c
I0222 20:44:09.268671 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:09.268768 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:09.269122 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:09.269130 6226 round_trippers.go:469] Request Headers:
I0222 20:44:09.269152 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:09.269158 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:09.270767 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:09.270776 6226 round_trippers.go:577] Response Headers:
I0222 20:44:09.270782 6226 round_trippers.go:580] Audit-Id: 6803d20f-9809-4c1c-a975-3f877a9cc05c
I0222 20:44:09.270787 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:09.270791 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:09.270797 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:09.270802 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:09.270807 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:09 GMT
I0222 20:44:09.270950 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:09.271128 6226 pod_ready.go:102] pod "coredns-787d4945fb-b28zh" in "kube-system" namespace has status "Ready":"False"
I0222 20:44:09.765120 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:09.765134 6226 round_trippers.go:469] Request Headers:
I0222 20:44:09.765176 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:09.765182 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:09.767062 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:09.767071 6226 round_trippers.go:577] Response Headers:
I0222 20:44:09.767077 6226 round_trippers.go:580] Audit-Id: 7f127cd6-6b74-4dbf-bd1a-62f93e2d03a2
I0222 20:44:09.767081 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:09.767087 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:09.767091 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:09.767096 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:09.767101 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:09 GMT
I0222 20:44:09.767162 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:09.767421 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:09.767427 6226 round_trippers.go:469] Request Headers:
I0222 20:44:09.767432 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:09.767438 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:09.770551 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:09.770560 6226 round_trippers.go:577] Response Headers:
I0222 20:44:09.770565 6226 round_trippers.go:580] Audit-Id: 0881a2e1-1a36-4846-b9eb-b4e96834f788
I0222 20:44:09.770571 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:09.770576 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:09.770581 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:09.770585 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:09.770590 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:09 GMT
I0222 20:44:09.770687 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:10.264176 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:10.264200 6226 round_trippers.go:469] Request Headers:
I0222 20:44:10.264300 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:10.264312 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:10.266710 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:10.266724 6226 round_trippers.go:577] Response Headers:
I0222 20:44:10.266731 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:10.266739 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:10.266746 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:10.266777 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:10.266809 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:10 GMT
I0222 20:44:10.266825 6226 round_trippers.go:580] Audit-Id: a3f30560-919a-49d2-8a40-7ef0af4ec59c
I0222 20:44:10.266994 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:10.267345 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:10.267354 6226 round_trippers.go:469] Request Headers:
I0222 20:44:10.267362 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:10.267369 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:10.268914 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:10.268923 6226 round_trippers.go:577] Response Headers:
I0222 20:44:10.268928 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:10.268933 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:10.268938 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:10.268944 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:10.268951 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:10 GMT
I0222 20:44:10.268957 6226 round_trippers.go:580] Audit-Id: 968eb4df-0a57-451b-acf1-c77f1b8f1ac0
I0222 20:44:10.269065 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:10.764695 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:10.764724 6226 round_trippers.go:469] Request Headers:
I0222 20:44:10.764805 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:10.764817 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:10.767414 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:10.767431 6226 round_trippers.go:577] Response Headers:
I0222 20:44:10.767442 6226 round_trippers.go:580] Audit-Id: 92858708-515b-4cac-83b1-21e5b9655000
I0222 20:44:10.767452 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:10.767474 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:10.767482 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:10.767489 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:10.767495 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:10 GMT
I0222 20:44:10.767636 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:10.767997 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:10.768006 6226 round_trippers.go:469] Request Headers:
I0222 20:44:10.768014 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:10.768022 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:10.769491 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:10.769502 6226 round_trippers.go:577] Response Headers:
I0222 20:44:10.769508 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:10.769515 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:10.769523 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:10 GMT
I0222 20:44:10.769530 6226 round_trippers.go:580] Audit-Id: 381602ab-7a1a-4d81-88f8-9059bfdd8578
I0222 20:44:10.769539 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:10.769547 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:10.769629 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:11.264411 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:11.264434 6226 round_trippers.go:469] Request Headers:
I0222 20:44:11.264537 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:11.264551 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:11.266988 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:11.267002 6226 round_trippers.go:577] Response Headers:
I0222 20:44:11.267009 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:11.267042 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:11.267071 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:11.267082 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:11.267089 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:11 GMT
I0222 20:44:11.267097 6226 round_trippers.go:580] Audit-Id: 42fd0bdc-db81-4ad5-9ef6-251a235531f0
I0222 20:44:11.267427 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:11.267786 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:11.267794 6226 round_trippers.go:469] Request Headers:
I0222 20:44:11.267803 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:11.267811 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:11.269454 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:11.269461 6226 round_trippers.go:577] Response Headers:
I0222 20:44:11.269466 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:11.269473 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:11.269478 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:11.269483 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:11.269488 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:11 GMT
I0222 20:44:11.269492 6226 round_trippers.go:580] Audit-Id: 3a81ad9c-9b56-4bb9-82ed-6ca17a5709b5
I0222 20:44:11.269775 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:11.764476 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:11.764497 6226 round_trippers.go:469] Request Headers:
I0222 20:44:11.764510 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:11.764519 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:11.767540 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:11.767556 6226 round_trippers.go:577] Response Headers:
I0222 20:44:11.767564 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:11.767570 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:11.767577 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:11.767584 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:11 GMT
I0222 20:44:11.767590 6226 round_trippers.go:580] Audit-Id: c5a0afbd-6315-4a91-9e75-bba531584bc9
I0222 20:44:11.767596 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:11.767949 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:11.768316 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:11.768325 6226 round_trippers.go:469] Request Headers:
I0222 20:44:11.768333 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:11.768349 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:11.771446 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:11.771455 6226 round_trippers.go:577] Response Headers:
I0222 20:44:11.771461 6226 round_trippers.go:580] Audit-Id: 553a0b0b-9005-404b-8626-01408227ceb0
I0222 20:44:11.771466 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:11.771470 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:11.771475 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:11.771480 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:11.771484 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:11 GMT
I0222 20:44:11.771653 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:11.771829 6226 pod_ready.go:102] pod "coredns-787d4945fb-b28zh" in "kube-system" namespace has status "Ready":"False"
I0222 20:44:12.265324 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:12.265348 6226 round_trippers.go:469] Request Headers:
I0222 20:44:12.265360 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:12.265371 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:12.268188 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:12.268203 6226 round_trippers.go:577] Response Headers:
I0222 20:44:12.268210 6226 round_trippers.go:580] Audit-Id: 2eb6425a-5879-4634-bafb-46dd6700d2c7
I0222 20:44:12.268217 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:12.268224 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:12.268230 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:12.268238 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:12.268244 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:12 GMT
I0222 20:44:12.268330 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:12.268758 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:12.268766 6226 round_trippers.go:469] Request Headers:
I0222 20:44:12.268774 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:12.268781 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:12.271150 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:12.271166 6226 round_trippers.go:577] Response Headers:
I0222 20:44:12.271178 6226 round_trippers.go:580] Audit-Id: 3cb95f99-63b2-471e-ae9a-4f78e5813dcd
I0222 20:44:12.271188 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:12.271199 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:12.271208 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:12.271234 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:12.271246 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:12 GMT
I0222 20:44:12.271411 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:12.764175 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:12.764198 6226 round_trippers.go:469] Request Headers:
I0222 20:44:12.764211 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:12.764221 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:12.766648 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:12.766664 6226 round_trippers.go:577] Response Headers:
I0222 20:44:12.766675 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:12.766685 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:12 GMT
I0222 20:44:12.766695 6226 round_trippers.go:580] Audit-Id: ec257de5-c379-4eb4-8e15-37633011502b
I0222 20:44:12.766705 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:12.766714 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:12.766722 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:12.766794 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:12.767158 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:12.767167 6226 round_trippers.go:469] Request Headers:
I0222 20:44:12.767175 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:12.767182 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:12.768700 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:12.768709 6226 round_trippers.go:577] Response Headers:
I0222 20:44:12.768715 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:12.768719 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:12.768725 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:12 GMT
I0222 20:44:12.768730 6226 round_trippers.go:580] Audit-Id: 8e078d1b-c908-413e-ba11-1ace517fbedc
I0222 20:44:12.768734 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:12.768740 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:12.768803 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:13.266145 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:13.266170 6226 round_trippers.go:469] Request Headers:
I0222 20:44:13.266182 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:13.266192 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:13.269376 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:13.269391 6226 round_trippers.go:577] Response Headers:
I0222 20:44:13.269398 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:13 GMT
I0222 20:44:13.269405 6226 round_trippers.go:580] Audit-Id: 11e94372-8c17-4579-8221-d8d63463eec5
I0222 20:44:13.269412 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:13.269419 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:13.269426 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:13.269433 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:13.269500 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:13.269858 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:13.269866 6226 round_trippers.go:469] Request Headers:
I0222 20:44:13.269875 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:13.269882 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:13.271191 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:13.271203 6226 round_trippers.go:577] Response Headers:
I0222 20:44:13.271211 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:13.271219 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:13.271225 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:13 GMT
I0222 20:44:13.271230 6226 round_trippers.go:580] Audit-Id: f3772cfa-f6ed-48c9-9ddd-eb9dc2257df2
I0222 20:44:13.271236 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:13.271240 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:13.271308 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:13.764385 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:13.764407 6226 round_trippers.go:469] Request Headers:
I0222 20:44:13.764420 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:13.764430 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:13.767152 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:13.767169 6226 round_trippers.go:577] Response Headers:
I0222 20:44:13.767178 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:13.767187 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:13.767196 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:13.767203 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:13 GMT
I0222 20:44:13.767210 6226 round_trippers.go:580] Audit-Id: 28e49018-d28d-4d44-8d6d-4af083881ee0
I0222 20:44:13.767217 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:13.767601 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:13.767961 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:13.767970 6226 round_trippers.go:469] Request Headers:
I0222 20:44:13.767978 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:13.767985 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:13.769424 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:13.769434 6226 round_trippers.go:577] Response Headers:
I0222 20:44:13.769440 6226 round_trippers.go:580] Audit-Id: 9e913e33-df68-419a-ac00-4efa0c62a77f
I0222 20:44:13.769445 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:13.769450 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:13.769455 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:13.769460 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:13.769464 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:13 GMT
I0222 20:44:13.769517 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:14.264681 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:14.264700 6226 round_trippers.go:469] Request Headers:
I0222 20:44:14.264715 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:14.264725 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:14.267075 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:14.267094 6226 round_trippers.go:577] Response Headers:
I0222 20:44:14.267103 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:14.267110 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:14.267116 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:14.267123 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:14.267130 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:14 GMT
I0222 20:44:14.267137 6226 round_trippers.go:580] Audit-Id: db00c5fd-e5a3-44ba-a113-0ef248f5122d
I0222 20:44:14.267339 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:14.267703 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:14.267712 6226 round_trippers.go:469] Request Headers:
I0222 20:44:14.267720 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:14.267727 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:14.269022 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:14.269032 6226 round_trippers.go:577] Response Headers:
I0222 20:44:14.269040 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:14.269048 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:14 GMT
I0222 20:44:14.269057 6226 round_trippers.go:580] Audit-Id: f7eb2128-53f5-4377-8814-5d029916abf0
I0222 20:44:14.269065 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:14.269070 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:14.269080 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:14.269217 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:14.269384 6226 pod_ready.go:102] pod "coredns-787d4945fb-b28zh" in "kube-system" namespace has status "Ready":"False"
I0222 20:44:14.764353 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:14.764366 6226 round_trippers.go:469] Request Headers:
I0222 20:44:14.764373 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:14.764379 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:14.766054 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:14.766065 6226 round_trippers.go:577] Response Headers:
I0222 20:44:14.766072 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:14.766078 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:14.766086 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:14 GMT
I0222 20:44:14.766093 6226 round_trippers.go:580] Audit-Id: 12fab6d5-cdfa-4771-a0dc-6fac4c1ba565
I0222 20:44:14.766100 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:14.766104 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:14.766173 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:14.766448 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:14.766454 6226 round_trippers.go:469] Request Headers:
I0222 20:44:14.766460 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:14.766466 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:14.767709 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:14.767719 6226 round_trippers.go:577] Response Headers:
I0222 20:44:14.767724 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:14.767729 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:14.767734 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:14 GMT
I0222 20:44:14.767739 6226 round_trippers.go:580] Audit-Id: 25d70386-7bda-40fd-9ef8-2b74cc7b4444
I0222 20:44:14.767744 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:14.767749 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:14.767839 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:15.264047 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:15.264059 6226 round_trippers.go:469] Request Headers:
I0222 20:44:15.264065 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:15.264071 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:15.265873 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:15.265894 6226 round_trippers.go:577] Response Headers:
I0222 20:44:15.265901 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:15.265906 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:15.265911 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:15.265917 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:15 GMT
I0222 20:44:15.265921 6226 round_trippers.go:580] Audit-Id: b94f7e19-33df-4fe0-a7da-6b9b44df1051
I0222 20:44:15.265926 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:15.266110 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:15.266396 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:15.266402 6226 round_trippers.go:469] Request Headers:
I0222 20:44:15.266408 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:15.266414 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:15.269196 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:15.269205 6226 round_trippers.go:577] Response Headers:
I0222 20:44:15.269210 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:15.269214 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:15.269222 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:15.269229 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:15.269236 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:15 GMT
I0222 20:44:15.269243 6226 round_trippers.go:580] Audit-Id: fdccf124-fa4b-4f0a-937c-c8b645a44e8e
I0222 20:44:15.269344 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:15.765235 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:15.765252 6226 round_trippers.go:469] Request Headers:
I0222 20:44:15.765259 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:15.765264 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:15.766930 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:15.766941 6226 round_trippers.go:577] Response Headers:
I0222 20:44:15.766947 6226 round_trippers.go:580] Audit-Id: ad3f7a2d-6d0e-432e-b099-e1df465a3502
I0222 20:44:15.766952 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:15.766957 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:15.766962 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:15.766967 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:15.766972 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:15 GMT
I0222 20:44:15.767056 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:15.767351 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:15.767357 6226 round_trippers.go:469] Request Headers:
I0222 20:44:15.767363 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:15.767368 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:15.768661 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:15.768670 6226 round_trippers.go:577] Response Headers:
I0222 20:44:15.768676 6226 round_trippers.go:580] Audit-Id: 200500b1-0f4e-4320-864e-9e2ab6d58706
I0222 20:44:15.768701 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:15.768719 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:15.768736 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:15.768753 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:15.768764 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:15 GMT
I0222 20:44:15.768854 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:16.264448 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:16.264462 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.264471 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.264481 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.266882 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:16.266893 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.266899 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.266904 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.266909 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.266914 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.266919 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.266924 6226 round_trippers.go:580] Audit-Id: 9aff5b85-3114-4ccd-85bd-9df2db11e2d1
I0222 20:44:16.267060 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"820","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6488 chars]
I0222 20:44:16.267326 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:16.267332 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.267338 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.267344 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.268432 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.268441 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.268449 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.268457 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.268463 6226 round_trippers.go:580] Audit-Id: 789b09fc-a902-4265-b8bb-4eb8a4ee2cec
I0222 20:44:16.268471 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.268479 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.268486 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.268602 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:16.268777 6226 pod_ready.go:92] pod "coredns-787d4945fb-b28zh" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:16.268787 6226 pod_ready.go:81] duration metric: took 9.007901592s waiting for pod "coredns-787d4945fb-b28zh" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.268794 6226 pod_ready.go:78] waiting up to 6m0s for pod "etcd-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.268818 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/etcd-multinode-293000
I0222 20:44:16.268822 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.268828 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.268834 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.270061 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.270069 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.270074 6226 round_trippers.go:580] Audit-Id: 00a18d5f-570c-40d5-8f3d-738dc1fc7e24
I0222 20:44:16.270079 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.270085 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.270091 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.270097 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.270101 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.270276 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"etcd-multinode-293000","namespace":"kube-system","uid":"2363a307-e6f7-4025-ae02-4920adde4561","resourceVersion":"793","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.64.12:2379","kubernetes.io/config.hash":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.mirror":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.seen":"2023-02-23T04:40:26.073140598Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-c
lient-urls":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config [truncated 6055 chars]
I0222 20:44:16.270475 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:16.270481 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.270487 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.270492 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.271618 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.271629 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.271638 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.271646 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.271653 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.271661 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.271670 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.271674 6226 round_trippers.go:580] Audit-Id: 07cb834d-60ce-465b-a06e-86da6a177ebb
I0222 20:44:16.271763 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:16.271930 6226 pod_ready.go:92] pod "etcd-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:16.271936 6226 pod_ready.go:81] duration metric: took 3.13713ms waiting for pod "etcd-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.271945 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.271970 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-multinode-293000
I0222 20:44:16.271973 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.271979 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.271986 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.273216 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.273225 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.273231 6226 round_trippers.go:580] Audit-Id: 9286c743-fe6c-4a61-8602-18a3a8831b50
I0222 20:44:16.273250 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.273261 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.273275 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.273286 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.273297 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.273365 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-apiserver-multinode-293000","namespace":"kube-system","uid":"bb2fc1a3-12c1-4854-8f8c-3c1c5664067c","resourceVersion":"748","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-apiserver","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.64.12:8443","kubernetes.io/config.hash":"578ff397a5454283a55e183c76494192","kubernetes.io/config.mirror":"578ff397a5454283a55e183c76494192","kubernetes.io/config.seen":"2023-02-23T04:40:26.073157361Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kub
ernetes.io/kube-apiserver.advertise-address.endpoint":{},"f:kubernetes. [truncated 7590 chars]
I0222 20:44:16.273583 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:16.273589 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.273595 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.273601 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.274859 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.274869 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.274875 6226 round_trippers.go:580] Audit-Id: 29b9a3ee-8f69-43bb-ac15-9b00159b8a92
I0222 20:44:16.274880 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.274885 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.274889 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.274894 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.274900 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.274955 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:16.275121 6226 pod_ready.go:92] pod "kube-apiserver-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:16.275128 6226 pod_ready.go:81] duration metric: took 3.176067ms waiting for pod "kube-apiserver-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.275133 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.275158 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-multinode-293000
I0222 20:44:16.275163 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.275168 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.275174 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.276689 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.276697 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.276703 6226 round_trippers.go:580] Audit-Id: 7aacf995-a637-4a9c-ab11-b9ba5705cba4
I0222 20:44:16.276709 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.276714 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.276719 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.276724 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.276729 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.276789 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-controller-manager-multinode-293000","namespace":"kube-system","uid":"e60be5dc-4ed1-4a87-b03c-2ac01b03001d","resourceVersion":"742","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-controller-manager","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"02b271251b67ef9dd552c569d01153ca","kubernetes.io/config.mirror":"02b271251b67ef9dd552c569d01153ca","kubernetes.io/config.seen":"2023-02-23T04:40:26.073158360Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.i
o/config.seen":{},"f:kubernetes.io/config.source":{}},"f:labels":{".":{ [truncated 7158 chars]
I0222 20:44:16.277000 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:16.277006 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.277011 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.277018 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.278138 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.278146 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.278152 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.278169 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.278176 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.278183 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.278190 6226 round_trippers.go:580] Audit-Id: 6b3b9bca-35a6-4dac-9663-e52d847924bc
I0222 20:44:16.278197 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.278315 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:16.278490 6226 pod_ready.go:92] pod "kube-controller-manager-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:16.278496 6226 pod_ready.go:81] duration metric: took 3.357195ms waiting for pod "kube-controller-manager-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.278501 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-bj985" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.278526 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bj985
I0222 20:44:16.278530 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.278536 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.278541 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.279713 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.279725 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.279734 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.279743 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.279749 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.279754 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.279759 6226 round_trippers.go:580] Audit-Id: cc3e2a6e-0607-4c81-bdfb-dac4d8d3254e
I0222 20:44:16.279764 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.280023 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-bj985","generateName":"kube-proxy-","namespace":"kube-system","uid":"36f7816d-0b3e-4210-be32-907bf62dfa61","resourceVersion":"687","creationTimestamp":"2023-02-23T04:42:15Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:42:15Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5746 chars]
I0222 20:44:16.280234 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m03
I0222 20:44:16.280239 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.280245 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.280251 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.281261 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.281270 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.281276 6226 round_trippers.go:580] Audit-Id: 0cc60e92-b744-4e06-b505-28009a1cb41a
I0222 20:44:16.281285 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.281290 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.281295 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.281301 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.281305 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.281449 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m03","uid":"181ccd63-a7fc-412c-bfee-446a1e65f4b4","resourceVersion":"778","creationTimestamp":"2023-02-23T04:42:56Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m03","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:42:56Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{
}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 4329 chars]
I0222 20:44:16.281596 6226 pod_ready.go:92] pod "kube-proxy-bj985" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:16.281602 6226 pod_ready.go:81] duration metric: took 3.096381ms waiting for pod "kube-proxy-bj985" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.281607 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-pxq2s" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.465001 6226 request.go:622] Waited for 183.361238ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pxq2s
I0222 20:44:16.465048 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pxq2s
I0222 20:44:16.465061 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.465160 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.465178 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.468885 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:16.468908 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.468920 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.468931 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.468942 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.468949 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.468956 6226 round_trippers.go:580] Audit-Id: 6508f5b4-46ab-4b16-b8ea-c874adb655e1
I0222 20:44:16.468963 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.469300 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-pxq2s","generateName":"kube-proxy-","namespace":"kube-system","uid":"0ce24b37-1ce7-4772-b40d-5f88f10aaa4b","resourceVersion":"720","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5738 chars]
I0222 20:44:16.666094 6226 request.go:622] Waited for 196.314811ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:16.666143 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:16.666152 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.666164 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.666177 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.669323 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:16.669338 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.669346 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.669358 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.669365 6226 round_trippers.go:580] Audit-Id: bcdfa0f0-1c74-49f0-aaa5-702c6c9ced53
I0222 20:44:16.669372 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.669378 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.669386 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.669711 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:16.669963 6226 pod_ready.go:92] pod "kube-proxy-pxq2s" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:16.669971 6226 pod_ready.go:81] duration metric: took 388.366863ms waiting for pod "kube-proxy-pxq2s" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.669979 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-qmsbf" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.864558 6226 request.go:622] Waited for 194.458236ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qmsbf
I0222 20:44:16.864611 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qmsbf
I0222 20:44:16.864621 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.864633 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.864648 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.867216 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:16.867232 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.867240 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.867247 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.867258 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.867267 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.867274 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.867282 6226 round_trippers.go:580] Audit-Id: a5698c87-87ce-4609-9e12-d4dfc265ae78
I0222 20:44:16.867645 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-qmsbf","generateName":"kube-proxy-","namespace":"kube-system","uid":"98395ed9-2055-48e0-8d84-b931dfc0d9c7","resourceVersion":"486","creationTimestamp":"2023-02-23T04:41:26Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:41:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5541 chars]
I0222 20:44:17.064975 6226 request.go:622] Waited for 197.015626ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:44:17.065068 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:44:17.065075 6226 round_trippers.go:469] Request Headers:
I0222 20:44:17.065083 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:17.065093 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:17.067331 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:17.067344 6226 round_trippers.go:577] Response Headers:
I0222 20:44:17.067350 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:17 GMT
I0222 20:44:17.067355 6226 round_trippers.go:580] Audit-Id: 9c308762-72a2-41b1-9b17-e2380e2468a4
I0222 20:44:17.067360 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:17.067365 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:17.067371 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:17.067375 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:17.067469 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"f968bf76-422f-4a90-ba94-df00a7b8efaa","resourceVersion":"592","creationTimestamp":"2023-02-23T04:41:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:41:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:41:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.ku
bernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f [truncated 4512 chars]
I0222 20:44:17.067643 6226 pod_ready.go:92] pod "kube-proxy-qmsbf" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:17.067649 6226 pod_ready.go:81] duration metric: took 397.67161ms waiting for pod "kube-proxy-qmsbf" in "kube-system" namespace to be "Ready" ...
I0222 20:44:17.067655 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:17.265411 6226 request.go:622] Waited for 197.701959ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-293000
I0222 20:44:17.265497 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-293000
I0222 20:44:17.265502 6226 round_trippers.go:469] Request Headers:
I0222 20:44:17.265508 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:17.265513 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:17.267192 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:17.267203 6226 round_trippers.go:577] Response Headers:
I0222 20:44:17.267211 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:17 GMT
I0222 20:44:17.267218 6226 round_trippers.go:580] Audit-Id: cc5b70b7-a43d-48f8-a370-b6560f684dbf
I0222 20:44:17.267227 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:17.267234 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:17.267239 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:17.267245 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:17.267305 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-scheduler-multinode-293000","namespace":"kube-system","uid":"deb74301-35df-47d1-a8a9-f59943186666","resourceVersion":"772","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-scheduler","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"ef6d7c628504525048f2a505fc91f554","kubernetes.io/config.mirror":"ef6d7c628504525048f2a505fc91f554","kubernetes.io/config.seen":"2023-02-23T04:40:26.073159188Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.io/config.seen":{},
"f:kubernetes.io/config.source":{}},"f:labels":{".":{},"f:component":{} [truncated 4888 chars]
I0222 20:44:17.464729 6226 request.go:622] Waited for 197.064672ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:17.464776 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:17.464784 6226 round_trippers.go:469] Request Headers:
I0222 20:44:17.464795 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:17.464806 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:17.467524 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:17.467539 6226 round_trippers.go:577] Response Headers:
I0222 20:44:17.467548 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:17 GMT
I0222 20:44:17.467554 6226 round_trippers.go:580] Audit-Id: 004c21fc-0837-4add-9738-fc3388fc99ad
I0222 20:44:17.467561 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:17.467568 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:17.467575 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:17.467583 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:17.467727 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:17.467977 6226 pod_ready.go:92] pod "kube-scheduler-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:17.467985 6226 pod_ready.go:81] duration metric: took 400.33221ms waiting for pod "kube-scheduler-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:17.467994 6226 pod_ready.go:38] duration metric: took 10.213039891s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0222 20:44:17.468006 6226 api_server.go:51] waiting for apiserver process to appear ...
I0222 20:44:17.468069 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0222 20:44:17.477987 6226 command_runner.go:130] > 1661
I0222 20:44:17.478089 6226 api_server.go:71] duration metric: took 14.318811842s to wait for apiserver process to appear ...
I0222 20:44:17.478099 6226 api_server.go:87] waiting for apiserver healthz status ...
I0222 20:44:17.478106 6226 api_server.go:252] Checking apiserver healthz at https://192.168.64.12:8443/healthz ...
I0222 20:44:17.482844 6226 api_server.go:278] https://192.168.64.12:8443/healthz returned 200:
ok
I0222 20:44:17.482871 6226 round_trippers.go:463] GET https://192.168.64.12:8443/version
I0222 20:44:17.482878 6226 round_trippers.go:469] Request Headers:
I0222 20:44:17.482884 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:17.482890 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:17.483402 6226 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds
I0222 20:44:17.483413 6226 round_trippers.go:577] Response Headers:
I0222 20:44:17.483419 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:17 GMT
I0222 20:44:17.483425 6226 round_trippers.go:580] Audit-Id: ef2f8f70-b6f7-498f-a2be-d59c6fa0bfe1
I0222 20:44:17.483430 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:17.483436 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:17.483440 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:17.483446 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:17.483450 6226 round_trippers.go:580] Content-Length: 263
I0222 20:44:17.483461 6226 request.go:1171] Response Body: {
"major": "1",
"minor": "26",
"gitVersion": "v1.26.1",
"gitCommit": "8f94681cd294aa8cfd3407b8191f6c70214973a4",
"gitTreeState": "clean",
"buildDate": "2023-01-18T15:51:25Z",
"goVersion": "go1.19.5",
"compiler": "gc",
"platform": "linux/amd64"
}
I0222 20:44:17.483484 6226 api_server.go:140] control plane version: v1.26.1
I0222 20:44:17.483490 6226 api_server.go:130] duration metric: took 5.387882ms to wait for apiserver health ...
I0222 20:44:17.483494 6226 system_pods.go:43] waiting for kube-system pods to appear ...
I0222 20:44:17.665991 6226 request.go:622] Waited for 182.44557ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:44:17.666094 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:44:17.666186 6226 round_trippers.go:469] Request Headers:
I0222 20:44:17.666199 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:17.666210 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:17.670524 6226 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0222 20:44:17.670539 6226 round_trippers.go:577] Response Headers:
I0222 20:44:17.670548 6226 round_trippers.go:580] Audit-Id: 3e1987d2-6012-4d63-9868-1e1c22301cd5
I0222 20:44:17.670560 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:17.670574 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:17.670582 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:17.670591 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:17.670602 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:17 GMT
I0222 20:44:17.671600 6226 request.go:1171] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"835"},"items":[{"metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"820","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f
:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 82825 chars]
I0222 20:44:17.673381 6226 system_pods.go:59] 12 kube-system pods found
I0222 20:44:17.673392 6226 system_pods.go:61] "coredns-787d4945fb-b28zh" [307635d3-a26b-4eff-be8a-9d65e1f996c3] Running
I0222 20:44:17.673396 6226 system_pods.go:61] "etcd-multinode-293000" [2363a307-e6f7-4025-ae02-4920adde4561] Running
I0222 20:44:17.673400 6226 system_pods.go:61] "kindnet-bzxtr" [b3092ad6-e39a-43f2-8a95-ead97184aa40] Running
I0222 20:44:17.673403 6226 system_pods.go:61] "kindnet-nm7kn" [061817b8-aa21-408e-b432-53850cf8eb6d] Running
I0222 20:44:17.673407 6226 system_pods.go:61] "kindnet-rrx46" [df2ad52c-df28-46f4-b739-812ad756ed0e] Running
I0222 20:44:17.673411 6226 system_pods.go:61] "kube-apiserver-multinode-293000" [bb2fc1a3-12c1-4854-8f8c-3c1c5664067c] Running
I0222 20:44:17.673415 6226 system_pods.go:61] "kube-controller-manager-multinode-293000" [e60be5dc-4ed1-4a87-b03c-2ac01b03001d] Running
I0222 20:44:17.673419 6226 system_pods.go:61] "kube-proxy-bj985" [36f7816d-0b3e-4210-be32-907bf62dfa61] Running
I0222 20:44:17.673423 6226 system_pods.go:61] "kube-proxy-pxq2s" [0ce24b37-1ce7-4772-b40d-5f88f10aaa4b] Running
I0222 20:44:17.673426 6226 system_pods.go:61] "kube-proxy-qmsbf" [98395ed9-2055-48e0-8d84-b931dfc0d9c7] Running
I0222 20:44:17.673431 6226 system_pods.go:61] "kube-scheduler-multinode-293000" [deb74301-35df-47d1-a8a9-f59943186666] Running
I0222 20:44:17.673435 6226 system_pods.go:61] "storage-provisioner" [2e7410db-637a-4d25-9f92-f5e551a32c8d] Running
I0222 20:44:17.673439 6226 system_pods.go:74] duration metric: took 189.94454ms to wait for pod list to return data ...
I0222 20:44:17.673444 6226 default_sa.go:34] waiting for default service account to be created ...
I0222 20:44:17.866499 6226 request.go:622] Waited for 192.919272ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/default/serviceaccounts
I0222 20:44:17.866546 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/default/serviceaccounts
I0222 20:44:17.866555 6226 round_trippers.go:469] Request Headers:
I0222 20:44:17.866568 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:17.866580 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:17.869520 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:17.869535 6226 round_trippers.go:577] Response Headers:
I0222 20:44:17.869544 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:17.869550 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:17.869557 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:17.869563 6226 round_trippers.go:580] Content-Length: 261
I0222 20:44:17.869571 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:17 GMT
I0222 20:44:17.869578 6226 round_trippers.go:580] Audit-Id: e0a0acca-af45-4711-adc6-98f94ed5914a
I0222 20:44:17.869585 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:17.869599 6226 request.go:1171] Response Body: {"kind":"ServiceAccountList","apiVersion":"v1","metadata":{"resourceVersion":"836"},"items":[{"metadata":{"name":"default","namespace":"default","uid":"71d0bf82-edd0-4f65-8a8a-5f4b6f0937d3","resourceVersion":"306","creationTimestamp":"2023-02-23T04:40:39Z"}}]}
I0222 20:44:17.869724 6226 default_sa.go:45] found service account: "default"
I0222 20:44:17.869732 6226 default_sa.go:55] duration metric: took 196.287277ms for default service account to be created ...
I0222 20:44:17.869738 6226 system_pods.go:116] waiting for k8s-apps to be running ...
I0222 20:44:18.065114 6226 request.go:622] Waited for 195.323511ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:44:18.065289 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:44:18.065300 6226 round_trippers.go:469] Request Headers:
I0222 20:44:18.065313 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:18.065324 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:18.069574 6226 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0222 20:44:18.069596 6226 round_trippers.go:577] Response Headers:
I0222 20:44:18.069609 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:18 GMT
I0222 20:44:18.069620 6226 round_trippers.go:580] Audit-Id: ca355e49-0cad-4659-80b7-9b110475e53b
I0222 20:44:18.069630 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:18.069655 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:18.069691 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:18.069703 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:18.070211 6226 request.go:1171] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"837"},"items":[{"metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"820","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f
:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 82825 chars]
I0222 20:44:18.072135 6226 system_pods.go:86] 12 kube-system pods found
I0222 20:44:18.072144 6226 system_pods.go:89] "coredns-787d4945fb-b28zh" [307635d3-a26b-4eff-be8a-9d65e1f996c3] Running
I0222 20:44:18.072148 6226 system_pods.go:89] "etcd-multinode-293000" [2363a307-e6f7-4025-ae02-4920adde4561] Running
I0222 20:44:18.072159 6226 system_pods.go:89] "kindnet-bzxtr" [b3092ad6-e39a-43f2-8a95-ead97184aa40] Running
I0222 20:44:18.072162 6226 system_pods.go:89] "kindnet-nm7kn" [061817b8-aa21-408e-b432-53850cf8eb6d] Running
I0222 20:44:18.072167 6226 system_pods.go:89] "kindnet-rrx46" [df2ad52c-df28-46f4-b739-812ad756ed0e] Running
I0222 20:44:18.072170 6226 system_pods.go:89] "kube-apiserver-multinode-293000" [bb2fc1a3-12c1-4854-8f8c-3c1c5664067c] Running
I0222 20:44:18.072174 6226 system_pods.go:89] "kube-controller-manager-multinode-293000" [e60be5dc-4ed1-4a87-b03c-2ac01b03001d] Running
I0222 20:44:18.072178 6226 system_pods.go:89] "kube-proxy-bj985" [36f7816d-0b3e-4210-be32-907bf62dfa61] Running
I0222 20:44:18.072182 6226 system_pods.go:89] "kube-proxy-pxq2s" [0ce24b37-1ce7-4772-b40d-5f88f10aaa4b] Running
I0222 20:44:18.072185 6226 system_pods.go:89] "kube-proxy-qmsbf" [98395ed9-2055-48e0-8d84-b931dfc0d9c7] Running
I0222 20:44:18.072189 6226 system_pods.go:89] "kube-scheduler-multinode-293000" [deb74301-35df-47d1-a8a9-f59943186666] Running
I0222 20:44:18.072193 6226 system_pods.go:89] "storage-provisioner" [2e7410db-637a-4d25-9f92-f5e551a32c8d] Running
I0222 20:44:18.072197 6226 system_pods.go:126] duration metric: took 202.458774ms to wait for k8s-apps to be running ...
I0222 20:44:18.072205 6226 system_svc.go:44] waiting for kubelet service to be running ....
I0222 20:44:18.072284 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0222 20:44:18.081691 6226 system_svc.go:56] duration metric: took 9.468944ms WaitForService to wait for kubelet.
I0222 20:44:18.081722 6226 kubeadm.go:578] duration metric: took 14.922456497s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
I0222 20:44:18.081734 6226 node_conditions.go:102] verifying NodePressure condition ...
I0222 20:44:18.264949 6226 request.go:622] Waited for 183.145764ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes
I0222 20:44:18.265042 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes
I0222 20:44:18.265053 6226 round_trippers.go:469] Request Headers:
I0222 20:44:18.265144 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:18.265157 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:18.268325 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:18.268341 6226 round_trippers.go:577] Response Headers:
I0222 20:44:18.268349 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:18 GMT
I0222 20:44:18.268363 6226 round_trippers.go:580] Audit-Id: a4ce575e-6173-4624-bdc5-1069842928a1
I0222 20:44:18.268371 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:18.268378 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:18.268385 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:18.268393 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:18.268553 6226 request.go:1171] Response Body: {"kind":"NodeList","apiVersion":"v1","metadata":{"resourceVersion":"837"},"items":[{"metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFiel
ds":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time" [truncated 16207 chars]
I0222 20:44:18.269085 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:44:18.269098 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:44:18.269107 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:44:18.269112 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:44:18.269116 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:44:18.269120 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:44:18.269124 6226 node_conditions.go:105] duration metric: took 187.390549ms to run NodePressure ...
I0222 20:44:18.269133 6226 start.go:228] waiting for startup goroutines ...
I0222 20:44:18.269141 6226 start.go:233] waiting for cluster config update ...
I0222 20:44:18.269148 6226 start.go:242] writing updated cluster config ...
I0222 20:44:18.269899 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:44:18.269957 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:44:18.292139 6226 out.go:177] * Starting worker node multinode-293000-m02 in cluster multinode-293000
I0222 20:44:18.313718 6226 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0222 20:44:18.313795 6226 cache.go:57] Caching tarball of preloaded images
I0222 20:44:18.313962 6226 preload.go:174] Found /Users/jenkins/minikube-integration/15909-2565/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0222 20:44:18.313981 6226 cache.go:60] Finished verifying existence of preloaded tar for v1.26.1 on docker
I0222 20:44:18.314108 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:44:18.315140 6226 cache.go:193] Successfully downloaded all kic artifacts
I0222 20:44:18.315171 6226 start.go:364] acquiring machines lock for multinode-293000-m02: {Name:mk88cf87535f73dae2b0686647d170168e328899 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0222 20:44:18.315260 6226 start.go:368] acquired machines lock for "multinode-293000-m02" in 71.209µs
I0222 20:44:18.315291 6226 start.go:96] Skipping create...Using existing machine configuration
I0222 20:44:18.315297 6226 fix.go:55] fixHost starting: m02
I0222 20:44:18.315701 6226 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0222 20:44:18.315727 6226 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0222 20:44:18.323356 6226 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51529
I0222 20:44:18.323693 6226 main.go:141] libmachine: () Calling .GetVersion
I0222 20:44:18.324020 6226 main.go:141] libmachine: Using API Version 1
I0222 20:44:18.324032 6226 main.go:141] libmachine: () Calling .SetConfigRaw
I0222 20:44:18.324229 6226 main.go:141] libmachine: () Calling .GetMachineName
I0222 20:44:18.324349 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:18.324438 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetState
I0222 20:44:18.324542 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:44:18.324612 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | hyperkit pid from json: 5763
I0222 20:44:18.325448 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | hyperkit pid 5763 missing from process table
I0222 20:44:18.325488 6226 fix.go:103] recreateIfNeeded on multinode-293000-m02: state=Stopped err=<nil>
I0222 20:44:18.325498 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
W0222 20:44:18.325584 6226 fix.go:129] unexpected machine state, will restart: <nil>
I0222 20:44:18.347007 6226 out.go:177] * Restarting existing hyperkit VM for "multinode-293000-m02" ...
I0222 20:44:18.368943 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .Start
I0222 20:44:18.369239 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:44:18.369278 6226 main.go:141] libmachine: (multinode-293000-m02) minikube might have been shutdown in an unclean way, the hyperkit pid file still exists: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/hyperkit.pid
I0222 20:44:18.370884 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | hyperkit pid 5763 missing from process table
I0222 20:44:18.370904 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | pid 5763 is in state "Stopped"
I0222 20:44:18.370995 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Removing stale pid file /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/hyperkit.pid...
I0222 20:44:18.371117 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Using UUID 3f0c1c76-b334-11ed-affa-149d997fca88
I0222 20:44:18.398443 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Generated MAC f6:5a:53:47:16:21
I0222 20:44:18.398464 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000
I0222 20:44:18.398601 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"3f0c1c76-b334-11ed-affa-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0003d4030)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/bzimage", Initrd:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""
, process:(*os.Process)(nil)}
I0222 20:44:18.398643 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"3f0c1c76-b334-11ed-affa-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0003d4030)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/bzimage", Initrd:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""
, process:(*os.Process)(nil)}
I0222 20:44:18.398754 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "3f0c1c76-b334-11ed-affa-149d997fca88", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/multinode-293000-m02.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/tty,log=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/bzimage,/Users/j
enkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000"}
I0222 20:44:18.398803 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U 3f0c1c76-b334-11ed-affa-149d997fca88 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/multinode-293000-m02.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/tty,log=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/console-ring -f kexec,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/bzimage,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/mult
inode-293000-m02/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000"
I0222 20:44:18.398818 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 DEBUG: hyperkit: Redirecting stdout/stderr to logger
I0222 20:44:18.399962 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 DEBUG: hyperkit: Pid is 6299
I0222 20:44:18.400427 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Attempt 0
I0222 20:44:18.400440 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:44:18.400543 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | hyperkit pid from json: 6299
I0222 20:44:18.402158 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Searching for f6:5a:53:47:16:21 in /var/db/dhcpd_leases ...
I0222 20:44:18.402215 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Found 13 entries in /var/db/dhcpd_leases!
I0222 20:44:18.402229 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.12 HWAddress:8e:8:26:1e:84:48 ID:1,8e:8:26:1e:84:48 Lease:0x63f84076}
I0222 20:44:18.402252 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.14 HWAddress:66:3a:f:a5:79:1d ID:1,66:3a:f:a5:79:1d Lease:0x63f6eeed}
I0222 20:44:18.402271 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.13 HWAddress:f6:5a:53:47:16:21 ID:1,f6:5a:53:47:16:21 Lease:0x63f83fd9}
I0222 20:44:18.402284 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Found match: f6:5a:53:47:16:21
I0222 20:44:18.402297 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | IP: 192.168.64.13
I0222 20:44:18.402329 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetConfigRaw
I0222 20:44:18.402954 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetIP
I0222 20:44:18.403138 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:44:18.403429 6226 machine.go:88] provisioning docker machine ...
I0222 20:44:18.403439 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:18.403544 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetMachineName
I0222 20:44:18.403632 6226 buildroot.go:166] provisioning hostname "multinode-293000-m02"
I0222 20:44:18.403642 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetMachineName
I0222 20:44:18.403721 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:18.403810 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:18.403888 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:18.403971 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:18.404051 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:18.404165 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:44:18.404483 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.13 22 <nil> <nil>}
I0222 20:44:18.404492 6226 main.go:141] libmachine: About to run SSH command:
sudo hostname multinode-293000-m02 && echo "multinode-293000-m02" | sudo tee /etc/hostname
I0222 20:44:18.406984 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: Using fd 5 for I/O notifications
I0222 20:44:18.415205 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD
I0222 20:44:18.415897 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I0222 20:44:18.415908 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I0222 20:44:18.415916 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I0222 20:44:18.415923 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I0222 20:44:18.772792 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0
I0222 20:44:18.772807 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0
I0222 20:44:18.876799 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I0222 20:44:18.876820 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I0222 20:44:18.876832 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I0222 20:44:18.876843 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I0222 20:44:18.877726 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1
I0222 20:44:18.877739 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1
I0222 20:44:23.406461 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:23 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1
I0222 20:44:23.406541 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:23 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1
I0222 20:44:23.406553 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:23 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1
I0222 20:44:53.477402 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-293000-m02
I0222 20:44:53.477418 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:53.477563 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:53.477664 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.477758 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.477849 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:53.477977 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:44:53.478294 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.13 22 <nil> <nil>}
I0222 20:44:53.478307 6226 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smultinode-293000-m02' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-293000-m02/g' /etc/hosts;
else
echo '127.0.1.1 multinode-293000-m02' | sudo tee -a /etc/hosts;
fi
fi
I0222 20:44:53.544756 6226 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0222 20:44:53.544770 6226 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/15909-2565/.minikube CaCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15909-2565/.minikube}
I0222 20:44:53.544779 6226 buildroot.go:174] setting up certificates
I0222 20:44:53.544784 6226 provision.go:83] configureAuth start
I0222 20:44:53.544791 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetMachineName
I0222 20:44:53.544923 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetIP
I0222 20:44:53.545028 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:53.545139 6226 provision.go:138] copyHostCerts
I0222 20:44:53.545172 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem
I0222 20:44:53.545216 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem, removing ...
I0222 20:44:53.545221 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem
I0222 20:44:53.545374 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem (1082 bytes)
I0222 20:44:53.545549 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem
I0222 20:44:53.545581 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem, removing ...
I0222 20:44:53.545585 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem
I0222 20:44:53.545652 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem (1123 bytes)
I0222 20:44:53.545778 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem
I0222 20:44:53.545808 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem, removing ...
I0222 20:44:53.545815 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem
I0222 20:44:53.545964 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem (1679 bytes)
I0222 20:44:53.546090 6226 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem org=jenkins.multinode-293000-m02 san=[192.168.64.13 192.168.64.13 localhost 127.0.0.1 minikube multinode-293000-m02]
I0222 20:44:53.652741 6226 provision.go:172] copyRemoteCerts
I0222 20:44:53.652797 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0222 20:44:53.652815 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:53.653010 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:53.653108 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.653190 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:53.653273 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.13 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/id_rsa Username:docker}
I0222 20:44:53.687999 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0222 20:44:53.688076 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0222 20:44:53.703888 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0222 20:44:53.703956 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0222 20:44:53.719429 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem -> /etc/docker/server.pem
I0222 20:44:53.719490 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem --> /etc/docker/server.pem (1237 bytes)
I0222 20:44:53.735372 6226 provision.go:86] duration metric: configureAuth took 190.57721ms
I0222 20:44:53.735382 6226 buildroot.go:189] setting minikube options for container-runtime
I0222 20:44:53.735542 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:44:53.735555 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:53.735690 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:53.735787 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:53.735879 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.735970 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.736063 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:53.736175 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:44:53.736478 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.13 22 <nil> <nil>}
I0222 20:44:53.736486 6226 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0222 20:44:53.795863 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I0222 20:44:53.795880 6226 buildroot.go:70] root file system type: tmpfs
I0222 20:44:53.795964 6226 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0222 20:44:53.795974 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:53.796105 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:53.796200 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.796284 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.796364 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:53.796494 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:44:53.796812 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.13 22 <nil> <nil>}
I0222 20:44:53.796859 6226 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
Environment="NO_PROXY=192.168.64.12"
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0222 20:44:53.864199 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
Environment=NO_PROXY=192.168.64.12
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0222 20:44:53.864218 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:53.864366 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:53.864480 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.864566 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.864681 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:53.864817 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:44:53.865130 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.13 22 <nil> <nil>}
I0222 20:44:53.865143 6226 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0222 20:44:54.360954 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I0222 20:44:54.360968 6226 machine.go:91] provisioned docker machine in 35.958184105s
I0222 20:44:54.360974 6226 start.go:300] post-start starting for "multinode-293000-m02" (driver="hyperkit")
I0222 20:44:54.360979 6226 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0222 20:44:54.360992 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:54.361201 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0222 20:44:54.361214 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:54.361302 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:54.361406 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:54.361507 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:54.361602 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.13 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/id_rsa Username:docker}
I0222 20:44:54.400276 6226 ssh_runner.go:195] Run: cat /etc/os-release
I0222 20:44:54.402664 6226 command_runner.go:130] > NAME=Buildroot
I0222 20:44:54.402674 6226 command_runner.go:130] > VERSION=2021.02.12-1-g41e8300-dirty
I0222 20:44:54.402678 6226 command_runner.go:130] > ID=buildroot
I0222 20:44:54.402682 6226 command_runner.go:130] > VERSION_ID=2021.02.12
I0222 20:44:54.402686 6226 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"
I0222 20:44:54.402857 6226 info.go:137] Remote host: Buildroot 2021.02.12
I0222 20:44:54.402868 6226 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15909-2565/.minikube/addons for local assets ...
I0222 20:44:54.402953 6226 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15909-2565/.minikube/files for local assets ...
I0222 20:44:54.403108 6226 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> 30412.pem in /etc/ssl/certs
I0222 20:44:54.403114 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> /etc/ssl/certs/30412.pem
I0222 20:44:54.403286 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0222 20:44:54.409793 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem --> /etc/ssl/certs/30412.pem (1708 bytes)
I0222 20:44:54.425170 6226 start.go:303] post-start completed in 64.188612ms
I0222 20:44:54.425187 6226 fix.go:57] fixHost completed within 36.110540871s
I0222 20:44:54.425199 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:54.425327 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:54.425416 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:54.425506 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:54.425587 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:54.425700 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:44:54.426001 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.13 22 <nil> <nil>}
I0222 20:44:54.426009 6226 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0222 20:44:54.486606 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: 1677127494.596382578
I0222 20:44:54.486618 6226 fix.go:207] guest clock: 1677127494.596382578
I0222 20:44:54.486624 6226 fix.go:220] Guest: 2023-02-22 20:44:54.596382578 -0800 PST Remote: 2023-02-22 20:44:54.425189 -0800 PST m=+87.890504206 (delta=171.193578ms)
I0222 20:44:54.486633 6226 fix.go:191] guest clock delta is within tolerance: 171.193578ms
I0222 20:44:54.486637 6226 start.go:83] releasing machines lock for "multinode-293000-m02", held for 36.17202281s
I0222 20:44:54.486657 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:54.486788 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetIP
I0222 20:44:54.508269 6226 out.go:177] * Found network options:
I0222 20:44:54.529274 6226 out.go:177] - NO_PROXY=192.168.64.12
W0222 20:44:54.551353 6226 proxy.go:119] fail to check proxy env: Error ip not in block
I0222 20:44:54.551402 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:54.552295 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:54.552564 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:54.552701 6226 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0222 20:44:54.552745 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
W0222 20:44:54.552769 6226 proxy.go:119] fail to check proxy env: Error ip not in block
I0222 20:44:54.552870 6226 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0222 20:44:54.552904 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:54.552933 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:54.553103 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:54.553139 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:54.553307 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:54.553324 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:54.553460 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.13 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/id_rsa Username:docker}
I0222 20:44:54.553516 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:54.553671 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.13 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/id_rsa Username:docker}
I0222 20:44:54.586460 6226 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory
W0222 20:44:54.586481 6226 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0222 20:44:54.586537 6226 ssh_runner.go:195] Run: which cri-dockerd
I0222 20:44:54.622787 6226 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.
I0222 20:44:54.623712 6226 command_runner.go:130] > /usr/bin/cri-dockerd
I0222 20:44:54.623875 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0222 20:44:54.630549 6226 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (135 bytes)
I0222 20:44:54.641965 6226 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0222 20:44:54.652115 6226 command_runner.go:139] > /etc/cni/net.d/87-podman-bridge.conflist,
I0222 20:44:54.652149 6226 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0222 20:44:54.652156 6226 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0222 20:44:54.652243 6226 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0222 20:44:54.668279 6226 command_runner.go:130] > registry.k8s.io/kube-apiserver:v1.26.1
I0222 20:44:54.668292 6226 command_runner.go:130] > registry.k8s.io/kube-controller-manager:v1.26.1
I0222 20:44:54.668296 6226 command_runner.go:130] > registry.k8s.io/kube-scheduler:v1.26.1
I0222 20:44:54.668302 6226 command_runner.go:130] > registry.k8s.io/kube-proxy:v1.26.1
I0222 20:44:54.668312 6226 command_runner.go:130] > registry.k8s.io/etcd:3.5.6-0
I0222 20:44:54.668316 6226 command_runner.go:130] > registry.k8s.io/pause:3.9
I0222 20:44:54.668320 6226 command_runner.go:130] > kindest/kindnetd:v20221004-44d545d1
I0222 20:44:54.668327 6226 command_runner.go:130] > registry.k8s.io/coredns/coredns:v1.9.3
I0222 20:44:54.668332 6226 command_runner.go:130] > registry.k8s.io/pause:3.6
I0222 20:44:54.668335 6226 command_runner.go:130] > gcr.io/k8s-minikube/storage-provisioner:v5
I0222 20:44:54.668340 6226 command_runner.go:130] > gcr.io/k8s-minikube/busybox:1.28
I0222 20:44:54.669175 6226 docker.go:630] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.26.1
registry.k8s.io/kube-controller-manager:v1.26.1
registry.k8s.io/kube-scheduler:v1.26.1
registry.k8s.io/kube-proxy:v1.26.1
registry.k8s.io/etcd:3.5.6-0
registry.k8s.io/pause:3.9
kindest/kindnetd:v20221004-44d545d1
registry.k8s.io/coredns/coredns:v1.9.3
registry.k8s.io/pause:3.6
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28
-- /stdout --
I0222 20:44:54.669187 6226 docker.go:560] Images already preloaded, skipping extraction
I0222 20:44:54.669193 6226 start.go:485] detecting cgroup driver to use...
I0222 20:44:54.669261 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
image-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0222 20:44:54.680845 6226 command_runner.go:130] > runtime-endpoint: unix:///run/containerd/containerd.sock
I0222 20:44:54.680858 6226 command_runner.go:130] > image-endpoint: unix:///run/containerd/containerd.sock
I0222 20:44:54.681166 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0222 20:44:54.687635 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0222 20:44:54.693891 6226 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I0222 20:44:54.693938 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0222 20:44:54.700270 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0222 20:44:54.706633 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0222 20:44:54.712882 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0222 20:44:54.719237 6226 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0222 20:44:54.725831 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0222 20:44:54.732080 6226 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0222 20:44:54.737612 6226 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1
I0222 20:44:54.737747 6226 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0222 20:44:54.743442 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:44:54.822256 6226 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0222 20:44:54.834867 6226 start.go:485] detecting cgroup driver to use...
I0222 20:44:54.834933 6226 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0222 20:44:54.843406 6226 command_runner.go:130] > # /usr/lib/systemd/system/docker.service
I0222 20:44:54.844301 6226 command_runner.go:130] > [Unit]
I0222 20:44:54.844318 6226 command_runner.go:130] > Description=Docker Application Container Engine
I0222 20:44:54.844328 6226 command_runner.go:130] > Documentation=https://docs.docker.com
I0222 20:44:54.844341 6226 command_runner.go:130] > After=network.target minikube-automount.service docker.socket
I0222 20:44:54.844347 6226 command_runner.go:130] > Requires= minikube-automount.service docker.socket
I0222 20:44:54.844355 6226 command_runner.go:130] > StartLimitBurst=3
I0222 20:44:54.844359 6226 command_runner.go:130] > StartLimitIntervalSec=60
I0222 20:44:54.844362 6226 command_runner.go:130] > [Service]
I0222 20:44:54.844365 6226 command_runner.go:130] > Type=notify
I0222 20:44:54.844370 6226 command_runner.go:130] > Restart=on-failure
I0222 20:44:54.844373 6226 command_runner.go:130] > Environment=NO_PROXY=192.168.64.12
I0222 20:44:54.844382 6226 command_runner.go:130] > # This file is a systemd drop-in unit that inherits from the base dockerd configuration.
I0222 20:44:54.844392 6226 command_runner.go:130] > # The base configuration already specifies an 'ExecStart=...' command. The first directive
I0222 20:44:54.844398 6226 command_runner.go:130] > # here is to clear out that command inherited from the base configuration. Without this,
I0222 20:44:54.844408 6226 command_runner.go:130] > # the command from the base configuration and the command specified here are treated as
I0222 20:44:54.844415 6226 command_runner.go:130] > # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
I0222 20:44:54.844427 6226 command_runner.go:130] > # will catch this invalid input and refuse to start the service with an error like:
I0222 20:44:54.844443 6226 command_runner.go:130] > # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
I0222 20:44:54.844465 6226 command_runner.go:130] > # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
I0222 20:44:54.844481 6226 command_runner.go:130] > # container runtimes. If left unlimited, it may result in OOM issues with MySQL.
I0222 20:44:54.844488 6226 command_runner.go:130] > ExecStart=
I0222 20:44:54.844500 6226 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
I0222 20:44:54.844505 6226 command_runner.go:130] > ExecReload=/bin/kill -s HUP $MAINPID
I0222 20:44:54.844510 6226 command_runner.go:130] > # Having non-zero Limit*s causes performance problems due to accounting overhead
I0222 20:44:54.844516 6226 command_runner.go:130] > # in the kernel. We recommend using cgroups to do container-local accounting.
I0222 20:44:54.844519 6226 command_runner.go:130] > LimitNOFILE=infinity
I0222 20:44:54.844523 6226 command_runner.go:130] > LimitNPROC=infinity
I0222 20:44:54.844526 6226 command_runner.go:130] > LimitCORE=infinity
I0222 20:44:54.844533 6226 command_runner.go:130] > # Uncomment TasksMax if your systemd version supports it.
I0222 20:44:54.844538 6226 command_runner.go:130] > # Only systemd 226 and above support this version.
I0222 20:44:54.844542 6226 command_runner.go:130] > TasksMax=infinity
I0222 20:44:54.844545 6226 command_runner.go:130] > TimeoutStartSec=0
I0222 20:44:54.844557 6226 command_runner.go:130] > # set delegate yes so that systemd does not reset the cgroups of docker containers
I0222 20:44:54.844560 6226 command_runner.go:130] > Delegate=yes
I0222 20:44:54.844565 6226 command_runner.go:130] > # kill only the docker process, not all processes in the cgroup
I0222 20:44:54.844582 6226 command_runner.go:130] > KillMode=process
I0222 20:44:54.844588 6226 command_runner.go:130] > [Install]
I0222 20:44:54.844594 6226 command_runner.go:130] > WantedBy=multi-user.target
I0222 20:44:54.844789 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0222 20:44:54.856302 6226 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0222 20:44:54.869451 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0222 20:44:54.877648 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0222 20:44:54.885949 6226 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0222 20:44:54.913023 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0222 20:44:54.922260 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
image-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0222 20:44:54.933704 6226 command_runner.go:130] > runtime-endpoint: unix:///var/run/cri-dockerd.sock
I0222 20:44:54.933715 6226 command_runner.go:130] > image-endpoint: unix:///var/run/cri-dockerd.sock
I0222 20:44:54.934023 6226 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0222 20:44:55.014980 6226 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0222 20:44:55.105531 6226 docker.go:529] configuring docker to use "cgroupfs" as cgroup driver...
I0222 20:44:55.105549 6226 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
I0222 20:44:55.116799 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:44:55.196966 6226 ssh_runner.go:195] Run: sudo systemctl restart docker
I0222 20:44:56.435163 6226 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.238198156s)
I0222 20:44:56.435224 6226 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0222 20:44:56.517748 6226 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0222 20:44:56.604273 6226 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0222 20:44:56.691564 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:44:56.771800 6226 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0222 20:44:56.783317 6226 start.go:532] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0222 20:44:56.783405 6226 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0222 20:44:56.787070 6226 command_runner.go:130] > File: /var/run/cri-dockerd.sock
I0222 20:44:56.787085 6226 command_runner.go:130] > Size: 0 Blocks: 0 IO Block: 4096 socket
I0222 20:44:56.787095 6226 command_runner.go:130] > Device: 16h/22d Inode: 824 Links: 1
I0222 20:44:56.787106 6226 command_runner.go:130] > Access: (0660/srw-rw----) Uid: ( 0/ root) Gid: ( 1000/ docker)
I0222 20:44:56.787114 6226 command_runner.go:130] > Access: 2023-02-23 04:44:56.891151653 +0000
I0222 20:44:56.787118 6226 command_runner.go:130] > Modify: 2023-02-23 04:44:56.891151653 +0000
I0222 20:44:56.787123 6226 command_runner.go:130] > Change: 2023-02-23 04:44:56.893151653 +0000
I0222 20:44:56.787126 6226 command_runner.go:130] > Birth: -
I0222 20:44:56.787347 6226 start.go:553] Will wait 60s for crictl version
I0222 20:44:56.787392 6226 ssh_runner.go:195] Run: which crictl
I0222 20:44:56.789473 6226 command_runner.go:130] > /usr/bin/crictl
I0222 20:44:56.789752 6226 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0222 20:44:56.861843 6226 command_runner.go:130] > Version: 0.1.0
I0222 20:44:56.861856 6226 command_runner.go:130] > RuntimeName: docker
I0222 20:44:56.861860 6226 command_runner.go:130] > RuntimeVersion: 20.10.23
I0222 20:44:56.861864 6226 command_runner.go:130] > RuntimeApiVersion: v1alpha2
I0222 20:44:56.862801 6226 start.go:569] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 20.10.23
RuntimeApiVersion: v1alpha2
I0222 20:44:56.862903 6226 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0222 20:44:56.884991 6226 command_runner.go:130] > 20.10.23
I0222 20:44:56.885810 6226 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0222 20:44:56.904926 6226 command_runner.go:130] > 20.10.23
I0222 20:44:56.949151 6226 out.go:204] * Preparing Kubernetes v1.26.1 on Docker 20.10.23 ...
I0222 20:44:56.971245 6226 out.go:177] - env NO_PROXY=192.168.64.12
I0222 20:44:56.993196 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetIP
I0222 20:44:56.993538 6226 ssh_runner.go:195] Run: grep 192.168.64.1 host.minikube.internal$ /etc/hosts
I0222 20:44:56.996709 6226 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.64.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0222 20:44:57.004699 6226 certs.go:56] Setting up /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000 for IP: 192.168.64.13
I0222 20:44:57.004711 6226 certs.go:186] acquiring lock for shared ca certs: {Name:mk146a2279536341f0de1f1926bcacb2037bedc8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 20:44:57.004850 6226 certs.go:195] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.key
I0222 20:44:57.004901 6226 certs.go:195] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.key
I0222 20:44:57.004910 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0222 20:44:57.004934 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0222 20:44:57.004952 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0222 20:44:57.004969 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0222 20:44:57.005049 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041.pem (1338 bytes)
W0222 20:44:57.005086 6226 certs.go:397] ignoring /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041_empty.pem, impossibly tiny 0 bytes
I0222 20:44:57.005096 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem (1679 bytes)
I0222 20:44:57.005130 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem (1082 bytes)
I0222 20:44:57.005159 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem (1123 bytes)
I0222 20:44:57.005188 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem (1679 bytes)
I0222 20:44:57.005256 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem (1708 bytes)
I0222 20:44:57.005288 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0222 20:44:57.005308 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041.pem -> /usr/share/ca-certificates/3041.pem
I0222 20:44:57.005327 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> /usr/share/ca-certificates/30412.pem
I0222 20:44:57.005575 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0222 20:44:57.021751 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0222 20:44:57.037933 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0222 20:44:57.053925 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0222 20:44:57.069647 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0222 20:44:57.085266 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041.pem --> /usr/share/ca-certificates/3041.pem (1338 bytes)
I0222 20:44:57.101260 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem --> /usr/share/ca-certificates/30412.pem (1708 bytes)
I0222 20:44:57.117396 6226 ssh_runner.go:195] Run: openssl version
I0222 20:44:57.120692 6226 command_runner.go:130] > OpenSSL 1.1.1n 15 Mar 2022
I0222 20:44:57.120907 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3041.pem && ln -fs /usr/share/ca-certificates/3041.pem /etc/ssl/certs/3041.pem"
I0222 20:44:57.127316 6226 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3041.pem
I0222 20:44:57.129977 6226 command_runner.go:130] > -rw-r--r-- 1 root root 1338 Feb 23 04:28 /usr/share/ca-certificates/3041.pem
I0222 20:44:57.130172 6226 certs.go:444] hashing: -rw-r--r-- 1 root root 1338 Feb 23 04:28 /usr/share/ca-certificates/3041.pem
I0222 20:44:57.130210 6226 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3041.pem
I0222 20:44:57.133500 6226 command_runner.go:130] > 51391683
I0222 20:44:57.133682 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/3041.pem /etc/ssl/certs/51391683.0"
I0222 20:44:57.140180 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/30412.pem && ln -fs /usr/share/ca-certificates/30412.pem /etc/ssl/certs/30412.pem"
I0222 20:44:57.146784 6226 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/30412.pem
I0222 20:44:57.149565 6226 command_runner.go:130] > -rw-r--r-- 1 root root 1708 Feb 23 04:28 /usr/share/ca-certificates/30412.pem
I0222 20:44:57.149752 6226 certs.go:444] hashing: -rw-r--r-- 1 root root 1708 Feb 23 04:28 /usr/share/ca-certificates/30412.pem
I0222 20:44:57.149790 6226 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/30412.pem
I0222 20:44:57.153077 6226 command_runner.go:130] > 3ec20f2e
I0222 20:44:57.153280 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/30412.pem /etc/ssl/certs/3ec20f2e.0"
I0222 20:44:57.159974 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0222 20:44:57.166266 6226 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0222 20:44:57.169015 6226 command_runner.go:130] > -rw-r--r-- 1 root root 1111 Feb 23 04:23 /usr/share/ca-certificates/minikubeCA.pem
I0222 20:44:57.169211 6226 certs.go:444] hashing: -rw-r--r-- 1 root root 1111 Feb 23 04:23 /usr/share/ca-certificates/minikubeCA.pem
I0222 20:44:57.169247 6226 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0222 20:44:57.172499 6226 command_runner.go:130] > b5213941
I0222 20:44:57.172716 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0222 20:44:57.179185 6226 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0222 20:44:57.198336 6226 command_runner.go:130] > cgroupfs
I0222 20:44:57.199044 6226 cni.go:84] Creating CNI manager for ""
I0222 20:44:57.199056 6226 cni.go:136] 3 nodes found, recommending kindnet
I0222 20:44:57.199062 6226 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0222 20:44:57.199076 6226 kubeadm.go:172] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.64.13 APIServerPort:8443 KubernetesVersion:v1.26.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:multinode-293000 NodeName:multinode-293000-m02 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.64.12"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.64.13 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPa
th:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m]}
I0222 20:44:57.199147 6226 kubeadm.go:177] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.64.13
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/cri-dockerd.sock
name: "multinode-293000-m02"
kubeletExtraArgs:
node-ip: 192.168.64.13
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.64.12"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.26.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0222 20:44:57.199193 6226 kubeadm.go:968] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.26.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=/var/run/cri-dockerd.sock --hostname-override=multinode-293000-m02 --image-service-endpoint=/var/run/cri-dockerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.64.13
[Install]
config:
{KubernetesVersion:v1.26.1 ClusterName:multinode-293000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0222 20:44:57.199248 6226 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.26.1
I0222 20:44:57.205093 6226 command_runner.go:130] > kubeadm
I0222 20:44:57.205100 6226 command_runner.go:130] > kubectl
I0222 20:44:57.205104 6226 command_runner.go:130] > kubelet
I0222 20:44:57.205239 6226 binaries.go:44] Found k8s binaries, skipping transfer
I0222 20:44:57.205296 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system
I0222 20:44:57.211128 6226 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (453 bytes)
I0222 20:44:57.222142 6226 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0222 20:44:57.232927 6226 ssh_runner.go:195] Run: grep 192.168.64.12 control-plane.minikube.internal$ /etc/hosts
I0222 20:44:57.235192 6226 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.64.12 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0222 20:44:57.243101 6226 host.go:66] Checking if "multinode-293000" exists ...
I0222 20:44:57.243275 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:44:57.243386 6226 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0222 20:44:57.243408 6226 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0222 20:44:57.250376 6226 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51548
I0222 20:44:57.250710 6226 main.go:141] libmachine: () Calling .GetVersion
I0222 20:44:57.251062 6226 main.go:141] libmachine: Using API Version 1
I0222 20:44:57.251078 6226 main.go:141] libmachine: () Calling .SetConfigRaw
I0222 20:44:57.251270 6226 main.go:141] libmachine: () Calling .GetMachineName
I0222 20:44:57.251378 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:44:57.251467 6226 start.go:301] JoinCluster: &{Name:multinode-293000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15849/minikube-v1.29.0-1676568791-15849-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersi
on:v1.26.1 ClusterName:multinode-293000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.12 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.64.14 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingr
ess:false ingress-dns:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath:
StaticIP:}
I0222 20:44:57.251571 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm token create --print-join-command --ttl=0"
I0222 20:44:57.251581 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:44:57.251663 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:44:57.251734 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:44:57.251801 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:44:57.251899 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.12 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/id_rsa Username:docker}
I0222 20:44:57.346629 6226 command_runner.go:130] > kubeadm join control-plane.minikube.internal:8443 --token tlyzme.3mhzgdnodrgsn6st --discovery-token-ca-cert-hash sha256:b04cace514db1b68286f4e0582e633ab5836a09959a0a1417edcdafc3829e5ca
I0222 20:44:57.346671 6226 start.go:314] removing existing worker node "m02" before attempting to rejoin cluster: &{Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true}
I0222 20:44:57.346695 6226 host.go:66] Checking if "multinode-293000" exists ...
I0222 20:44:57.346986 6226 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0222 20:44:57.347010 6226 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0222 20:44:57.354069 6226 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51551
I0222 20:44:57.354410 6226 main.go:141] libmachine: () Calling .GetVersion
I0222 20:44:57.354741 6226 main.go:141] libmachine: Using API Version 1
I0222 20:44:57.354753 6226 main.go:141] libmachine: () Calling .SetConfigRaw
I0222 20:44:57.355002 6226 main.go:141] libmachine: () Calling .GetMachineName
I0222 20:44:57.355110 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:44:57.355251 6226 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.26.1/kubectl drain multinode-293000-m02 --force --grace-period=1 --skip-wait-for-delete-timeout=1 --disable-eviction --ignore-daemonsets --delete-emptydir-data --delete-local-data
I0222 20:44:57.355263 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:44:57.355344 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:44:57.355420 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:44:57.355530 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:44:57.355611 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.12 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/id_rsa Username:docker}
I0222 20:44:57.464951 6226 command_runner.go:130] > node/multinode-293000-m02 cordoned
I0222 20:45:00.492802 6226 command_runner.go:130] > pod "busybox-6b86dd6d48-pz4cz" has DeletionTimestamp older than 1 seconds, skipping
I0222 20:45:00.492826 6226 command_runner.go:130] > node/multinode-293000-m02 drained
I0222 20:45:00.494164 6226 command_runner.go:130] ! Flag --delete-local-data has been deprecated, This option is deprecated and will be deleted. Use --delete-emptydir-data.
I0222 20:45:00.494175 6226 command_runner.go:130] ! Warning: ignoring DaemonSet-managed Pods: kube-system/kindnet-bzxtr, kube-system/kube-proxy-qmsbf
I0222 20:45:00.494191 6226 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.26.1/kubectl drain multinode-293000-m02 --force --grace-period=1 --skip-wait-for-delete-timeout=1 --disable-eviction --ignore-daemonsets --delete-emptydir-data --delete-local-data: (3.138982007s)
I0222 20:45:00.494199 6226 node.go:109] successfully drained node "m02"
I0222 20:45:00.494507 6226 loader.go:373] Config loaded from file: /Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:45:00.494713 6226 kapi.go:59] client config for multinode-293000: &rest.Config{Host:"https://192.168.64.12:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.key", CAFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next
Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x25472a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0222 20:45:00.494997 6226 request.go:1171] Request Body: {"kind":"DeleteOptions","apiVersion":"v1"}
I0222 20:45:00.495026 6226 round_trippers.go:463] DELETE https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:00.495030 6226 round_trippers.go:469] Request Headers:
I0222 20:45:00.495036 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:00.495042 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:00.495048 6226 round_trippers.go:473] Content-Type: application/json
I0222 20:45:00.498006 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:00.498016 6226 round_trippers.go:577] Response Headers:
I0222 20:45:00.498021 6226 round_trippers.go:580] Content-Length: 171
I0222 20:45:00.498027 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:00 GMT
I0222 20:45:00.498032 6226 round_trippers.go:580] Audit-Id: 02857edf-6958-413e-8c18-99e61fdac428
I0222 20:45:00.498037 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:00.498042 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:00.498047 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:00.498053 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:00.498157 6226 request.go:1171] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"multinode-293000-m02","kind":"nodes","uid":"f968bf76-422f-4a90-ba94-df00a7b8efaa"}}
I0222 20:45:00.498182 6226 node.go:125] successfully deleted node "m02"
I0222 20:45:00.498188 6226 start.go:318] successfully removed existing worker node "m02" from cluster: &{Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true}
I0222 20:45:00.498199 6226 start.go:322] trying to join worker node "m02" to cluster: &{Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true}
I0222 20:45:00.498213 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm join control-plane.minikube.internal:8443 --token tlyzme.3mhzgdnodrgsn6st --discovery-token-ca-cert-hash sha256:b04cace514db1b68286f4e0582e633ab5836a09959a0a1417edcdafc3829e5ca --ignore-preflight-errors=all --cri-socket /var/run/cri-dockerd.sock --node-name=multinode-293000-m02"
I0222 20:45:00.561508 6226 command_runner.go:130] ! W0223 04:45:00.675776 1123 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!
I0222 20:45:00.706566 6226 command_runner.go:130] ! [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0222 20:45:02.351569 6226 command_runner.go:130] > [preflight] Running pre-flight checks
I0222 20:45:02.351589 6226 command_runner.go:130] > [preflight] Reading configuration from the cluster...
I0222 20:45:02.351600 6226 command_runner.go:130] > [preflight] FYI: You can look at this config file with 'kubectl -n kube-system get cm kubeadm-config -o yaml'
I0222 20:45:02.351609 6226 command_runner.go:130] > [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0222 20:45:02.351615 6226 command_runner.go:130] > [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0222 20:45:02.351619 6226 command_runner.go:130] > [kubelet-start] Starting the kubelet
I0222 20:45:02.351625 6226 command_runner.go:130] > [kubelet-start] Waiting for the kubelet to perform the TLS Bootstrap...
I0222 20:45:02.351634 6226 command_runner.go:130] > This node has joined the cluster:
I0222 20:45:02.351643 6226 command_runner.go:130] > * Certificate signing request was sent to apiserver and a response was received.
I0222 20:45:02.351649 6226 command_runner.go:130] > * The Kubelet was informed of the new secure connection details.
I0222 20:45:02.351671 6226 command_runner.go:130] > Run 'kubectl get nodes' on the control-plane to see this node join the cluster.
I0222 20:45:02.351842 6226 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm join control-plane.minikube.internal:8443 --token tlyzme.3mhzgdnodrgsn6st --discovery-token-ca-cert-hash sha256:b04cace514db1b68286f4e0582e633ab5836a09959a0a1417edcdafc3829e5ca --ignore-preflight-errors=all --cri-socket /var/run/cri-dockerd.sock --node-name=multinode-293000-m02": (1.853644672s)
I0222 20:45:02.351861 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
I0222 20:45:02.544185 6226 command_runner.go:130] ! Created symlink /etc/systemd/system/multi-user.target.wants/kubelet.service → /usr/lib/systemd/system/kubelet.service.
I0222 20:45:02.544224 6226 start.go:303] JoinCluster complete in 5.292852458s
I0222 20:45:02.544235 6226 cni.go:84] Creating CNI manager for ""
I0222 20:45:02.544242 6226 cni.go:136] 3 nodes found, recommending kindnet
I0222 20:45:02.544335 6226 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0222 20:45:02.547556 6226 command_runner.go:130] > File: /opt/cni/bin/portmap
I0222 20:45:02.547575 6226 command_runner.go:130] > Size: 2798344 Blocks: 5472 IO Block: 4096 regular file
I0222 20:45:02.547593 6226 command_runner.go:130] > Device: 11h/17d Inode: 3542 Links: 1
I0222 20:45:02.547603 6226 command_runner.go:130] > Access: (0755/-rwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root)
I0222 20:45:02.547614 6226 command_runner.go:130] > Access: 2023-02-23 04:43:35.438869016 +0000
I0222 20:45:02.547626 6226 command_runner.go:130] > Modify: 2023-02-16 22:59:55.000000000 +0000
I0222 20:45:02.547643 6226 command_runner.go:130] > Change: 2023-02-23 04:43:33.465142217 +0000
I0222 20:45:02.547650 6226 command_runner.go:130] > Birth: -
I0222 20:45:02.547770 6226 cni.go:181] applying CNI manifest using /var/lib/minikube/binaries/v1.26.1/kubectl ...
I0222 20:45:02.547778 6226 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2428 bytes)
I0222 20:45:02.559408 6226 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.26.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0222 20:45:02.799481 6226 command_runner.go:130] > clusterrole.rbac.authorization.k8s.io/kindnet unchanged
I0222 20:45:02.801794 6226 command_runner.go:130] > clusterrolebinding.rbac.authorization.k8s.io/kindnet unchanged
I0222 20:45:02.803694 6226 command_runner.go:130] > serviceaccount/kindnet unchanged
I0222 20:45:02.810312 6226 command_runner.go:130] > daemonset.apps/kindnet configured
I0222 20:45:02.812163 6226 loader.go:373] Config loaded from file: /Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:45:02.812361 6226 kapi.go:59] client config for multinode-293000: &rest.Config{Host:"https://192.168.64.12:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.key", CAFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next
Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x25472a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0222 20:45:02.812593 6226 round_trippers.go:463] GET https://192.168.64.12:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale
I0222 20:45:02.812599 6226 round_trippers.go:469] Request Headers:
I0222 20:45:02.812605 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:02.812611 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:02.813907 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:02.813915 6226 round_trippers.go:577] Response Headers:
I0222 20:45:02.813921 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:02.813926 6226 round_trippers.go:580] Content-Length: 291
I0222 20:45:02.813931 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:02 GMT
I0222 20:45:02.813938 6226 round_trippers.go:580] Audit-Id: 08e50a36-99be-4e88-9345-82862ccf63e8
I0222 20:45:02.813945 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:02.813953 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:02.813959 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:02.813971 6226 request.go:1171] Response Body: {"kind":"Scale","apiVersion":"autoscaling/v1","metadata":{"name":"coredns","namespace":"kube-system","uid":"b913bddd-effc-42b2-b71d-0d3159053b5a","resourceVersion":"824","creationTimestamp":"2023-02-23T04:40:25Z"},"spec":{"replicas":1},"status":{"replicas":1,"selector":"k8s-app=kube-dns"}}
I0222 20:45:02.814014 6226 kapi.go:248] "coredns" deployment in "kube-system" namespace and "multinode-293000" context rescaled to 1 replicas
I0222 20:45:02.814027 6226 start.go:223] Will wait 6m0s for node &{Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true}
I0222 20:45:02.835817 6226 out.go:177] * Verifying Kubernetes components...
I0222 20:45:02.879338 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0222 20:45:02.888901 6226 loader.go:373] Config loaded from file: /Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:45:02.889116 6226 kapi.go:59] client config for multinode-293000: &rest.Config{Host:"https://192.168.64.12:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.key", CAFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next
Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x25472a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0222 20:45:02.889301 6226 node_ready.go:35] waiting up to 6m0s for node "multinode-293000-m02" to be "Ready" ...
I0222 20:45:02.889341 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:02.889346 6226 round_trippers.go:469] Request Headers:
I0222 20:45:02.889352 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:02.889358 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:02.890998 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:02.891007 6226 round_trippers.go:577] Response Headers:
I0222 20:45:02.891016 6226 round_trippers.go:580] Audit-Id: c750f846-102a-4337-a66c-56039256ff82
I0222 20:45:02.891022 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:02.891031 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:02.891043 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:02.891053 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:02.891058 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:03 GMT
I0222 20:45:02.891164 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"914","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsT
ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 4251 chars]
I0222 20:45:03.392088 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:03.392100 6226 round_trippers.go:469] Request Headers:
I0222 20:45:03.392106 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:03.392111 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:03.393779 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:03.393800 6226 round_trippers.go:577] Response Headers:
I0222 20:45:03.393824 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:03 GMT
I0222 20:45:03.393839 6226 round_trippers.go:580] Audit-Id: b74d8ab7-6ca6-4907-b478-df870722f932
I0222 20:45:03.393847 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:03.393864 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:03.393875 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:03.393881 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:03.393972 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"914","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsT
ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 4251 chars]
I0222 20:45:03.892385 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:03.892397 6226 round_trippers.go:469] Request Headers:
I0222 20:45:03.892403 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:03.892408 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:03.893930 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:03.893940 6226 round_trippers.go:577] Response Headers:
I0222 20:45:03.893945 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:04 GMT
I0222 20:45:03.893950 6226 round_trippers.go:580] Audit-Id: 9bb9b1e1-9ac7-4876-a291-5714292bbf73
I0222 20:45:03.893955 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:03.893960 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:03.893965 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:03.893970 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:03.894055 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"914","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsT
ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 4251 chars]
I0222 20:45:04.392299 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:04.392313 6226 round_trippers.go:469] Request Headers:
I0222 20:45:04.392321 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:04.392326 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:04.393844 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:04.393855 6226 round_trippers.go:577] Response Headers:
I0222 20:45:04.393860 6226 round_trippers.go:580] Audit-Id: adc49372-b9a4-42f9-bce4-5c160e3d4012
I0222 20:45:04.393878 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:04.393889 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:04.393897 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:04.393905 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:04.393912 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:04 GMT
I0222 20:45:04.394088 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"914","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsT
ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 4251 chars]
I0222 20:45:04.891493 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:04.891508 6226 round_trippers.go:469] Request Headers:
I0222 20:45:04.891515 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:04.891520 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:04.893229 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:04.893242 6226 round_trippers.go:577] Response Headers:
I0222 20:45:04.893249 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:04.893254 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:04.893268 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:05 GMT
I0222 20:45:04.893276 6226 round_trippers.go:580] Audit-Id: 65d32211-c023-4638-b516-a52f0cb66f2e
I0222 20:45:04.893283 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:04.893289 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:04.893372 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"914","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsT
ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 4251 chars]
I0222 20:45:04.893573 6226 node_ready.go:58] node "multinode-293000-m02" has status "Ready":"False"
I0222 20:45:05.391788 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:05.391801 6226 round_trippers.go:469] Request Headers:
I0222 20:45:05.391807 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:05.391812 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:05.393514 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:05.393526 6226 round_trippers.go:577] Response Headers:
I0222 20:45:05.393532 6226 round_trippers.go:580] Audit-Id: ab287753-2fbd-4445-8ca6-5952e871e5e6
I0222 20:45:05.393541 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:05.393547 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:05.393552 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:05.393557 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:05.393562 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:05 GMT
I0222 20:45:05.393650 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"914","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsT
ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 4251 chars]
I0222 20:45:05.891917 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:05.891929 6226 round_trippers.go:469] Request Headers:
I0222 20:45:05.891936 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:05.891941 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:05.893514 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:05.893525 6226 round_trippers.go:577] Response Headers:
I0222 20:45:05.893533 6226 round_trippers.go:580] Audit-Id: aa9b1117-5d51-49df-b575-f87e7a349e0a
I0222 20:45:05.893541 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:05.893548 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:05.893555 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:05.893568 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:05.893577 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:06 GMT
I0222 20:45:05.893716 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"914","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsT
ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 4251 chars]
I0222 20:45:06.391740 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:06.391752 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.391758 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.391763 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.393493 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.393509 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.393518 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:06 GMT
I0222 20:45:06.393527 6226 round_trippers.go:580] Audit-Id: 5eed6747-0b62-4b5a-a7df-39c0d0fb25e3
I0222 20:45:06.393534 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.393546 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.393551 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.393556 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.393631 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"936","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{
}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 4360 chars]
I0222 20:45:06.892240 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:06.892260 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.892267 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.892272 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.893569 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.893580 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.893586 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.893591 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.893603 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.893608 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.893613 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.893618 6226 round_trippers.go:580] Audit-Id: b0f3e2a4-9cfa-4034-8de1-3e8f8548ecc4
I0222 20:45:06.893717 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"941","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{
}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 4618 chars]
I0222 20:45:06.893903 6226 node_ready.go:49] node "multinode-293000-m02" has status "Ready":"True"
I0222 20:45:06.893913 6226 node_ready.go:38] duration metric: took 4.004675827s waiting for node "multinode-293000-m02" to be "Ready" ...
I0222 20:45:06.893918 6226 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0222 20:45:06.893952 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:45:06.893957 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.893962 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.893968 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.896020 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:06.896033 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.896041 6226 round_trippers.go:580] Audit-Id: ad4ba6e0-b499-4a7c-8174-854c50392394
I0222 20:45:06.896050 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.896057 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.896066 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.896073 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.896078 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.896916 6226 request.go:1171] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"944"},"items":[{"metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"820","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f
:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 83689 chars]
I0222 20:45:06.898830 6226 pod_ready.go:78] waiting up to 6m0s for pod "coredns-787d4945fb-b28zh" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.898867 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:45:06.898871 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.898878 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.898884 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.900026 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.900042 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.900048 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.900053 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.900058 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.900063 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.900068 6226 round_trippers.go:580] Audit-Id: 24d0df9d-1409-491e-9b97-3b2f32261e4b
I0222 20:45:06.900073 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.900181 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"820","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6488 chars]
I0222 20:45:06.900417 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:06.900423 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.900429 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.900434 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.901513 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.901522 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.901530 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.901538 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.901550 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.901556 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.901561 6226 round_trippers.go:580] Audit-Id: 3fc612fe-a074-4563-ab05-95de6c56a53c
I0222 20:45:06.901566 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.901681 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:45:06.901864 6226 pod_ready.go:92] pod "coredns-787d4945fb-b28zh" in "kube-system" namespace has status "Ready":"True"
I0222 20:45:06.901869 6226 pod_ready.go:81] duration metric: took 3.03073ms waiting for pod "coredns-787d4945fb-b28zh" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.901875 6226 pod_ready.go:78] waiting up to 6m0s for pod "etcd-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.901901 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/etcd-multinode-293000
I0222 20:45:06.901906 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.901911 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.901917 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.902899 6226 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds
I0222 20:45:06.902906 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.902911 6226 round_trippers.go:580] Audit-Id: bce1a718-2de7-4e3d-88fd-d37cb19950f7
I0222 20:45:06.902916 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.902922 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.902926 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.902934 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.902939 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.903273 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"etcd-multinode-293000","namespace":"kube-system","uid":"2363a307-e6f7-4025-ae02-4920adde4561","resourceVersion":"793","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.64.12:2379","kubernetes.io/config.hash":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.mirror":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.seen":"2023-02-23T04:40:26.073140598Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-c
lient-urls":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config [truncated 6055 chars]
I0222 20:45:06.903477 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:06.903483 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.903489 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.903494 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.904553 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.904562 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.904567 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.904573 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.904578 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.904583 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.904588 6226 round_trippers.go:580] Audit-Id: 83c3c739-2c6d-4858-85b9-0f6de7012ace
I0222 20:45:06.904593 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.904744 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:45:06.904907 6226 pod_ready.go:92] pod "etcd-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:45:06.904913 6226 pod_ready.go:81] duration metric: took 3.033371ms waiting for pod "etcd-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.904925 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.904952 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-multinode-293000
I0222 20:45:06.904957 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.904963 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.904969 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.906181 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.906191 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.906197 6226 round_trippers.go:580] Audit-Id: 6befa1e8-d194-432e-8667-2ccb2fd77788
I0222 20:45:06.906202 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.906207 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.906211 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.906217 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.906222 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.906501 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-apiserver-multinode-293000","namespace":"kube-system","uid":"bb2fc1a3-12c1-4854-8f8c-3c1c5664067c","resourceVersion":"748","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-apiserver","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.64.12:8443","kubernetes.io/config.hash":"578ff397a5454283a55e183c76494192","kubernetes.io/config.mirror":"578ff397a5454283a55e183c76494192","kubernetes.io/config.seen":"2023-02-23T04:40:26.073157361Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kub
ernetes.io/kube-apiserver.advertise-address.endpoint":{},"f:kubernetes. [truncated 7590 chars]
I0222 20:45:06.906747 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:06.906753 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.906758 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.906764 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.907973 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.907982 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.907991 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.908000 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.908009 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.908018 6226 round_trippers.go:580] Audit-Id: bc795608-0e81-4988-840f-e2b75fbc974d
I0222 20:45:06.908031 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.908040 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.908129 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:45:06.908307 6226 pod_ready.go:92] pod "kube-apiserver-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:45:06.908315 6226 pod_ready.go:81] duration metric: took 3.38336ms waiting for pod "kube-apiserver-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.908321 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.908350 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-multinode-293000
I0222 20:45:06.908355 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.908360 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.908368 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.909550 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.909557 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.909562 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.909567 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.909573 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.909577 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.909583 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.909588 6226 round_trippers.go:580] Audit-Id: 677a73f2-1f14-4198-a0b3-b456db3f4356
I0222 20:45:06.909713 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-controller-manager-multinode-293000","namespace":"kube-system","uid":"e60be5dc-4ed1-4a87-b03c-2ac01b03001d","resourceVersion":"742","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-controller-manager","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"02b271251b67ef9dd552c569d01153ca","kubernetes.io/config.mirror":"02b271251b67ef9dd552c569d01153ca","kubernetes.io/config.seen":"2023-02-23T04:40:26.073158360Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.i
o/config.seen":{},"f:kubernetes.io/config.source":{}},"f:labels":{".":{ [truncated 7158 chars]
I0222 20:45:06.909951 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:06.909957 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.909963 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.909968 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.911178 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.911185 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.911190 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.911195 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.911200 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.911204 6226 round_trippers.go:580] Audit-Id: af6e5f9e-8886-405b-b37b-d28b8133856b
I0222 20:45:06.911210 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.911216 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.911348 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:45:06.911516 6226 pod_ready.go:92] pod "kube-controller-manager-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:45:06.911521 6226 pod_ready.go:81] duration metric: took 3.195134ms waiting for pod "kube-controller-manager-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.911526 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-bj985" in "kube-system" namespace to be "Ready" ...
I0222 20:45:07.092939 6226 request.go:622] Waited for 181.331895ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bj985
I0222 20:45:07.092977 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bj985
I0222 20:45:07.092983 6226 round_trippers.go:469] Request Headers:
I0222 20:45:07.092995 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:07.093001 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:07.094927 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:07.094937 6226 round_trippers.go:577] Response Headers:
I0222 20:45:07.094943 6226 round_trippers.go:580] Audit-Id: fae56b53-82fa-493b-9458-0d62a847f5ce
I0222 20:45:07.094948 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:07.094953 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:07.094958 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:07.094963 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:07.094968 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:07.095105 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-bj985","generateName":"kube-proxy-","namespace":"kube-system","uid":"36f7816d-0b3e-4210-be32-907bf62dfa61","resourceVersion":"875","creationTimestamp":"2023-02-23T04:42:15Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:42:15Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5971 chars]
I0222 20:45:07.292936 6226 request.go:622] Waited for 197.564573ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m03
I0222 20:45:07.293011 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m03
I0222 20:45:07.293038 6226 round_trippers.go:469] Request Headers:
I0222 20:45:07.293054 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:07.293067 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:07.296218 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:45:07.296234 6226 round_trippers.go:577] Response Headers:
I0222 20:45:07.296242 6226 round_trippers.go:580] Audit-Id: 25b3b0be-3d8b-4185-afb7-d0b4cd9db4da
I0222 20:45:07.296249 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:07.296258 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:07.296268 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:07.296275 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:07.296281 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:07.296599 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m03","uid":"181ccd63-a7fc-412c-bfee-446a1e65f4b4","resourceVersion":"873","creationTimestamp":"2023-02-23T04:42:56Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m03","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:42:56Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{
}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 4988 chars]
I0222 20:45:07.296865 6226 pod_ready.go:97] node "multinode-293000-m03" hosting pod "kube-proxy-bj985" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000-m03" has status "Ready":"Unknown"
I0222 20:45:07.296891 6226 pod_ready.go:81] duration metric: took 385.352206ms waiting for pod "kube-proxy-bj985" in "kube-system" namespace to be "Ready" ...
E0222 20:45:07.296898 6226 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-293000-m03" hosting pod "kube-proxy-bj985" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000-m03" has status "Ready":"Unknown"
I0222 20:45:07.296903 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-pxq2s" in "kube-system" namespace to be "Ready" ...
I0222 20:45:07.492448 6226 request.go:622] Waited for 195.50692ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pxq2s
I0222 20:45:07.492507 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pxq2s
I0222 20:45:07.492519 6226 round_trippers.go:469] Request Headers:
I0222 20:45:07.492531 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:07.492542 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:07.495239 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:07.495262 6226 round_trippers.go:577] Response Headers:
I0222 20:45:07.495274 6226 round_trippers.go:580] Audit-Id: f42ec6c2-b81d-4508-8409-dc9b907a02cf
I0222 20:45:07.495285 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:07.495295 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:07.495302 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:07.495310 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:07.495317 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:07.495453 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-pxq2s","generateName":"kube-proxy-","namespace":"kube-system","uid":"0ce24b37-1ce7-4772-b40d-5f88f10aaa4b","resourceVersion":"720","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5738 chars]
I0222 20:45:07.692322 6226 request.go:622] Waited for 196.533071ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:07.692412 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:07.692418 6226 round_trippers.go:469] Request Headers:
I0222 20:45:07.692425 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:07.692432 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:07.694732 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:07.694745 6226 round_trippers.go:577] Response Headers:
I0222 20:45:07.694751 6226 round_trippers.go:580] Audit-Id: 9889670a-0e67-43e2-b493-f6a21902e518
I0222 20:45:07.694757 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:07.694762 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:07.694767 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:07.694772 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:07.694777 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:07.694886 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:45:07.695084 6226 pod_ready.go:92] pod "kube-proxy-pxq2s" in "kube-system" namespace has status "Ready":"True"
I0222 20:45:07.695089 6226 pod_ready.go:81] duration metric: took 398.189383ms waiting for pod "kube-proxy-pxq2s" in "kube-system" namespace to be "Ready" ...
I0222 20:45:07.695096 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-qmsbf" in "kube-system" namespace to be "Ready" ...
I0222 20:45:07.894139 6226 request.go:622] Waited for 198.922314ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qmsbf
I0222 20:45:07.894194 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qmsbf
I0222 20:45:07.894205 6226 round_trippers.go:469] Request Headers:
I0222 20:45:07.894223 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:07.894235 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:07.896655 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:07.896669 6226 round_trippers.go:577] Response Headers:
I0222 20:45:07.896676 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:07.896683 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:07.896689 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:07.896696 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:07.896704 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:08 GMT
I0222 20:45:07.896713 6226 round_trippers.go:580] Audit-Id: eff4222b-6e0b-46cc-9ee0-6d738200e195
I0222 20:45:07.897019 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-qmsbf","generateName":"kube-proxy-","namespace":"kube-system","uid":"98395ed9-2055-48e0-8d84-b931dfc0d9c7","resourceVersion":"928","creationTimestamp":"2023-02-23T04:41:26Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:41:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5750 chars]
I0222 20:45:08.092607 6226 request.go:622] Waited for 195.249412ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:08.092664 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:08.092675 6226 round_trippers.go:469] Request Headers:
I0222 20:45:08.092739 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:08.092753 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:08.095387 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:08.095403 6226 round_trippers.go:577] Response Headers:
I0222 20:45:08.095410 6226 round_trippers.go:580] Audit-Id: fce5b8f3-b008-43b7-9608-f8d52e2cf740
I0222 20:45:08.095419 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:08.095431 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:08.095454 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:08.095468 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:08.095475 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:08 GMT
I0222 20:45:08.095587 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"941","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{
}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 4618 chars]
I0222 20:45:08.095823 6226 pod_ready.go:92] pod "kube-proxy-qmsbf" in "kube-system" namespace has status "Ready":"True"
I0222 20:45:08.095831 6226 pod_ready.go:81] duration metric: took 400.738052ms waiting for pod "kube-proxy-qmsbf" in "kube-system" namespace to be "Ready" ...
I0222 20:45:08.095840 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:08.293697 6226 request.go:622] Waited for 197.819416ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-293000
I0222 20:45:08.293757 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-293000
I0222 20:45:08.293769 6226 round_trippers.go:469] Request Headers:
I0222 20:45:08.293783 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:08.293794 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:08.296459 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:08.296473 6226 round_trippers.go:577] Response Headers:
I0222 20:45:08.296481 6226 round_trippers.go:580] Audit-Id: 33423e76-7c35-46d8-8a30-2163e85c79c3
I0222 20:45:08.296488 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:08.296495 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:08.296509 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:08.296516 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:08.296523 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:08 GMT
I0222 20:45:08.296665 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-scheduler-multinode-293000","namespace":"kube-system","uid":"deb74301-35df-47d1-a8a9-f59943186666","resourceVersion":"772","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-scheduler","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"ef6d7c628504525048f2a505fc91f554","kubernetes.io/config.mirror":"ef6d7c628504525048f2a505fc91f554","kubernetes.io/config.seen":"2023-02-23T04:40:26.073159188Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.io/config.seen":{},
"f:kubernetes.io/config.source":{}},"f:labels":{".":{},"f:component":{} [truncated 4888 chars]
I0222 20:45:08.492581 6226 request.go:622] Waited for 195.581412ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:08.492675 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:08.492686 6226 round_trippers.go:469] Request Headers:
I0222 20:45:08.492698 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:08.492709 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:08.495609 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:08.495626 6226 round_trippers.go:577] Response Headers:
I0222 20:45:08.495637 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:08.495646 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:08 GMT
I0222 20:45:08.495661 6226 round_trippers.go:580] Audit-Id: 3b238647-1e00-469b-a710-8236ebc0475a
I0222 20:45:08.495668 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:08.495674 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:08.495680 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:08.495757 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:45:08.496016 6226 pod_ready.go:92] pod "kube-scheduler-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:45:08.496026 6226 pod_ready.go:81] duration metric: took 400.185846ms waiting for pod "kube-scheduler-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:08.496035 6226 pod_ready.go:38] duration metric: took 1.602138604s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0222 20:45:08.496047 6226 system_svc.go:44] waiting for kubelet service to be running ....
I0222 20:45:08.496123 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0222 20:45:08.504968 6226 system_svc.go:56] duration metric: took 8.916927ms WaitForService to wait for kubelet.
I0222 20:45:08.504981 6226 kubeadm.go:578] duration metric: took 5.691039142s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
I0222 20:45:08.504998 6226 node_conditions.go:102] verifying NodePressure condition ...
I0222 20:45:08.693034 6226 request.go:622] Waited for 187.98291ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes
I0222 20:45:08.693150 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes
I0222 20:45:08.693173 6226 round_trippers.go:469] Request Headers:
I0222 20:45:08.693189 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:08.693215 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:08.696210 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:08.696228 6226 round_trippers.go:577] Response Headers:
I0222 20:45:08.696240 6226 round_trippers.go:580] Audit-Id: 35840ac1-9bc6-4a0b-9cac-4ccbe32d3b4c
I0222 20:45:08.696248 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:08.696260 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:08.696270 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:08.696281 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:08.696293 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:08 GMT
I0222 20:45:08.696739 6226 request.go:1171] Response Body: {"kind":"NodeList","apiVersion":"v1","metadata":{"resourceVersion":"945"},"items":[{"metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFiel
ds":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time" [truncated 16972 chars]
I0222 20:45:08.697330 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:45:08.697343 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:45:08.697352 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:45:08.697358 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:45:08.697365 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:45:08.697370 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:45:08.697375 6226 node_conditions.go:105] duration metric: took 192.375598ms to run NodePressure ...
I0222 20:45:08.697386 6226 start.go:228] waiting for startup goroutines ...
I0222 20:45:08.697407 6226 start.go:242] writing updated cluster config ...
I0222 20:45:08.698115 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:45:08.698183 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:45:08.741951 6226 out.go:177] * Starting worker node multinode-293000-m03 in cluster multinode-293000
I0222 20:45:08.763724 6226 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0222 20:45:08.763769 6226 cache.go:57] Caching tarball of preloaded images
I0222 20:45:08.763864 6226 preload.go:174] Found /Users/jenkins/minikube-integration/15909-2565/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0222 20:45:08.763874 6226 cache.go:60] Finished verifying existence of preloaded tar for v1.26.1 on docker
I0222 20:45:08.763958 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:45:08.764499 6226 cache.go:193] Successfully downloaded all kic artifacts
I0222 20:45:08.764514 6226 start.go:364] acquiring machines lock for multinode-293000-m03: {Name:mk88cf87535f73dae2b0686647d170168e328899 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0222 20:45:08.764560 6226 start.go:368] acquired machines lock for "multinode-293000-m03" in 33.016µs
I0222 20:45:08.764576 6226 start.go:96] Skipping create...Using existing machine configuration
I0222 20:45:08.764581 6226 fix.go:55] fixHost starting: m03
I0222 20:45:08.764812 6226 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0222 20:45:08.764832 6226 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0222 20:45:08.771823 6226 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51554
I0222 20:45:08.772173 6226 main.go:141] libmachine: () Calling .GetVersion
I0222 20:45:08.772542 6226 main.go:141] libmachine: Using API Version 1
I0222 20:45:08.772561 6226 main.go:141] libmachine: () Calling .SetConfigRaw
I0222 20:45:08.772765 6226 main.go:141] libmachine: () Calling .GetMachineName
I0222 20:45:08.772885 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:08.772968 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetState
I0222 20:45:08.773055 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:45:08.773147 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | hyperkit pid from json: 6146
I0222 20:45:08.774001 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | hyperkit pid 6146 missing from process table
I0222 20:45:08.774035 6226 fix.go:103] recreateIfNeeded on multinode-293000-m03: state=Stopped err=<nil>
I0222 20:45:08.774046 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
W0222 20:45:08.774125 6226 fix.go:129] unexpected machine state, will restart: <nil>
I0222 20:45:08.796003 6226 out.go:177] * Restarting existing hyperkit VM for "multinode-293000-m03" ...
I0222 20:45:08.837919 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .Start
I0222 20:45:08.838206 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:45:08.838262 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/hyperkit.pid
I0222 20:45:08.838338 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | Using UUID 63b17e68-b334-11ed-87a5-149d997fca88
I0222 20:45:08.866674 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | Generated MAC 66:3a:f:a5:79:1d
I0222 20:45:08.866696 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000
I0222 20:45:08.866830 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"63b17e68-b334-11ed-87a5-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0002c7650)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/bzimage", Initrd:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""
, process:(*os.Process)(nil)}
I0222 20:45:08.866871 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"63b17e68-b334-11ed-87a5-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0002c7650)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/bzimage", Initrd:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""
, process:(*os.Process)(nil)}
I0222 20:45:08.866948 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "63b17e68-b334-11ed-87a5-149d997fca88", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/multinode-293000-m03.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/tty,log=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/bzimage,/Users/j
enkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000"}
I0222 20:45:08.867044 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U 63b17e68-b334-11ed-87a5-149d997fca88 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/multinode-293000-m03.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/tty,log=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/console-ring -f kexec,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/bzimage,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/mult
inode-293000-m03/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000"
I0222 20:45:08.867060 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 DEBUG: hyperkit: Redirecting stdout/stderr to logger
I0222 20:45:08.868195 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 DEBUG: hyperkit: Pid is 6359
I0222 20:45:08.868535 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | Attempt 0
I0222 20:45:08.868546 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:45:08.868636 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | hyperkit pid from json: 6359
I0222 20:45:08.869569 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | Searching for 66:3a:f:a5:79:1d in /var/db/dhcpd_leases ...
I0222 20:45:08.869624 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | Found 13 entries in /var/db/dhcpd_leases!
I0222 20:45:08.869636 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.13 HWAddress:f6:5a:53:47:16:21 ID:1,f6:5a:53:47:16:21 Lease:0x63f840aa}
I0222 20:45:08.869645 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.12 HWAddress:8e:8:26:1e:84:48 ID:1,8e:8:26:1e:84:48 Lease:0x63f84076}
I0222 20:45:08.869656 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.14 HWAddress:66:3a:f:a5:79:1d ID:1,66:3a:f:a5:79:1d Lease:0x63f6eeed}
I0222 20:45:08.869675 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | Found match: 66:3a:f:a5:79:1d
I0222 20:45:08.869687 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | IP: 192.168.64.14
I0222 20:45:08.869717 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetConfigRaw
I0222 20:45:08.870387 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetIP
I0222 20:45:08.870565 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:45:08.870883 6226 machine.go:88] provisioning docker machine ...
I0222 20:45:08.870893 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:08.870993 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetMachineName
I0222 20:45:08.871074 6226 buildroot.go:166] provisioning hostname "multinode-293000-m03"
I0222 20:45:08.871084 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetMachineName
I0222 20:45:08.871170 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:08.871259 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:08.871337 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:08.871412 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:08.871485 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:08.871589 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:45:08.871910 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.14 22 <nil> <nil>}
I0222 20:45:08.871920 6226 main.go:141] libmachine: About to run SSH command:
sudo hostname multinode-293000-m03 && echo "multinode-293000-m03" | sudo tee /etc/hostname
I0222 20:45:08.874682 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 INFO : hyperkit: stderr: Using fd 5 for I/O notifications
I0222 20:45:08.882216 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD
I0222 20:45:08.882943 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I0222 20:45:08.882954 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I0222 20:45:08.882964 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I0222 20:45:08.882971 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I0222 20:45:09.245825 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0
I0222 20:45:09.245841 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0
I0222 20:45:09.349892 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I0222 20:45:09.349919 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I0222 20:45:09.349935 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I0222 20:45:09.349945 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I0222 20:45:09.350754 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1
I0222 20:45:09.350764 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1
I0222 20:45:13.874057 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:13 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1
I0222 20:45:13.874092 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:13 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1
I0222 20:45:13.874100 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:13 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1
I0222 20:45:16.782770 6226 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.64.14:22: connect: connection refused
I0222 20:45:19.855607 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-293000-m03
I0222 20:45:19.855625 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:19.855757 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:19.855856 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:19.855947 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:19.856055 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:19.856191 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:45:19.856504 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.14 22 <nil> <nil>}
I0222 20:45:19.856517 6226 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smultinode-293000-m03' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-293000-m03/g' /etc/hosts;
else
echo '127.0.1.1 multinode-293000-m03' | sudo tee -a /etc/hosts;
fi
fi
I0222 20:45:19.923607 6226 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0222 20:45:19.923624 6226 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/15909-2565/.minikube CaCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15909-2565/.minikube}
I0222 20:45:19.923631 6226 buildroot.go:174] setting up certificates
I0222 20:45:19.923636 6226 provision.go:83] configureAuth start
I0222 20:45:19.923642 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetMachineName
I0222 20:45:19.923790 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetIP
I0222 20:45:19.923876 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:19.923963 6226 provision.go:138] copyHostCerts
I0222 20:45:19.924000 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem
I0222 20:45:19.924049 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem, removing ...
I0222 20:45:19.924058 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem
I0222 20:45:19.924203 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem (1082 bytes)
I0222 20:45:19.924364 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem
I0222 20:45:19.924402 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem, removing ...
I0222 20:45:19.924407 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem
I0222 20:45:19.924463 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem (1123 bytes)
I0222 20:45:19.924584 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem
I0222 20:45:19.924613 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem, removing ...
I0222 20:45:19.924618 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem
I0222 20:45:19.924675 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem (1679 bytes)
I0222 20:45:19.924795 6226 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem org=jenkins.multinode-293000-m03 san=[192.168.64.14 192.168.64.14 localhost 127.0.0.1 minikube multinode-293000-m03]
I0222 20:45:20.004242 6226 provision.go:172] copyRemoteCerts
I0222 20:45:20.004287 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0222 20:45:20.004304 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:20.004458 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.004551 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.004638 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.004722 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.14 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/id_rsa Username:docker}
I0222 20:45:20.042897 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0222 20:45:20.042968 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0222 20:45:20.058658 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem -> /etc/docker/server.pem
I0222 20:45:20.058717 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem --> /etc/docker/server.pem (1237 bytes)
I0222 20:45:20.074291 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0222 20:45:20.074355 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0222 20:45:20.089809 6226 provision.go:86] duration metric: configureAuth took 166.169671ms
I0222 20:45:20.089822 6226 buildroot.go:189] setting minikube options for container-runtime
I0222 20:45:20.090008 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:45:20.090022 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:20.090151 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:20.090266 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.090372 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.090459 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.090538 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.090652 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:45:20.090949 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.14 22 <nil> <nil>}
I0222 20:45:20.090957 6226 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0222 20:45:20.153395 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I0222 20:45:20.153407 6226 buildroot.go:70] root file system type: tmpfs
I0222 20:45:20.153484 6226 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0222 20:45:20.153496 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:20.153618 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.153723 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.153807 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.153911 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.154051 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:45:20.154367 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.14 22 <nil> <nil>}
I0222 20:45:20.154412 6226 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
Environment="NO_PROXY=192.168.64.12"
Environment="NO_PROXY=192.168.64.12,192.168.64.13"
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0222 20:45:20.224832 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
Environment=NO_PROXY=192.168.64.12
Environment=NO_PROXY=192.168.64.12,192.168.64.13
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0222 20:45:20.224851 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:20.224987 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.225084 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.225177 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.225262 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.225391 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:45:20.225703 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.14 22 <nil> <nil>}
I0222 20:45:20.225715 6226 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0222 20:45:20.732412 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I0222 20:45:20.732430 6226 machine.go:91] provisioned docker machine in 11.861754679s
I0222 20:45:20.732437 6226 start.go:300] post-start starting for "multinode-293000-m03" (driver="hyperkit")
I0222 20:45:20.732452 6226 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0222 20:45:20.732468 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:20.732657 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0222 20:45:20.732672 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:20.732766 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.732873 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.732953 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.733035 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.14 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/id_rsa Username:docker}
I0222 20:45:20.770518 6226 ssh_runner.go:195] Run: cat /etc/os-release
I0222 20:45:20.772819 6226 command_runner.go:130] > NAME=Buildroot
I0222 20:45:20.772827 6226 command_runner.go:130] > VERSION=2021.02.12-1-g41e8300-dirty
I0222 20:45:20.772831 6226 command_runner.go:130] > ID=buildroot
I0222 20:45:20.772837 6226 command_runner.go:130] > VERSION_ID=2021.02.12
I0222 20:45:20.772842 6226 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"
I0222 20:45:20.773060 6226 info.go:137] Remote host: Buildroot 2021.02.12
I0222 20:45:20.773070 6226 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15909-2565/.minikube/addons for local assets ...
I0222 20:45:20.773150 6226 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15909-2565/.minikube/files for local assets ...
I0222 20:45:20.773294 6226 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> 30412.pem in /etc/ssl/certs
I0222 20:45:20.773301 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> /etc/ssl/certs/30412.pem
I0222 20:45:20.773462 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0222 20:45:20.778996 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem --> /etc/ssl/certs/30412.pem (1708 bytes)
I0222 20:45:20.794906 6226 start.go:303] post-start completed in 62.454223ms
I0222 20:45:20.794916 6226 fix.go:57] fixHost completed within 12.030553709s
I0222 20:45:20.794928 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:20.795057 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.795151 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.795231 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.795308 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.795422 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:45:20.795730 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.14 22 <nil> <nil>}
I0222 20:45:20.795738 6226 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0222 20:45:20.857423 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: 1677127520.731422810
I0222 20:45:20.857435 6226 fix.go:207] guest clock: 1677127520.731422810
I0222 20:45:20.857441 6226 fix.go:220] Guest: 2023-02-22 20:45:20.73142281 -0800 PST Remote: 2023-02-22 20:45:20.794918 -0800 PST m=+114.260712075 (delta=-63.49519ms)
I0222 20:45:20.857450 6226 fix.go:191] guest clock delta is within tolerance: -63.49519ms
I0222 20:45:20.857454 6226 start.go:83] releasing machines lock for "multinode-293000-m03", held for 12.093107673s
I0222 20:45:20.857473 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:20.857598 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetIP
I0222 20:45:20.880215 6226 out.go:177] * Found network options:
I0222 20:45:20.902155 6226 out.go:177] - NO_PROXY=192.168.64.12,192.168.64.13
W0222 20:45:20.924180 6226 proxy.go:119] fail to check proxy env: Error ip not in block
W0222 20:45:20.924222 6226 proxy.go:119] fail to check proxy env: Error ip not in block
I0222 20:45:20.924242 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:20.925119 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:20.925340 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:20.925485 6226 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0222 20:45:20.925525 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
W0222 20:45:20.925551 6226 proxy.go:119] fail to check proxy env: Error ip not in block
W0222 20:45:20.925574 6226 proxy.go:119] fail to check proxy env: Error ip not in block
I0222 20:45:20.925697 6226 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0222 20:45:20.925724 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:20.925831 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.925962 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.926084 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.926178 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.926294 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.926351 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.926507 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.14 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/id_rsa Username:docker}
I0222 20:45:20.926541 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.14 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/id_rsa Username:docker}
I0222 20:45:20.962222 6226 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory
W0222 20:45:20.962245 6226 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0222 20:45:20.962290 6226 ssh_runner.go:195] Run: which cri-dockerd
I0222 20:45:20.999990 6226 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.
I0222 20:45:21.000458 6226 command_runner.go:130] > /usr/bin/cri-dockerd
I0222 20:45:21.000559 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0222 20:45:21.006362 6226 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (135 bytes)
I0222 20:45:21.017458 6226 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0222 20:45:21.027003 6226 command_runner.go:139] > /etc/cni/net.d/87-podman-bridge.conflist,
I0222 20:45:21.027031 6226 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0222 20:45:21.027038 6226 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0222 20:45:21.027122 6226 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0222 20:45:21.042804 6226 command_runner.go:130] > registry.k8s.io/kube-apiserver:v1.26.1
I0222 20:45:21.042817 6226 command_runner.go:130] > registry.k8s.io/kube-controller-manager:v1.26.1
I0222 20:45:21.042822 6226 command_runner.go:130] > registry.k8s.io/kube-scheduler:v1.26.1
I0222 20:45:21.042826 6226 command_runner.go:130] > registry.k8s.io/kube-proxy:v1.26.1
I0222 20:45:21.042836 6226 command_runner.go:130] > registry.k8s.io/etcd:3.5.6-0
I0222 20:45:21.042842 6226 command_runner.go:130] > registry.k8s.io/pause:3.9
I0222 20:45:21.042847 6226 command_runner.go:130] > kindest/kindnetd:v20221004-44d545d1
I0222 20:45:21.042852 6226 command_runner.go:130] > registry.k8s.io/coredns/coredns:v1.9.3
I0222 20:45:21.042855 6226 command_runner.go:130] > registry.k8s.io/pause:3.6
I0222 20:45:21.042872 6226 command_runner.go:130] > gcr.io/k8s-minikube/storage-provisioner:v5
I0222 20:45:21.043818 6226 docker.go:630] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.26.1
registry.k8s.io/kube-controller-manager:v1.26.1
registry.k8s.io/kube-scheduler:v1.26.1
registry.k8s.io/kube-proxy:v1.26.1
registry.k8s.io/etcd:3.5.6-0
registry.k8s.io/pause:3.9
kindest/kindnetd:v20221004-44d545d1
registry.k8s.io/coredns/coredns:v1.9.3
registry.k8s.io/pause:3.6
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0222 20:45:21.043829 6226 docker.go:560] Images already preloaded, skipping extraction
I0222 20:45:21.043834 6226 start.go:485] detecting cgroup driver to use...
I0222 20:45:21.043904 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
image-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0222 20:45:21.063989 6226 command_runner.go:130] > runtime-endpoint: unix:///run/containerd/containerd.sock
I0222 20:45:21.064002 6226 command_runner.go:130] > image-endpoint: unix:///run/containerd/containerd.sock
I0222 20:45:21.064389 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0222 20:45:21.071737 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0222 20:45:21.079115 6226 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I0222 20:45:21.079181 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0222 20:45:21.089062 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0222 20:45:21.100610 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0222 20:45:21.110994 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0222 20:45:21.118130 6226 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0222 20:45:21.124560 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0222 20:45:21.131048 6226 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0222 20:45:21.136924 6226 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1
I0222 20:45:21.137062 6226 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0222 20:45:21.142754 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:45:21.226342 6226 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0222 20:45:21.238824 6226 start.go:485] detecting cgroup driver to use...
I0222 20:45:21.238904 6226 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0222 20:45:21.259355 6226 command_runner.go:130] > # /usr/lib/systemd/system/docker.service
I0222 20:45:21.260057 6226 command_runner.go:130] > [Unit]
I0222 20:45:21.260066 6226 command_runner.go:130] > Description=Docker Application Container Engine
I0222 20:45:21.260073 6226 command_runner.go:130] > Documentation=https://docs.docker.com
I0222 20:45:21.260078 6226 command_runner.go:130] > After=network.target minikube-automount.service docker.socket
I0222 20:45:21.260083 6226 command_runner.go:130] > Requires= minikube-automount.service docker.socket
I0222 20:45:21.260090 6226 command_runner.go:130] > StartLimitBurst=3
I0222 20:45:21.260094 6226 command_runner.go:130] > StartLimitIntervalSec=60
I0222 20:45:21.260099 6226 command_runner.go:130] > [Service]
I0222 20:45:21.260103 6226 command_runner.go:130] > Type=notify
I0222 20:45:21.260107 6226 command_runner.go:130] > Restart=on-failure
I0222 20:45:21.260111 6226 command_runner.go:130] > Environment=NO_PROXY=192.168.64.12
I0222 20:45:21.260115 6226 command_runner.go:130] > Environment=NO_PROXY=192.168.64.12,192.168.64.13
I0222 20:45:21.260125 6226 command_runner.go:130] > # This file is a systemd drop-in unit that inherits from the base dockerd configuration.
I0222 20:45:21.260133 6226 command_runner.go:130] > # The base configuration already specifies an 'ExecStart=...' command. The first directive
I0222 20:45:21.260138 6226 command_runner.go:130] > # here is to clear out that command inherited from the base configuration. Without this,
I0222 20:45:21.260144 6226 command_runner.go:130] > # the command from the base configuration and the command specified here are treated as
I0222 20:45:21.260150 6226 command_runner.go:130] > # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
I0222 20:45:21.260156 6226 command_runner.go:130] > # will catch this invalid input and refuse to start the service with an error like:
I0222 20:45:21.260169 6226 command_runner.go:130] > # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
I0222 20:45:21.260177 6226 command_runner.go:130] > # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
I0222 20:45:21.260186 6226 command_runner.go:130] > # container runtimes. If left unlimited, it may result in OOM issues with MySQL.
I0222 20:45:21.260190 6226 command_runner.go:130] > ExecStart=
I0222 20:45:21.260203 6226 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
I0222 20:45:21.260210 6226 command_runner.go:130] > ExecReload=/bin/kill -s HUP $MAINPID
I0222 20:45:21.260215 6226 command_runner.go:130] > # Having non-zero Limit*s causes performance problems due to accounting overhead
I0222 20:45:21.260221 6226 command_runner.go:130] > # in the kernel. We recommend using cgroups to do container-local accounting.
I0222 20:45:21.260225 6226 command_runner.go:130] > LimitNOFILE=infinity
I0222 20:45:21.260232 6226 command_runner.go:130] > LimitNPROC=infinity
I0222 20:45:21.260236 6226 command_runner.go:130] > LimitCORE=infinity
I0222 20:45:21.260241 6226 command_runner.go:130] > # Uncomment TasksMax if your systemd version supports it.
I0222 20:45:21.260245 6226 command_runner.go:130] > # Only systemd 226 and above support this version.
I0222 20:45:21.260248 6226 command_runner.go:130] > TasksMax=infinity
I0222 20:45:21.260252 6226 command_runner.go:130] > TimeoutStartSec=0
I0222 20:45:21.260257 6226 command_runner.go:130] > # set delegate yes so that systemd does not reset the cgroups of docker containers
I0222 20:45:21.260261 6226 command_runner.go:130] > Delegate=yes
I0222 20:45:21.260271 6226 command_runner.go:130] > # kill only the docker process, not all processes in the cgroup
I0222 20:45:21.260275 6226 command_runner.go:130] > KillMode=process
I0222 20:45:21.260278 6226 command_runner.go:130] > [Install]
I0222 20:45:21.260282 6226 command_runner.go:130] > WantedBy=multi-user.target
I0222 20:45:21.260557 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0222 20:45:21.272348 6226 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0222 20:45:21.287341 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0222 20:45:21.296390 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0222 20:45:21.304619 6226 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0222 20:45:21.329294 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0222 20:45:21.338036 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
image-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0222 20:45:21.349887 6226 command_runner.go:130] > runtime-endpoint: unix:///var/run/cri-dockerd.sock
I0222 20:45:21.349901 6226 command_runner.go:130] > image-endpoint: unix:///var/run/cri-dockerd.sock
I0222 20:45:21.350226 6226 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0222 20:45:21.436177 6226 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0222 20:45:21.525894 6226 docker.go:529] configuring docker to use "cgroupfs" as cgroup driver...
I0222 20:45:21.525910 6226 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
I0222 20:45:21.538086 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:45:21.633720 6226 ssh_runner.go:195] Run: sudo systemctl restart docker
I0222 20:46:22.452405 6226 command_runner.go:130] ! Job for docker.service failed because the control process exited with error code.
I0222 20:46:22.452419 6226 command_runner.go:130] ! See "systemctl status docker.service" and "journalctl -xe" for details.
I0222 20:46:22.452428 6226 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1m0.816571721s)
I0222 20:46:22.490645 6226 out.go:177]
W0222 20:46:22.512302 6226 out.go:239] X Exiting due to RUNTIME_ENABLE: sudo systemctl restart docker: Process exited with status 1
stdout:
stderr:
Job for docker.service failed because the control process exited with error code.
See "systemctl status docker.service" and "journalctl -xe" for details.
X Exiting due to RUNTIME_ENABLE: sudo systemctl restart docker: Process exited with status 1
stdout:
stderr:
Job for docker.service failed because the control process exited with error code.
See "systemctl status docker.service" and "journalctl -xe" for details.
W0222 20:46:22.512331 6226 out.go:239] *
*
W0222 20:46:22.513584 6226 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0222 20:46:22.599050 6226 out.go:177]
** /stderr **
multinode_test.go:295: failed to run minikube start. args "out/minikube-darwin-amd64 node list -p multinode-293000" : exit status 90
multinode_test.go:298: (dbg) Run: out/minikube-darwin-amd64 node list -p multinode-293000
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-293000 -n multinode-293000
helpers_test.go:244: <<< TestMultiNode/serial/RestartKeepsNodes FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestMultiNode/serial/RestartKeepsNodes]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-darwin-amd64 -p multinode-293000 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-darwin-amd64 -p multinode-293000 logs -n 25: (3.007077264s)
helpers_test.go:252: TestMultiNode/serial/RestartKeepsNodes logs:
-- stdout --
*
* ==> Audit <==
* |---------|-----------------------------------------------------------------------------------------------------------------------------|------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|-----------------------------------------------------------------------------------------------------------------------------|------------------|---------|---------|---------------------|---------------------|
| ssh | multinode-293000 ssh -n | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | multinode-293000-m02 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | multinode-293000 cp multinode-293000-m02:/home/docker/cp-test.txt | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestMultiNodeserialCopyFile2283267355/001/cp-test_multinode-293000-m02.txt | | | | | |
| ssh | multinode-293000 ssh -n | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | multinode-293000-m02 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | multinode-293000 cp multinode-293000-m02:/home/docker/cp-test.txt | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | multinode-293000:/home/docker/cp-test_multinode-293000-m02_multinode-293000.txt | | | | | |
| ssh | multinode-293000 ssh -n | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | multinode-293000-m02 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | multinode-293000 ssh -n multinode-293000 sudo cat | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | /home/docker/cp-test_multinode-293000-m02_multinode-293000.txt | | | | | |
| cp | multinode-293000 cp multinode-293000-m02:/home/docker/cp-test.txt | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | multinode-293000-m03:/home/docker/cp-test_multinode-293000-m02_multinode-293000-m03.txt | | | | | |
| ssh | multinode-293000 ssh -n | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | multinode-293000-m02 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | multinode-293000 ssh -n multinode-293000-m03 sudo cat | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | /home/docker/cp-test_multinode-293000-m02_multinode-293000-m03.txt | | | | | |
| cp | multinode-293000 cp testdata/cp-test.txt | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | multinode-293000-m03:/home/docker/cp-test.txt | | | | | |
| ssh | multinode-293000 ssh -n | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | multinode-293000-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | multinode-293000 cp multinode-293000-m03:/home/docker/cp-test.txt | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestMultiNodeserialCopyFile2283267355/001/cp-test_multinode-293000-m03.txt | | | | | |
| ssh | multinode-293000 ssh -n | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | multinode-293000-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| cp | multinode-293000 cp multinode-293000-m03:/home/docker/cp-test.txt | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | multinode-293000:/home/docker/cp-test_multinode-293000-m03_multinode-293000.txt | | | | | |
| ssh | multinode-293000 ssh -n | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | multinode-293000-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | multinode-293000 ssh -n multinode-293000 sudo cat | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | /home/docker/cp-test_multinode-293000-m03_multinode-293000.txt | | | | | |
| cp | multinode-293000 cp multinode-293000-m03:/home/docker/cp-test.txt | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | multinode-293000-m02:/home/docker/cp-test_multinode-293000-m03_multinode-293000-m02.txt | | | | | |
| ssh | multinode-293000 ssh -n | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | multinode-293000-m03 sudo cat | | | | | |
| | /home/docker/cp-test.txt | | | | | |
| ssh | multinode-293000 ssh -n multinode-293000-m02 sudo cat | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| | /home/docker/cp-test_multinode-293000-m03_multinode-293000-m02.txt | | | | | |
| node | multinode-293000 node stop m03 | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:42 PST |
| node | multinode-293000 node start | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:42 PST | 22 Feb 23 20:43 PST |
| | m03 --alsologtostderr | | | | | |
| node | list -p multinode-293000 | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:43 PST | |
| stop | -p multinode-293000 | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:43 PST | 22 Feb 23 20:43 PST |
| start | -p multinode-293000 | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:43 PST | |
| | --wait=true -v=8 | | | | | |
| | --alsologtostderr | | | | | |
| node | list -p multinode-293000 | multinode-293000 | jenkins | v1.29.0 | 22 Feb 23 20:46 PST | |
|---------|-----------------------------------------------------------------------------------------------------------------------------|------------------|---------|---------|---------------------|---------------------|
*
* ==> Last Start <==
* Log file created at: 2023/02/22 20:43:26
Running on machine: MacOS-Agent-4
Binary: Built with gc go1.20.1 for darwin/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0222 20:43:26.571790 6226 out.go:296] Setting OutFile to fd 1 ...
I0222 20:43:26.572506 6226 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0222 20:43:26.572514 6226 out.go:309] Setting ErrFile to fd 2...
I0222 20:43:26.572519 6226 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0222 20:43:26.572724 6226 root.go:336] Updating PATH: /Users/jenkins/minikube-integration/15909-2565/.minikube/bin
I0222 20:43:26.574408 6226 out.go:303] Setting JSON to false
I0222 20:43:26.595005 6226 start.go:125] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2580,"bootTime":1677124826,"procs":398,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.2","kernelVersion":"22.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
W0222 20:43:26.595103 6226 start.go:133] gopshost.Virtualization returned error: not implemented yet
I0222 20:43:26.616534 6226 out.go:177] * [multinode-293000] minikube v1.29.0 on Darwin 13.2
I0222 20:43:26.660552 6226 notify.go:220] Checking for updates...
I0222 20:43:26.660585 6226 out.go:177] - MINIKUBE_LOCATION=15909
I0222 20:43:26.682586 6226 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:43:26.704372 6226 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I0222 20:43:26.726540 6226 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0222 20:43:26.748401 6226 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/15909-2565/.minikube
I0222 20:43:26.790331 6226 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0222 20:43:26.812189 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:43:26.812281 6226 driver.go:365] Setting default libvirt URI to qemu:///system
I0222 20:43:26.812952 6226 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0222 20:43:26.813047 6226 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0222 20:43:26.820505 6226 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51502
I0222 20:43:26.820870 6226 main.go:141] libmachine: () Calling .GetVersion
I0222 20:43:26.821299 6226 main.go:141] libmachine: Using API Version 1
I0222 20:43:26.821310 6226 main.go:141] libmachine: () Calling .SetConfigRaw
I0222 20:43:26.821516 6226 main.go:141] libmachine: () Calling .GetMachineName
I0222 20:43:26.821625 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:26.849111 6226 out.go:177] * Using the hyperkit driver based on existing profile
I0222 20:43:26.892321 6226 start.go:296] selected driver: hyperkit
I0222 20:43:26.892350 6226 start.go:857] validating driver "hyperkit" against &{Name:multinode-293000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15849/minikube-v1.29.0-1676568791-15849-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete
sConfig:{KubernetesVersion:v1.26.1 ClusterName:multinode-293000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.12 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.64.14 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false
inaccel:false ingress:false ingress-dns:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath
: SocketVMnetPath: StaticIP:}
I0222 20:43:26.892545 6226 start.go:868] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0222 20:43:26.892650 6226 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0222 20:43:26.892856 6226 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/15909-2565/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
I0222 20:43:26.900688 6226 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.29.0
I0222 20:43:26.904982 6226 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0222 20:43:26.904998 6226 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
I0222 20:43:26.907798 6226 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0222 20:43:26.907833 6226 cni.go:84] Creating CNI manager for ""
I0222 20:43:26.907842 6226 cni.go:136] 3 nodes found, recommending kindnet
I0222 20:43:26.907852 6226 start_flags.go:319] config:
{Name:multinode-293000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15849/minikube-v1.29.0-1676568791-15849-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.26.1 ClusterName:multinode-293000 Namespace:default
APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.12 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.64.14 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false istio:false istio-provisioner:false
kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:}
I0222 20:43:26.907989 6226 iso.go:125] acquiring lock: {Name:mk3854eabdabf4511fd5a0e2c749dfea43fa973a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0222 20:43:26.951255 6226 out.go:177] * Starting control plane node multinode-293000 in cluster multinode-293000
I0222 20:43:26.972438 6226 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0222 20:43:26.972592 6226 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/15909-2565/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4
I0222 20:43:26.972620 6226 cache.go:57] Caching tarball of preloaded images
I0222 20:43:26.972801 6226 preload.go:174] Found /Users/jenkins/minikube-integration/15909-2565/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0222 20:43:26.972819 6226 cache.go:60] Finished verifying existence of preloaded tar for v1.26.1 on docker
I0222 20:43:26.973021 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:43:26.973745 6226 cache.go:193] Successfully downloaded all kic artifacts
I0222 20:43:26.973793 6226 start.go:364] acquiring machines lock for multinode-293000: {Name:mk88cf87535f73dae2b0686647d170168e328899 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0222 20:43:26.973920 6226 start.go:368] acquired machines lock for "multinode-293000" in 108.426µs
I0222 20:43:26.973959 6226 start.go:96] Skipping create...Using existing machine configuration
I0222 20:43:26.973971 6226 fix.go:55] fixHost starting:
I0222 20:43:26.974413 6226 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0222 20:43:26.974452 6226 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0222 20:43:26.981789 6226 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51504
I0222 20:43:26.982126 6226 main.go:141] libmachine: () Calling .GetVersion
I0222 20:43:26.982531 6226 main.go:141] libmachine: Using API Version 1
I0222 20:43:26.982551 6226 main.go:141] libmachine: () Calling .SetConfigRaw
I0222 20:43:26.982808 6226 main.go:141] libmachine: () Calling .GetMachineName
I0222 20:43:26.982930 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:26.983032 6226 main.go:141] libmachine: (multinode-293000) Calling .GetState
I0222 20:43:26.983110 6226 main.go:141] libmachine: (multinode-293000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:43:26.983183 6226 main.go:141] libmachine: (multinode-293000) DBG | hyperkit pid from json: 5686
I0222 20:43:26.984025 6226 main.go:141] libmachine: (multinode-293000) DBG | hyperkit pid 5686 missing from process table
I0222 20:43:26.984069 6226 fix.go:103] recreateIfNeeded on multinode-293000: state=Stopped err=<nil>
I0222 20:43:26.984087 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
W0222 20:43:26.984164 6226 fix.go:129] unexpected machine state, will restart: <nil>
I0222 20:43:27.026377 6226 out.go:177] * Restarting existing hyperkit VM for "multinode-293000" ...
I0222 20:43:27.047429 6226 main.go:141] libmachine: (multinode-293000) Calling .Start
I0222 20:43:27.047715 6226 main.go:141] libmachine: (multinode-293000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:43:27.047767 6226 main.go:141] libmachine: (multinode-293000) minikube might have been shutdown in an unclean way, the hyperkit pid file still exists: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/hyperkit.pid
I0222 20:43:27.049816 6226 main.go:141] libmachine: (multinode-293000) DBG | hyperkit pid 5686 missing from process table
I0222 20:43:27.049829 6226 main.go:141] libmachine: (multinode-293000) DBG | pid 5686 is in state "Stopped"
I0222 20:43:27.049860 6226 main.go:141] libmachine: (multinode-293000) DBG | Removing stale pid file /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/hyperkit.pid...
I0222 20:43:27.050116 6226 main.go:141] libmachine: (multinode-293000) DBG | Using UUID 1ad0122c-b334-11ed-affa-149d997fca88
I0222 20:43:27.160146 6226 main.go:141] libmachine: (multinode-293000) DBG | Generated MAC 8e:8:26:1e:84:48
I0222 20:43:27.160178 6226 main.go:141] libmachine: (multinode-293000) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000
I0222 20:43:27.160305 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"1ad0122c-b334-11ed-affa-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0004a1f20)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/bzimage", Initrd:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Proce
ss)(nil)}
I0222 20:43:27.160332 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"1ad0122c-b334-11ed-affa-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0004a1f20)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/bzimage", Initrd:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Proce
ss)(nil)}
I0222 20:43:27.160427 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "1ad0122c-b334-11ed-affa-149d997fca88", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/multinode-293000.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/tty,log=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/bzimage,/Users/jenkins/minikube-integration/1590
9-2565/.minikube/machines/multinode-293000/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000"}
I0222 20:43:27.160488 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U 1ad0122c-b334-11ed-affa-149d997fca88 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/multinode-293000.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/tty,log=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/console-ring -f kexec,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/bzimage,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/initrd,earlyprintk=
serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000"
I0222 20:43:27.160505 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 DEBUG: hyperkit: Redirecting stdout/stderr to logger
I0222 20:43:27.161929 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 DEBUG: hyperkit: Pid is 6239
I0222 20:43:27.162331 6226 main.go:141] libmachine: (multinode-293000) DBG | Attempt 0
I0222 20:43:27.162349 6226 main.go:141] libmachine: (multinode-293000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:43:27.162440 6226 main.go:141] libmachine: (multinode-293000) DBG | hyperkit pid from json: 6239
I0222 20:43:27.163844 6226 main.go:141] libmachine: (multinode-293000) DBG | Searching for 8e:8:26:1e:84:48 in /var/db/dhcpd_leases ...
I0222 20:43:27.163900 6226 main.go:141] libmachine: (multinode-293000) DBG | Found 13 entries in /var/db/dhcpd_leases!
I0222 20:43:27.163924 6226 main.go:141] libmachine: (multinode-293000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.14 HWAddress:66:3a:f:a5:79:1d ID:1,66:3a:f:a5:79:1d Lease:0x63f6eeed}
I0222 20:43:27.163941 6226 main.go:141] libmachine: (multinode-293000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.13 HWAddress:f6:5a:53:47:16:21 ID:1,f6:5a:53:47:16:21 Lease:0x63f83fd9}
I0222 20:43:27.163968 6226 main.go:141] libmachine: (multinode-293000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.12 HWAddress:8e:8:26:1e:84:48 ID:1,8e:8:26:1e:84:48 Lease:0x63f83f9d}
I0222 20:43:27.163986 6226 main.go:141] libmachine: (multinode-293000) DBG | Found match: 8e:8:26:1e:84:48
I0222 20:43:27.164006 6226 main.go:141] libmachine: (multinode-293000) DBG | IP: 192.168.64.12
I0222 20:43:27.164044 6226 main.go:141] libmachine: (multinode-293000) Calling .GetConfigRaw
I0222 20:43:27.164674 6226 main.go:141] libmachine: (multinode-293000) Calling .GetIP
I0222 20:43:27.164869 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:43:27.165191 6226 machine.go:88] provisioning docker machine ...
I0222 20:43:27.165201 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:27.165308 6226 main.go:141] libmachine: (multinode-293000) Calling .GetMachineName
I0222 20:43:27.165401 6226 buildroot.go:166] provisioning hostname "multinode-293000"
I0222 20:43:27.165413 6226 main.go:141] libmachine: (multinode-293000) Calling .GetMachineName
I0222 20:43:27.165512 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:27.165587 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:27.165655 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:27.165726 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:27.165803 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:27.165972 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:43:27.166338 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.12 22 <nil> <nil>}
I0222 20:43:27.166350 6226 main.go:141] libmachine: About to run SSH command:
sudo hostname multinode-293000 && echo "multinode-293000" | sudo tee /etc/hostname
I0222 20:43:27.168464 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: Using fd 5 for I/O notifications
I0222 20:43:27.230026 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD
I0222 20:43:27.230641 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I0222 20:43:27.230657 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I0222 20:43:27.230672 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I0222 20:43:27.230680 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I0222 20:43:27.587799 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0
I0222 20:43:27.587814 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0
I0222 20:43:27.691835 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I0222 20:43:27.691858 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I0222 20:43:27.691877 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I0222 20:43:27.691922 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I0222 20:43:27.692917 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1
I0222 20:43:27.692931 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:27 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1
I0222 20:43:32.224775 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:32 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1
I0222 20:43:32.224819 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:32 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1
I0222 20:43:32.224830 6226 main.go:141] libmachine: (multinode-293000) DBG | 2023/02/22 20:43:32 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1
I0222 20:43:38.260390 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-293000
I0222 20:43:38.260419 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:38.260588 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:38.260684 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.260786 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.260875 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:38.261011 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:43:38.261323 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.12 22 <nil> <nil>}
I0222 20:43:38.261337 6226 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smultinode-293000' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-293000/g' /etc/hosts;
else
echo '127.0.1.1 multinode-293000' | sudo tee -a /etc/hosts;
fi
fi
I0222 20:43:38.338767 6226 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0222 20:43:38.338785 6226 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/15909-2565/.minikube CaCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15909-2565/.minikube}
I0222 20:43:38.338797 6226 buildroot.go:174] setting up certificates
I0222 20:43:38.338806 6226 provision.go:83] configureAuth start
I0222 20:43:38.338814 6226 main.go:141] libmachine: (multinode-293000) Calling .GetMachineName
I0222 20:43:38.338953 6226 main.go:141] libmachine: (multinode-293000) Calling .GetIP
I0222 20:43:38.339067 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:38.339151 6226 provision.go:138] copyHostCerts
I0222 20:43:38.339183 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem
I0222 20:43:38.339247 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem, removing ...
I0222 20:43:38.339255 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem
I0222 20:43:38.339369 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem (1082 bytes)
I0222 20:43:38.339557 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem
I0222 20:43:38.339594 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem, removing ...
I0222 20:43:38.339599 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem
I0222 20:43:38.339662 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem (1123 bytes)
I0222 20:43:38.339777 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem
I0222 20:43:38.339806 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem, removing ...
I0222 20:43:38.339810 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem
I0222 20:43:38.339867 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem (1679 bytes)
I0222 20:43:38.339984 6226 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem org=jenkins.multinode-293000 san=[192.168.64.12 192.168.64.12 localhost 127.0.0.1 minikube multinode-293000]
I0222 20:43:38.504197 6226 provision.go:172] copyRemoteCerts
I0222 20:43:38.504311 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0222 20:43:38.504340 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:38.504603 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:38.504802 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.504986 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:38.505151 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.12 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/id_rsa Username:docker}
I0222 20:43:38.548689 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0222 20:43:38.548761 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0222 20:43:38.563997 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem -> /etc/docker/server.pem
I0222 20:43:38.564055 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I0222 20:43:38.579172 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0222 20:43:38.579225 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0222 20:43:38.594132 6226 provision.go:86] duration metric: configureAuth took 255.318104ms
I0222 20:43:38.594142 6226 buildroot.go:189] setting minikube options for container-runtime
I0222 20:43:38.594311 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:43:38.594325 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:38.594454 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:38.594540 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:38.594613 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.594702 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.594795 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:38.594905 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:43:38.595199 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.12 22 <nil> <nil>}
I0222 20:43:38.595207 6226 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0222 20:43:38.669265 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I0222 20:43:38.669282 6226 buildroot.go:70] root file system type: tmpfs
I0222 20:43:38.669355 6226 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0222 20:43:38.669374 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:38.669505 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:38.669596 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.669703 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.669794 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:38.669936 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:43:38.670251 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.12 22 <nil> <nil>}
I0222 20:43:38.670296 6226 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0222 20:43:38.752131 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0222 20:43:38.752151 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:38.752287 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:38.752383 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.752486 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:38.752572 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:38.752712 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:43:38.753026 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.12 22 <nil> <nil>}
I0222 20:43:38.753040 6226 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0222 20:43:39.349118 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I0222 20:43:39.349133 6226 machine.go:91] provisioned docker machine in 12.184156232s
I0222 20:43:39.349143 6226 start.go:300] post-start starting for "multinode-293000" (driver="hyperkit")
I0222 20:43:39.349148 6226 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0222 20:43:39.349160 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:39.349346 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0222 20:43:39.349358 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:39.349458 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:39.349564 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:39.349664 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:39.349753 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.12 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/id_rsa Username:docker}
I0222 20:43:39.393286 6226 ssh_runner.go:195] Run: cat /etc/os-release
I0222 20:43:39.395698 6226 command_runner.go:130] > NAME=Buildroot
I0222 20:43:39.395707 6226 command_runner.go:130] > VERSION=2021.02.12-1-g41e8300-dirty
I0222 20:43:39.395714 6226 command_runner.go:130] > ID=buildroot
I0222 20:43:39.395719 6226 command_runner.go:130] > VERSION_ID=2021.02.12
I0222 20:43:39.395723 6226 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"
I0222 20:43:39.395796 6226 info.go:137] Remote host: Buildroot 2021.02.12
I0222 20:43:39.395808 6226 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15909-2565/.minikube/addons for local assets ...
I0222 20:43:39.395888 6226 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15909-2565/.minikube/files for local assets ...
I0222 20:43:39.396044 6226 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> 30412.pem in /etc/ssl/certs
I0222 20:43:39.396050 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> /etc/ssl/certs/30412.pem
I0222 20:43:39.396219 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0222 20:43:39.401645 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem --> /etc/ssl/certs/30412.pem (1708 bytes)
I0222 20:43:39.417241 6226 start.go:303] post-start completed in 68.09182ms
I0222 20:43:39.417256 6226 fix.go:57] fixHost completed within 12.44351438s
I0222 20:43:39.417278 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:39.417415 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:39.417506 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:39.417599 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:39.417680 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:39.417814 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:43:39.418122 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.12 22 <nil> <nil>}
I0222 20:43:39.418130 6226 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0222 20:43:39.491162 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: 1677127419.600291426
I0222 20:43:39.491173 6226 fix.go:207] guest clock: 1677127419.600291426
I0222 20:43:39.491179 6226 fix.go:220] Guest: 2023-02-22 20:43:39.600291426 -0800 PST Remote: 2023-02-22 20:43:39.417261 -0800 PST m=+12.881213575 (delta=183.030426ms)
I0222 20:43:39.491203 6226 fix.go:191] guest clock delta is within tolerance: 183.030426ms
I0222 20:43:39.491207 6226 start.go:83] releasing machines lock for "multinode-293000", held for 12.517503173s
I0222 20:43:39.491226 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:39.491360 6226 main.go:141] libmachine: (multinode-293000) Calling .GetIP
I0222 20:43:39.491455 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:39.491769 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:39.491873 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:43:39.491954 6226 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0222 20:43:39.491981 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:39.492022 6226 ssh_runner.go:195] Run: cat /version.json
I0222 20:43:39.492033 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:43:39.492087 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:39.492137 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:43:39.492181 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:39.492228 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:43:39.492278 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:39.492311 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:43:39.492390 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.12 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/id_rsa Username:docker}
I0222 20:43:39.492404 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.12 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/id_rsa Username:docker}
I0222 20:43:39.575623 6226 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.
I0222 20:43:39.576473 6226 command_runner.go:130] > {"iso_version": "v1.29.0-1676568791-15849", "kicbase_version": "v0.0.37-1675980448-15752", "minikube_version": "v1.29.0", "commit": "cf7ad99382c4b89a2ffa286b1101797332265ce3"}
I0222 20:43:39.576650 6226 ssh_runner.go:195] Run: systemctl --version
I0222 20:43:39.580817 6226 command_runner.go:130] > systemd 247 (247)
I0222 20:43:39.580835 6226 command_runner.go:130] > -PAM -AUDIT -SELINUX -IMA -APPARMOR -SMACK -SYSVINIT -UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ +LZ4 -ZSTD +SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid
I0222 20:43:39.580895 6226 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0222 20:43:39.584185 6226 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory
W0222 20:43:39.584226 6226 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0222 20:43:39.584270 6226 ssh_runner.go:195] Run: which cri-dockerd
I0222 20:43:39.586408 6226 command_runner.go:130] > /usr/bin/cri-dockerd
I0222 20:43:39.586619 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0222 20:43:39.592621 6226 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (135 bytes)
I0222 20:43:39.603984 6226 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0222 20:43:39.614204 6226 command_runner.go:139] > /etc/cni/net.d/87-podman-bridge.conflist,
I0222 20:43:39.614240 6226 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0222 20:43:39.614248 6226 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0222 20:43:39.614331 6226 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0222 20:43:39.631097 6226 command_runner.go:130] > registry.k8s.io/kube-apiserver:v1.26.1
I0222 20:43:39.631110 6226 command_runner.go:130] > registry.k8s.io/kube-controller-manager:v1.26.1
I0222 20:43:39.631114 6226 command_runner.go:130] > registry.k8s.io/kube-scheduler:v1.26.1
I0222 20:43:39.631118 6226 command_runner.go:130] > registry.k8s.io/kube-proxy:v1.26.1
I0222 20:43:39.631123 6226 command_runner.go:130] > registry.k8s.io/etcd:3.5.6-0
I0222 20:43:39.631126 6226 command_runner.go:130] > registry.k8s.io/pause:3.9
I0222 20:43:39.631131 6226 command_runner.go:130] > kindest/kindnetd:v20221004-44d545d1
I0222 20:43:39.631136 6226 command_runner.go:130] > registry.k8s.io/coredns/coredns:v1.9.3
I0222 20:43:39.631140 6226 command_runner.go:130] > registry.k8s.io/pause:3.6
I0222 20:43:39.631144 6226 command_runner.go:130] > gcr.io/k8s-minikube/storage-provisioner:v5
I0222 20:43:39.631148 6226 command_runner.go:130] > gcr.io/k8s-minikube/busybox:1.28
I0222 20:43:39.632084 6226 docker.go:630] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.26.1
registry.k8s.io/kube-controller-manager:v1.26.1
registry.k8s.io/kube-scheduler:v1.26.1
registry.k8s.io/kube-proxy:v1.26.1
registry.k8s.io/etcd:3.5.6-0
registry.k8s.io/pause:3.9
kindest/kindnetd:v20221004-44d545d1
registry.k8s.io/coredns/coredns:v1.9.3
registry.k8s.io/pause:3.6
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28
-- /stdout --
I0222 20:43:39.632095 6226 docker.go:560] Images already preloaded, skipping extraction
I0222 20:43:39.632103 6226 start.go:485] detecting cgroup driver to use...
I0222 20:43:39.632179 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
image-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0222 20:43:39.644074 6226 command_runner.go:130] > runtime-endpoint: unix:///run/containerd/containerd.sock
I0222 20:43:39.644084 6226 command_runner.go:130] > image-endpoint: unix:///run/containerd/containerd.sock
I0222 20:43:39.644379 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0222 20:43:39.651211 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0222 20:43:39.657975 6226 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I0222 20:43:39.658023 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0222 20:43:39.664809 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0222 20:43:39.671543 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0222 20:43:39.678136 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0222 20:43:39.684800 6226 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0222 20:43:39.691736 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0222 20:43:39.698576 6226 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0222 20:43:39.704661 6226 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1
I0222 20:43:39.704819 6226 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0222 20:43:39.710820 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:43:39.793782 6226 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0222 20:43:39.806804 6226 start.go:485] detecting cgroup driver to use...
I0222 20:43:39.806881 6226 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0222 20:43:39.815801 6226 command_runner.go:130] > # /usr/lib/systemd/system/docker.service
I0222 20:43:39.816408 6226 command_runner.go:130] > [Unit]
I0222 20:43:39.816416 6226 command_runner.go:130] > Description=Docker Application Container Engine
I0222 20:43:39.816423 6226 command_runner.go:130] > Documentation=https://docs.docker.com
I0222 20:43:39.816428 6226 command_runner.go:130] > After=network.target minikube-automount.service docker.socket
I0222 20:43:39.816434 6226 command_runner.go:130] > Requires= minikube-automount.service docker.socket
I0222 20:43:39.816440 6226 command_runner.go:130] > StartLimitBurst=3
I0222 20:43:39.816445 6226 command_runner.go:130] > StartLimitIntervalSec=60
I0222 20:43:39.816448 6226 command_runner.go:130] > [Service]
I0222 20:43:39.816452 6226 command_runner.go:130] > Type=notify
I0222 20:43:39.816455 6226 command_runner.go:130] > Restart=on-failure
I0222 20:43:39.816461 6226 command_runner.go:130] > # This file is a systemd drop-in unit that inherits from the base dockerd configuration.
I0222 20:43:39.816468 6226 command_runner.go:130] > # The base configuration already specifies an 'ExecStart=...' command. The first directive
I0222 20:43:39.816476 6226 command_runner.go:130] > # here is to clear out that command inherited from the base configuration. Without this,
I0222 20:43:39.816482 6226 command_runner.go:130] > # the command from the base configuration and the command specified here are treated as
I0222 20:43:39.816490 6226 command_runner.go:130] > # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
I0222 20:43:39.816495 6226 command_runner.go:130] > # will catch this invalid input and refuse to start the service with an error like:
I0222 20:43:39.816501 6226 command_runner.go:130] > # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
I0222 20:43:39.816509 6226 command_runner.go:130] > # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
I0222 20:43:39.816515 6226 command_runner.go:130] > # container runtimes. If left unlimited, it may result in OOM issues with MySQL.
I0222 20:43:39.816519 6226 command_runner.go:130] > ExecStart=
I0222 20:43:39.816560 6226 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
I0222 20:43:39.816568 6226 command_runner.go:130] > ExecReload=/bin/kill -s HUP $MAINPID
I0222 20:43:39.816574 6226 command_runner.go:130] > # Having non-zero Limit*s causes performance problems due to accounting overhead
I0222 20:43:39.816580 6226 command_runner.go:130] > # in the kernel. We recommend using cgroups to do container-local accounting.
I0222 20:43:39.816585 6226 command_runner.go:130] > LimitNOFILE=infinity
I0222 20:43:39.816588 6226 command_runner.go:130] > LimitNPROC=infinity
I0222 20:43:39.816593 6226 command_runner.go:130] > LimitCORE=infinity
I0222 20:43:39.816598 6226 command_runner.go:130] > # Uncomment TasksMax if your systemd version supports it.
I0222 20:43:39.816603 6226 command_runner.go:130] > # Only systemd 226 and above support this version.
I0222 20:43:39.816606 6226 command_runner.go:130] > TasksMax=infinity
I0222 20:43:39.816615 6226 command_runner.go:130] > TimeoutStartSec=0
I0222 20:43:39.816624 6226 command_runner.go:130] > # set delegate yes so that systemd does not reset the cgroups of docker containers
I0222 20:43:39.816631 6226 command_runner.go:130] > Delegate=yes
I0222 20:43:39.816638 6226 command_runner.go:130] > # kill only the docker process, not all processes in the cgroup
I0222 20:43:39.816643 6226 command_runner.go:130] > KillMode=process
I0222 20:43:39.816646 6226 command_runner.go:130] > [Install]
I0222 20:43:39.816672 6226 command_runner.go:130] > WantedBy=multi-user.target
I0222 20:43:39.816747 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0222 20:43:39.826301 6226 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0222 20:43:39.839122 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0222 20:43:39.847417 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0222 20:43:39.856517 6226 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0222 20:43:39.877822 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0222 20:43:39.887392 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
image-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0222 20:43:39.899027 6226 command_runner.go:130] > runtime-endpoint: unix:///var/run/cri-dockerd.sock
I0222 20:43:39.899037 6226 command_runner.go:130] > image-endpoint: unix:///var/run/cri-dockerd.sock
I0222 20:43:39.899456 6226 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0222 20:43:39.985910 6226 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0222 20:43:40.079370 6226 docker.go:529] configuring docker to use "cgroupfs" as cgroup driver...
I0222 20:43:40.079387 6226 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
I0222 20:43:40.090365 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:43:40.185069 6226 ssh_runner.go:195] Run: sudo systemctl restart docker
I0222 20:43:41.464168 6226 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.279103152s)
I0222 20:43:41.464228 6226 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0222 20:43:41.546266 6226 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0222 20:43:41.630286 6226 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0222 20:43:41.711916 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:43:41.796591 6226 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0222 20:43:41.811953 6226 start.go:532] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0222 20:43:41.812041 6226 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0222 20:43:41.815730 6226 command_runner.go:130] > File: /var/run/cri-dockerd.sock
I0222 20:43:41.815748 6226 command_runner.go:130] > Size: 0 Blocks: 0 IO Block: 4096 socket
I0222 20:43:41.815756 6226 command_runner.go:130] > Device: 16h/22d Inode: 873 Links: 1
I0222 20:43:41.815763 6226 command_runner.go:130] > Access: (0660/srw-rw----) Uid: ( 0/ root) Gid: ( 1000/ docker)
I0222 20:43:41.815769 6226 command_runner.go:130] > Access: 2023-02-23 04:43:41.918868999 +0000
I0222 20:43:41.815773 6226 command_runner.go:130] > Modify: 2023-02-23 04:43:41.918868999 +0000
I0222 20:43:41.815778 6226 command_runner.go:130] > Change: 2023-02-23 04:43:41.920868999 +0000
I0222 20:43:41.815782 6226 command_runner.go:130] > Birth: -
I0222 20:43:41.815897 6226 start.go:553] Will wait 60s for crictl version
I0222 20:43:41.815949 6226 ssh_runner.go:195] Run: which crictl
I0222 20:43:41.818294 6226 command_runner.go:130] > /usr/bin/crictl
I0222 20:43:41.818565 6226 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0222 20:43:41.875368 6226 command_runner.go:130] > Version: 0.1.0
I0222 20:43:41.875390 6226 command_runner.go:130] > RuntimeName: docker
I0222 20:43:41.875401 6226 command_runner.go:130] > RuntimeVersion: 20.10.23
I0222 20:43:41.875406 6226 command_runner.go:130] > RuntimeApiVersion: v1alpha2
I0222 20:43:41.876347 6226 start.go:569] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 20.10.23
RuntimeApiVersion: v1alpha2
I0222 20:43:41.876413 6226 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0222 20:43:41.895913 6226 command_runner.go:130] > 20.10.23
I0222 20:43:41.896698 6226 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0222 20:43:41.915652 6226 command_runner.go:130] > 20.10.23
I0222 20:43:41.960013 6226 out.go:204] * Preparing Kubernetes v1.26.1 on Docker 20.10.23 ...
I0222 20:43:41.960093 6226 main.go:141] libmachine: (multinode-293000) Calling .GetIP
I0222 20:43:41.960476 6226 ssh_runner.go:195] Run: grep 192.168.64.1 host.minikube.internal$ /etc/hosts
I0222 20:43:41.964505 6226 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.64.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0222 20:43:41.972321 6226 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0222 20:43:41.972389 6226 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0222 20:43:41.987675 6226 command_runner.go:130] > registry.k8s.io/kube-apiserver:v1.26.1
I0222 20:43:41.987687 6226 command_runner.go:130] > registry.k8s.io/kube-controller-manager:v1.26.1
I0222 20:43:41.987691 6226 command_runner.go:130] > registry.k8s.io/kube-scheduler:v1.26.1
I0222 20:43:41.987695 6226 command_runner.go:130] > registry.k8s.io/kube-proxy:v1.26.1
I0222 20:43:41.987703 6226 command_runner.go:130] > registry.k8s.io/etcd:3.5.6-0
I0222 20:43:41.987707 6226 command_runner.go:130] > registry.k8s.io/pause:3.9
I0222 20:43:41.987713 6226 command_runner.go:130] > kindest/kindnetd:v20221004-44d545d1
I0222 20:43:41.987720 6226 command_runner.go:130] > registry.k8s.io/coredns/coredns:v1.9.3
I0222 20:43:41.987723 6226 command_runner.go:130] > registry.k8s.io/pause:3.6
I0222 20:43:41.987727 6226 command_runner.go:130] > gcr.io/k8s-minikube/storage-provisioner:v5
I0222 20:43:41.987733 6226 command_runner.go:130] > gcr.io/k8s-minikube/busybox:1.28
I0222 20:43:41.988448 6226 docker.go:630] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.26.1
registry.k8s.io/kube-controller-manager:v1.26.1
registry.k8s.io/kube-scheduler:v1.26.1
registry.k8s.io/kube-proxy:v1.26.1
registry.k8s.io/etcd:3.5.6-0
registry.k8s.io/pause:3.9
kindest/kindnetd:v20221004-44d545d1
registry.k8s.io/coredns/coredns:v1.9.3
registry.k8s.io/pause:3.6
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28
-- /stdout --
I0222 20:43:41.988457 6226 docker.go:560] Images already preloaded, skipping extraction
I0222 20:43:41.988531 6226 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0222 20:43:42.004559 6226 command_runner.go:130] > registry.k8s.io/kube-apiserver:v1.26.1
I0222 20:43:42.004572 6226 command_runner.go:130] > registry.k8s.io/kube-controller-manager:v1.26.1
I0222 20:43:42.004577 6226 command_runner.go:130] > registry.k8s.io/kube-scheduler:v1.26.1
I0222 20:43:42.004580 6226 command_runner.go:130] > registry.k8s.io/kube-proxy:v1.26.1
I0222 20:43:42.004602 6226 command_runner.go:130] > registry.k8s.io/etcd:3.5.6-0
I0222 20:43:42.004609 6226 command_runner.go:130] > registry.k8s.io/pause:3.9
I0222 20:43:42.004615 6226 command_runner.go:130] > kindest/kindnetd:v20221004-44d545d1
I0222 20:43:42.004619 6226 command_runner.go:130] > registry.k8s.io/coredns/coredns:v1.9.3
I0222 20:43:42.004623 6226 command_runner.go:130] > registry.k8s.io/pause:3.6
I0222 20:43:42.004629 6226 command_runner.go:130] > gcr.io/k8s-minikube/storage-provisioner:v5
I0222 20:43:42.004634 6226 command_runner.go:130] > gcr.io/k8s-minikube/busybox:1.28
I0222 20:43:42.005240 6226 docker.go:630] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.26.1
registry.k8s.io/kube-controller-manager:v1.26.1
registry.k8s.io/kube-scheduler:v1.26.1
registry.k8s.io/kube-proxy:v1.26.1
registry.k8s.io/etcd:3.5.6-0
registry.k8s.io/pause:3.9
kindest/kindnetd:v20221004-44d545d1
registry.k8s.io/coredns/coredns:v1.9.3
registry.k8s.io/pause:3.6
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28
-- /stdout --
I0222 20:43:42.005255 6226 cache_images.go:84] Images are preloaded, skipping loading
I0222 20:43:42.005323 6226 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0222 20:43:42.025980 6226 command_runner.go:130] > cgroupfs
I0222 20:43:42.026673 6226 cni.go:84] Creating CNI manager for ""
I0222 20:43:42.026682 6226 cni.go:136] 3 nodes found, recommending kindnet
I0222 20:43:42.026694 6226 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0222 20:43:42.026707 6226 kubeadm.go:172] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.64.12 APIServerPort:8443 KubernetesVersion:v1.26.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:multinode-293000 NodeName:multinode-293000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.64.12"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.64.12 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/
etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m]}
I0222 20:43:42.026804 6226 kubeadm.go:177] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.64.12
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/cri-dockerd.sock
name: "multinode-293000"
kubeletExtraArgs:
node-ip: 192.168.64.12
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.64.12"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.26.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0222 20:43:42.026871 6226 kubeadm.go:968] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.26.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=/var/run/cri-dockerd.sock --hostname-override=multinode-293000 --image-service-endpoint=/var/run/cri-dockerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.64.12
[Install]
config:
{KubernetesVersion:v1.26.1 ClusterName:multinode-293000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0222 20:43:42.026928 6226 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.26.1
I0222 20:43:42.032829 6226 command_runner.go:130] > kubeadm
I0222 20:43:42.032839 6226 command_runner.go:130] > kubectl
I0222 20:43:42.032842 6226 command_runner.go:130] > kubelet
I0222 20:43:42.033092 6226 binaries.go:44] Found k8s binaries, skipping transfer
I0222 20:43:42.033140 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0222 20:43:42.039287 6226 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (449 bytes)
I0222 20:43:42.050135 6226 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0222 20:43:42.060840 6226 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2095 bytes)
I0222 20:43:42.072650 6226 ssh_runner.go:195] Run: grep 192.168.64.12 control-plane.minikube.internal$ /etc/hosts
I0222 20:43:42.074820 6226 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.64.12 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0222 20:43:42.082179 6226 certs.go:56] Setting up /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000 for IP: 192.168.64.12
I0222 20:43:42.082194 6226 certs.go:186] acquiring lock for shared ca certs: {Name:mk146a2279536341f0de1f1926bcacb2037bedc8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 20:43:42.082333 6226 certs.go:195] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.key
I0222 20:43:42.082381 6226 certs.go:195] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.key
I0222 20:43:42.082474 6226 certs.go:311] skipping minikube-user signed cert generation: /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.key
I0222 20:43:42.082546 6226 certs.go:311] skipping minikube signed cert generation: /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/apiserver.key.546ed142
I0222 20:43:42.082606 6226 certs.go:311] skipping aggregator signed cert generation: /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/proxy-client.key
I0222 20:43:42.082612 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I0222 20:43:42.082639 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I0222 20:43:42.082671 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I0222 20:43:42.082690 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I0222 20:43:42.082711 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0222 20:43:42.082729 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0222 20:43:42.082746 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0222 20:43:42.082770 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0222 20:43:42.082857 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041.pem (1338 bytes)
W0222 20:43:42.082896 6226 certs.go:397] ignoring /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041_empty.pem, impossibly tiny 0 bytes
I0222 20:43:42.082907 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem (1679 bytes)
I0222 20:43:42.082947 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem (1082 bytes)
I0222 20:43:42.082982 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem (1123 bytes)
I0222 20:43:42.083013 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem (1679 bytes)
I0222 20:43:42.083081 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem (1708 bytes)
I0222 20:43:42.083114 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0222 20:43:42.083134 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041.pem -> /usr/share/ca-certificates/3041.pem
I0222 20:43:42.083151 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> /usr/share/ca-certificates/30412.pem
I0222 20:43:42.083589 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0222 20:43:42.099446 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0222 20:43:42.114840 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0222 20:43:42.130180 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0222 20:43:42.145438 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0222 20:43:42.160941 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0222 20:43:42.176105 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0222 20:43:42.191277 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0222 20:43:42.206868 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0222 20:43:42.222232 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041.pem --> /usr/share/ca-certificates/3041.pem (1338 bytes)
I0222 20:43:42.237579 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem --> /usr/share/ca-certificates/30412.pem (1708 bytes)
I0222 20:43:42.252442 6226 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0222 20:43:42.263261 6226 ssh_runner.go:195] Run: openssl version
I0222 20:43:42.266506 6226 command_runner.go:130] > OpenSSL 1.1.1n 15 Mar 2022
I0222 20:43:42.266722 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0222 20:43:42.273692 6226 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0222 20:43:42.276402 6226 command_runner.go:130] > -rw-r--r-- 1 root root 1111 Feb 23 04:23 /usr/share/ca-certificates/minikubeCA.pem
I0222 20:43:42.276606 6226 certs.go:444] hashing: -rw-r--r-- 1 root root 1111 Feb 23 04:23 /usr/share/ca-certificates/minikubeCA.pem
I0222 20:43:42.276642 6226 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0222 20:43:42.279832 6226 command_runner.go:130] > b5213941
I0222 20:43:42.280052 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0222 20:43:42.287421 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3041.pem && ln -fs /usr/share/ca-certificates/3041.pem /etc/ssl/certs/3041.pem"
I0222 20:43:42.294372 6226 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3041.pem
I0222 20:43:42.296997 6226 command_runner.go:130] > -rw-r--r-- 1 root root 1338 Feb 23 04:28 /usr/share/ca-certificates/3041.pem
I0222 20:43:42.297216 6226 certs.go:444] hashing: -rw-r--r-- 1 root root 1338 Feb 23 04:28 /usr/share/ca-certificates/3041.pem
I0222 20:43:42.297250 6226 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3041.pem
I0222 20:43:42.300434 6226 command_runner.go:130] > 51391683
I0222 20:43:42.300633 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/3041.pem /etc/ssl/certs/51391683.0"
I0222 20:43:42.307555 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/30412.pem && ln -fs /usr/share/ca-certificates/30412.pem /etc/ssl/certs/30412.pem"
I0222 20:43:42.314683 6226 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/30412.pem
I0222 20:43:42.317434 6226 command_runner.go:130] > -rw-r--r-- 1 root root 1708 Feb 23 04:28 /usr/share/ca-certificates/30412.pem
I0222 20:43:42.317588 6226 certs.go:444] hashing: -rw-r--r-- 1 root root 1708 Feb 23 04:28 /usr/share/ca-certificates/30412.pem
I0222 20:43:42.317624 6226 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/30412.pem
I0222 20:43:42.320889 6226 command_runner.go:130] > 3ec20f2e
I0222 20:43:42.321096 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/30412.pem /etc/ssl/certs/3ec20f2e.0"
I0222 20:43:42.328054 6226 kubeadm.go:401] StartCluster: {Name:multinode-293000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15849/minikube-v1.29.0-1676568791-15849-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVer
sion:v1.26.1 ClusterName:multinode-293000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.12 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.64.14 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false in
gress:false ingress-dns:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPat
h: StaticIP:}
I0222 20:43:42.328164 6226 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0222 20:43:42.343540 6226 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0222 20:43:42.350116 6226 command_runner.go:130] > /var/lib/kubelet/config.yaml
I0222 20:43:42.350125 6226 command_runner.go:130] > /var/lib/kubelet/kubeadm-flags.env
I0222 20:43:42.350129 6226 command_runner.go:130] > /var/lib/minikube/etcd:
I0222 20:43:42.350133 6226 command_runner.go:130] > member
I0222 20:43:42.350317 6226 kubeadm.go:416] found existing configuration files, will attempt cluster restart
I0222 20:43:42.350330 6226 kubeadm.go:633] restartCluster start
I0222 20:43:42.350367 6226 ssh_runner.go:195] Run: sudo test -d /data/minikube
I0222 20:43:42.357233 6226 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0222 20:43:42.357530 6226 kubeconfig.go:135] verify returned: extract IP: "multinode-293000" does not appear in /Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:43:42.357600 6226 kubeconfig.go:146] "multinode-293000" context is missing from /Users/jenkins/minikube-integration/15909-2565/kubeconfig - will repair!
I0222 20:43:42.357792 6226 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15909-2565/kubeconfig: {Name:mk1b06a800cd80c445d8288b4dd64f07b28a1499 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 20:43:42.358329 6226 loader.go:373] Config loaded from file: /Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:43:42.358518 6226 kapi.go:59] client config for multinode-293000: &rest.Config{Host:"https://192.168.64.12:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.key", CAFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next
Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x25472a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0222 20:43:42.359010 6226 cert_rotation.go:137] Starting client certificate rotation controller
I0222 20:43:42.359180 6226 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0222 20:43:42.365172 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:42.365212 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:42.373534 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:42.875625 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:42.875749 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:42.886815 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:43.375660 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:43.375814 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:43.387317 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:43.874172 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:43.874281 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:43.885806 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:44.375611 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:44.375765 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:44.386712 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:44.874971 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:44.875085 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:44.888686 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:45.374369 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:45.374535 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:45.385806 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:45.873525 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:45.873683 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:45.883145 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:46.375640 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:46.375882 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:46.386443 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:46.874175 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:46.874328 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:46.885341 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:47.374561 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:47.374679 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:47.385135 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:47.875579 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:47.875730 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:47.886171 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:48.373525 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:48.373645 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:48.383963 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:48.873896 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:48.874131 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:48.884516 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:49.373531 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:49.373738 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:49.384005 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:49.875538 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:49.875700 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:49.886141 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:50.374383 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:50.374529 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:50.384613 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:50.875681 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:50.875784 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:50.887907 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:51.374313 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:51.374535 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:51.385345 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:51.874892 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:51.875005 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:51.885197 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:52.375469 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:52.375620 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:52.386849 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:52.386859 6226 api_server.go:165] Checking apiserver status ...
I0222 20:43:52.386902 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0222 20:43:52.395506 6226 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0222 20:43:52.395517 6226 kubeadm.go:608] needs reconfigure: apiserver error: timed out waiting for the condition
I0222 20:43:52.395525 6226 kubeadm.go:1120] stopping kube-system containers ...
I0222 20:43:52.395582 6226 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0222 20:43:52.412517 6226 command_runner.go:130] > 6dd7f81ec2fa
I0222 20:43:52.412529 6226 command_runner.go:130] > ca2f5eddf90f
I0222 20:43:52.412532 6226 command_runner.go:130] > 81e5dea5bf26
I0222 20:43:52.412542 6226 command_runner.go:130] > 949ea4d7145b
I0222 20:43:52.412546 6226 command_runner.go:130] > 0c8255290780
I0222 20:43:52.412549 6226 command_runner.go:130] > 1684370ceee7
I0222 20:43:52.412552 6226 command_runner.go:130] > 41f088cd951f
I0222 20:43:52.412561 6226 command_runner.go:130] > 6d623202802d
I0222 20:43:52.412565 6226 command_runner.go:130] > 84e0fe46ac29
I0222 20:43:52.412573 6226 command_runner.go:130] > dedc068e64af
I0222 20:43:52.412580 6226 command_runner.go:130] > 7efc215d8e68
I0222 20:43:52.412585 6226 command_runner.go:130] > dba4607b22f4
I0222 20:43:52.412590 6226 command_runner.go:130] > 141cda940cdc
I0222 20:43:52.412593 6226 command_runner.go:130] > 7bd801790b1a
I0222 20:43:52.412598 6226 command_runner.go:130] > 0d2b73b122a0
I0222 20:43:52.412602 6226 command_runner.go:130] > 9c9e2bb93c68
I0222 20:43:52.413278 6226 docker.go:456] Stopping containers: [6dd7f81ec2fa ca2f5eddf90f 81e5dea5bf26 949ea4d7145b 0c8255290780 1684370ceee7 41f088cd951f 6d623202802d 84e0fe46ac29 dedc068e64af 7efc215d8e68 dba4607b22f4 141cda940cdc 7bd801790b1a 0d2b73b122a0 9c9e2bb93c68]
I0222 20:43:52.413350 6226 ssh_runner.go:195] Run: docker stop 6dd7f81ec2fa ca2f5eddf90f 81e5dea5bf26 949ea4d7145b 0c8255290780 1684370ceee7 41f088cd951f 6d623202802d 84e0fe46ac29 dedc068e64af 7efc215d8e68 dba4607b22f4 141cda940cdc 7bd801790b1a 0d2b73b122a0 9c9e2bb93c68
I0222 20:43:52.435900 6226 command_runner.go:130] > 6dd7f81ec2fa
I0222 20:43:52.435912 6226 command_runner.go:130] > ca2f5eddf90f
I0222 20:43:52.435916 6226 command_runner.go:130] > 81e5dea5bf26
I0222 20:43:52.435919 6226 command_runner.go:130] > 949ea4d7145b
I0222 20:43:52.435930 6226 command_runner.go:130] > 0c8255290780
I0222 20:43:52.435934 6226 command_runner.go:130] > 1684370ceee7
I0222 20:43:52.435937 6226 command_runner.go:130] > 41f088cd951f
I0222 20:43:52.435941 6226 command_runner.go:130] > 6d623202802d
I0222 20:43:52.435957 6226 command_runner.go:130] > 84e0fe46ac29
I0222 20:43:52.435962 6226 command_runner.go:130] > dedc068e64af
I0222 20:43:52.435965 6226 command_runner.go:130] > 7efc215d8e68
I0222 20:43:52.435969 6226 command_runner.go:130] > dba4607b22f4
I0222 20:43:52.435973 6226 command_runner.go:130] > 141cda940cdc
I0222 20:43:52.435976 6226 command_runner.go:130] > 7bd801790b1a
I0222 20:43:52.435979 6226 command_runner.go:130] > 0d2b73b122a0
I0222 20:43:52.435982 6226 command_runner.go:130] > 9c9e2bb93c68
I0222 20:43:52.436872 6226 ssh_runner.go:195] Run: sudo systemctl stop kubelet
I0222 20:43:52.448112 6226 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0222 20:43:52.454335 6226 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
I0222 20:43:52.454345 6226 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
I0222 20:43:52.454355 6226 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
I0222 20:43:52.454364 6226 command_runner.go:130] ! ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0222 20:43:52.454454 6226 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0222 20:43:52.454495 6226 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0222 20:43:52.460811 6226 kubeadm.go:710] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
I0222 20:43:52.460819 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0222 20:43:52.532734 6226 command_runner.go:130] > [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0222 20:43:52.532890 6226 command_runner.go:130] > [certs] Using existing ca certificate authority
I0222 20:43:52.533124 6226 command_runner.go:130] > [certs] Using existing apiserver certificate and key on disk
I0222 20:43:52.533447 6226 command_runner.go:130] > [certs] Using existing apiserver-kubelet-client certificate and key on disk
I0222 20:43:52.533717 6226 command_runner.go:130] > [certs] Using existing front-proxy-ca certificate authority
I0222 20:43:52.533952 6226 command_runner.go:130] > [certs] Using existing front-proxy-client certificate and key on disk
I0222 20:43:52.534671 6226 command_runner.go:130] > [certs] Using existing etcd/ca certificate authority
I0222 20:43:52.535138 6226 command_runner.go:130] > [certs] Using existing etcd/server certificate and key on disk
I0222 20:43:52.535453 6226 command_runner.go:130] > [certs] Using existing etcd/peer certificate and key on disk
I0222 20:43:52.535836 6226 command_runner.go:130] > [certs] Using existing etcd/healthcheck-client certificate and key on disk
I0222 20:43:52.536142 6226 command_runner.go:130] > [certs] Using existing apiserver-etcd-client certificate and key on disk
I0222 20:43:52.536391 6226 command_runner.go:130] > [certs] Using the existing "sa" key
I0222 20:43:52.537237 6226 command_runner.go:130] ! W0223 04:43:52.647786 1266 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!
I0222 20:43:52.537330 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0222 20:43:52.582900 6226 command_runner.go:130] > [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0222 20:43:52.691744 6226 command_runner.go:130] > [kubeconfig] Writing "admin.conf" kubeconfig file
I0222 20:43:52.794934 6226 command_runner.go:130] > [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0222 20:43:52.885520 6226 command_runner.go:130] > [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0222 20:43:53.265580 6226 command_runner.go:130] > [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0222 20:43:53.267597 6226 command_runner.go:130] ! W0223 04:43:52.695178 1272 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!
I0222 20:43:53.267634 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0222 20:43:53.323061 6226 command_runner.go:130] > [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0222 20:43:53.323938 6226 command_runner.go:130] > [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0222 20:43:53.324099 6226 command_runner.go:130] > [kubelet-start] Starting the kubelet
I0222 20:43:53.413765 6226 command_runner.go:130] ! W0223 04:43:53.426370 1278 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!
I0222 20:43:53.413785 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0222 20:43:53.459259 6226 command_runner.go:130] > [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0222 20:43:53.459272 6226 command_runner.go:130] > [control-plane] Creating static Pod manifest for "kube-apiserver"
I0222 20:43:53.460937 6226 command_runner.go:130] > [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0222 20:43:53.462920 6226 command_runner.go:130] > [control-plane] Creating static Pod manifest for "kube-scheduler"
I0222 20:43:53.466443 6226 command_runner.go:130] ! W0223 04:43:53.574681 1300 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!
I0222 20:43:53.466459 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0222 20:43:53.519036 6226 command_runner.go:130] > [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0222 20:43:53.521797 6226 command_runner.go:130] ! W0223 04:43:53.633648 1310 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!
I0222 20:43:53.521821 6226 api_server.go:51] waiting for apiserver process to appear ...
I0222 20:43:53.521872 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0222 20:43:54.033742 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0222 20:43:54.534304 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0222 20:43:55.034441 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0222 20:43:55.533672 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0222 20:43:55.543442 6226 command_runner.go:130] > 1661
I0222 20:43:55.543645 6226 api_server.go:71] duration metric: took 2.021859074s to wait for apiserver process to appear ...
I0222 20:43:55.543656 6226 api_server.go:87] waiting for apiserver healthz status ...
I0222 20:43:55.543666 6226 api_server.go:252] Checking apiserver healthz at https://192.168.64.12:8443/healthz ...
I0222 20:43:58.456609 6226 api_server.go:278] https://192.168.64.12:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0222 20:43:58.456641 6226 api_server.go:102] status: https://192.168.64.12:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0222 20:43:58.958958 6226 api_server.go:252] Checking apiserver healthz at https://192.168.64.12:8443/healthz ...
I0222 20:43:58.964560 6226 api_server.go:278] https://192.168.64.12:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W0222 20:43:58.964574 6226 api_server.go:102] status: https://192.168.64.12:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I0222 20:43:59.457367 6226 api_server.go:252] Checking apiserver healthz at https://192.168.64.12:8443/healthz ...
I0222 20:43:59.461714 6226 api_server.go:278] https://192.168.64.12:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
W0222 20:43:59.461731 6226 api_server.go:102] status: https://192.168.64.12:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/storage-object-count-tracker-hook ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
[+]poststarthook/start-legacy-token-tracking-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/apiservice-openapiv3-controller ok
healthz check failed
I0222 20:43:59.956687 6226 api_server.go:252] Checking apiserver healthz at https://192.168.64.12:8443/healthz ...
I0222 20:43:59.962161 6226 api_server.go:278] https://192.168.64.12:8443/healthz returned 200:
ok
I0222 20:43:59.962219 6226 round_trippers.go:463] GET https://192.168.64.12:8443/version
I0222 20:43:59.962223 6226 round_trippers.go:469] Request Headers:
I0222 20:43:59.962231 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:43:59.962240 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:43:59.967731 6226 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds
I0222 20:43:59.967742 6226 round_trippers.go:577] Response Headers:
I0222 20:43:59.967748 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:43:59.967753 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:43:59.967758 6226 round_trippers.go:580] Content-Length: 263
I0222 20:43:59.967763 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:00 GMT
I0222 20:43:59.967767 6226 round_trippers.go:580] Audit-Id: 18f93eac-ade5-4f2c-9a4b-fc7727bccd66
I0222 20:43:59.967772 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:43:59.967777 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:43:59.967794 6226 request.go:1171] Response Body: {
"major": "1",
"minor": "26",
"gitVersion": "v1.26.1",
"gitCommit": "8f94681cd294aa8cfd3407b8191f6c70214973a4",
"gitTreeState": "clean",
"buildDate": "2023-01-18T15:51:25Z",
"goVersion": "go1.19.5",
"compiler": "gc",
"platform": "linux/amd64"
}
I0222 20:43:59.967838 6226 api_server.go:140] control plane version: v1.26.1
I0222 20:43:59.967846 6226 api_server.go:130] duration metric: took 4.424266038s to wait for apiserver health ...
I0222 20:43:59.967851 6226 cni.go:84] Creating CNI manager for ""
I0222 20:43:59.967857 6226 cni.go:136] 3 nodes found, recommending kindnet
I0222 20:43:59.989987 6226 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0222 20:44:00.011252 6226 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0222 20:44:00.015234 6226 command_runner.go:130] > File: /opt/cni/bin/portmap
I0222 20:44:00.015247 6226 command_runner.go:130] > Size: 2798344 Blocks: 5472 IO Block: 4096 regular file
I0222 20:44:00.015252 6226 command_runner.go:130] > Device: 11h/17d Inode: 3542 Links: 1
I0222 20:44:00.015257 6226 command_runner.go:130] > Access: (0755/-rwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root)
I0222 20:44:00.015261 6226 command_runner.go:130] > Access: 2023-02-23 04:43:35.438869016 +0000
I0222 20:44:00.015266 6226 command_runner.go:130] > Modify: 2023-02-16 22:59:55.000000000 +0000
I0222 20:44:00.015271 6226 command_runner.go:130] > Change: 2023-02-23 04:43:33.465142217 +0000
I0222 20:44:00.015278 6226 command_runner.go:130] > Birth: -
I0222 20:44:00.015635 6226 cni.go:181] applying CNI manifest using /var/lib/minikube/binaries/v1.26.1/kubectl ...
I0222 20:44:00.015644 6226 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2428 bytes)
I0222 20:44:00.050119 6226 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.26.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0222 20:44:01.028716 6226 command_runner.go:130] > clusterrole.rbac.authorization.k8s.io/kindnet unchanged
I0222 20:44:01.030963 6226 command_runner.go:130] > clusterrolebinding.rbac.authorization.k8s.io/kindnet unchanged
I0222 20:44:01.032685 6226 command_runner.go:130] > serviceaccount/kindnet unchanged
I0222 20:44:01.045765 6226 command_runner.go:130] > daemonset.apps/kindnet configured
I0222 20:44:01.047289 6226 system_pods.go:43] waiting for kube-system pods to appear ...
I0222 20:44:01.047350 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:44:01.047355 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.047362 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.047368 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.050625 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:01.050635 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.050641 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.050646 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.050654 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.050661 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.050667 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.050672 6226 round_trippers.go:580] Audit-Id: 7de3f617-39b3-4130-b85b-c99ca5d82f3f
I0222 20:44:01.051622 6226 request.go:1171] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"713"},"items":[{"metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"403","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f
:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 82454 chars]
I0222 20:44:01.054470 6226 system_pods.go:59] 12 kube-system pods found
I0222 20:44:01.054481 6226 system_pods.go:61] "coredns-787d4945fb-b28zh" [307635d3-a26b-4eff-be8a-9d65e1f996c3] Running
I0222 20:44:01.054494 6226 system_pods.go:61] "etcd-multinode-293000" [2363a307-e6f7-4025-ae02-4920adde4561] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
I0222 20:44:01.054499 6226 system_pods.go:61] "kindnet-bzxtr" [b3092ad6-e39a-43f2-8a95-ead97184aa40] Running
I0222 20:44:01.054502 6226 system_pods.go:61] "kindnet-nm7kn" [061817b8-aa21-408e-b432-53850cf8eb6d] Running
I0222 20:44:01.054506 6226 system_pods.go:61] "kindnet-rrx46" [df2ad52c-df28-46f4-b739-812ad756ed0e] Running
I0222 20:44:01.054510 6226 system_pods.go:61] "kube-apiserver-multinode-293000" [bb2fc1a3-12c1-4854-8f8c-3c1c5664067c] Running
I0222 20:44:01.054514 6226 system_pods.go:61] "kube-controller-manager-multinode-293000" [e60be5dc-4ed1-4a87-b03c-2ac01b03001d] Running
I0222 20:44:01.054518 6226 system_pods.go:61] "kube-proxy-bj985" [36f7816d-0b3e-4210-be32-907bf62dfa61] Running
I0222 20:44:01.054524 6226 system_pods.go:61] "kube-proxy-pxq2s" [0ce24b37-1ce7-4772-b40d-5f88f10aaa4b] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0222 20:44:01.054528 6226 system_pods.go:61] "kube-proxy-qmsbf" [98395ed9-2055-48e0-8d84-b931dfc0d9c7] Running
I0222 20:44:01.054532 6226 system_pods.go:61] "kube-scheduler-multinode-293000" [deb74301-35df-47d1-a8a9-f59943186666] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
I0222 20:44:01.054536 6226 system_pods.go:61] "storage-provisioner" [2e7410db-637a-4d25-9f92-f5e551a32c8d] Running
I0222 20:44:01.054540 6226 system_pods.go:74] duration metric: took 7.244514ms to wait for pod list to return data ...
I0222 20:44:01.054546 6226 node_conditions.go:102] verifying NodePressure condition ...
I0222 20:44:01.054577 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes
I0222 20:44:01.054582 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.054587 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.054593 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.056582 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.056591 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.056596 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.056601 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.056607 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.056635 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.056644 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.056654 6226 round_trippers.go:580] Audit-Id: beb5ae1e-578b-4292-b55b-1c3284f144b8
I0222 20:44:01.056964 6226 request.go:1171] Response Body: {"kind":"NodeList","apiVersion":"v1","metadata":{"resourceVersion":"713"},"items":[{"metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFiel
ds":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time" [truncated 16454 chars]
I0222 20:44:01.057495 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:44:01.057510 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:44:01.057520 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:44:01.057524 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:44:01.057528 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:44:01.057532 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:44:01.057536 6226 node_conditions.go:105] duration metric: took 2.986334ms to run NodePressure ...
I0222 20:44:01.057546 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0222 20:44:01.159557 6226 command_runner.go:130] > [addons] Applied essential addon: CoreDNS
I0222 20:44:01.188402 6226 command_runner.go:130] > [addons] Applied essential addon: kube-proxy
I0222 20:44:01.189315 6226 command_runner.go:130] ! W0223 04:44:01.225890 2467 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!
I0222 20:44:01.189334 6226 kubeadm.go:769] waiting for restarted kubelet to initialise ...
I0222 20:44:01.189386 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods?labelSelector=tier%!D(MISSING)control-plane
I0222 20:44:01.189391 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.189397 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.189403 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.191389 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.191416 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.191428 6226 round_trippers.go:580] Audit-Id: c06f9c08-f04d-4cd6-8686-f9a2911e9932
I0222 20:44:01.191436 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.191442 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.191447 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.191452 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.191457 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.191692 6226 request.go:1171] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"715"},"items":[{"metadata":{"name":"etcd-multinode-293000","namespace":"kube-system","uid":"2363a307-e6f7-4025-ae02-4920adde4561","resourceVersion":"710","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.64.12:2379","kubernetes.io/config.hash":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.mirror":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.seen":"2023-02-23T04:40:26.073140598Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations
":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-client-urls":{},"f:ku [truncated 28779 chars]
I0222 20:44:01.192382 6226 kubeadm.go:784] kubelet initialised
I0222 20:44:01.192391 6226 kubeadm.go:785] duration metric: took 3.049214ms waiting for restarted kubelet to initialise ...
I0222 20:44:01.192398 6226 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0222 20:44:01.192429 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:44:01.192434 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.192440 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.192446 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.197287 6226 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0222 20:44:01.197301 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.197308 6226 round_trippers.go:580] Audit-Id: 5f613e84-3ed8-4792-b249-494ab1a89f6a
I0222 20:44:01.197314 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.197319 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.197324 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.197329 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.197338 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.198197 6226 request.go:1171] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"715"},"items":[{"metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"403","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f
:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 82454 chars]
I0222 20:44:01.200006 6226 pod_ready.go:78] waiting up to 4m0s for pod "coredns-787d4945fb-b28zh" in "kube-system" namespace to be "Ready" ...
I0222 20:44:01.200047 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:01.200052 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.200058 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.200065 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.201732 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.201742 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.201748 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.201754 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.201759 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.201763 6226 round_trippers.go:580] Audit-Id: 3c2ff47e-a83f-4ded-97c5-53691cd74ab8
I0222 20:44:01.201768 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.201773 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.201962 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"403","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6281 chars]
I0222 20:44:01.202223 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:01.202229 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.202236 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.202241 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.203613 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.203621 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.203629 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.203636 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.203645 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.203652 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.203660 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.203681 6226 round_trippers.go:580] Audit-Id: 9c7d0a9d-463a-4a1e-9948-7ddff31182d6
I0222 20:44:01.203763 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:01.203941 6226 pod_ready.go:97] node "multinode-293000" hosting pod "coredns-787d4945fb-b28zh" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.203950 6226 pod_ready.go:81] duration metric: took 3.932953ms waiting for pod "coredns-787d4945fb-b28zh" in "kube-system" namespace to be "Ready" ...
E0222 20:44:01.203955 6226 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-293000" hosting pod "coredns-787d4945fb-b28zh" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.203960 6226 pod_ready.go:78] waiting up to 4m0s for pod "etcd-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:01.203988 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/etcd-multinode-293000
I0222 20:44:01.203993 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.203998 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.204004 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.205574 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.205583 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.205591 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.205598 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.205604 6226 round_trippers.go:580] Audit-Id: e0413176-5c02-4b99-9cc0-b1f84e7b1546
I0222 20:44:01.205609 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.205614 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.205621 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.205800 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"etcd-multinode-293000","namespace":"kube-system","uid":"2363a307-e6f7-4025-ae02-4920adde4561","resourceVersion":"710","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.64.12:2379","kubernetes.io/config.hash":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.mirror":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.seen":"2023-02-23T04:40:26.073140598Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-c
lient-urls":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config [truncated 6279 chars]
I0222 20:44:01.206020 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:01.206026 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.206032 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.206038 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.207190 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.207198 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.207205 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.207212 6226 round_trippers.go:580] Audit-Id: 214f65cb-1e18-4ebc-b471-8214e2bb8a7b
I0222 20:44:01.207220 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.207226 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.207232 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.207237 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.207353 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:01.207522 6226 pod_ready.go:97] node "multinode-293000" hosting pod "etcd-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.207529 6226 pod_ready.go:81] duration metric: took 3.565343ms waiting for pod "etcd-multinode-293000" in "kube-system" namespace to be "Ready" ...
E0222 20:44:01.207535 6226 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-293000" hosting pod "etcd-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.207543 6226 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:01.207569 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-multinode-293000
I0222 20:44:01.207573 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.207579 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.207585 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.209410 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.209419 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.209424 6226 round_trippers.go:580] Audit-Id: bb45a18b-8d80-4512-852f-2519e059fa21
I0222 20:44:01.209428 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.209433 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.209444 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.209452 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.209458 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.209525 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-apiserver-multinode-293000","namespace":"kube-system","uid":"bb2fc1a3-12c1-4854-8f8c-3c1c5664067c","resourceVersion":"280","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-apiserver","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.64.12:8443","kubernetes.io/config.hash":"578ff397a5454283a55e183c76494192","kubernetes.io/config.mirror":"578ff397a5454283a55e183c76494192","kubernetes.io/config.seen":"2023-02-23T04:40:26.073157361Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kub
ernetes.io/kube-apiserver.advertise-address.endpoint":{},"f:kubernetes. [truncated 7383 chars]
I0222 20:44:01.209743 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:01.209749 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.209755 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.209760 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.211408 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.211418 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.211426 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.211434 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.211442 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.211448 6226 round_trippers.go:580] Audit-Id: 9c96ca23-ee87-404e-815c-df5c29ddccb4
I0222 20:44:01.211454 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.211458 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.211519 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:01.211690 6226 pod_ready.go:97] node "multinode-293000" hosting pod "kube-apiserver-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.211697 6226 pod_ready.go:81] duration metric: took 4.148979ms waiting for pod "kube-apiserver-multinode-293000" in "kube-system" namespace to be "Ready" ...
E0222 20:44:01.211702 6226 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-293000" hosting pod "kube-apiserver-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.211708 6226 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:01.248188 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-multinode-293000
I0222 20:44:01.248213 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.248226 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.248236 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.251464 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:01.251479 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.251487 6226 round_trippers.go:580] Audit-Id: f0985089-3bc7-4d27-9543-950d01930293
I0222 20:44:01.251493 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.251500 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.251508 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.251515 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.251522 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.251616 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-controller-manager-multinode-293000","namespace":"kube-system","uid":"e60be5dc-4ed1-4a87-b03c-2ac01b03001d","resourceVersion":"284","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-controller-manager","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"02b271251b67ef9dd552c569d01153ca","kubernetes.io/config.mirror":"02b271251b67ef9dd552c569d01153ca","kubernetes.io/config.seen":"2023-02-23T04:40:26.073158360Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.i
o/config.seen":{},"f:kubernetes.io/config.source":{}},"f:labels":{".":{ [truncated 6953 chars]
I0222 20:44:01.448799 6226 request.go:622] Waited for 196.844818ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:01.448895 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:01.448903 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.448912 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.448920 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.450814 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:01.450829 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.450838 6226 round_trippers.go:580] Audit-Id: f5d4a6ed-aaca-45eb-bd13-7a22da3cbc58
I0222 20:44:01.450848 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.450856 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.450863 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.450869 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.450876 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.451046 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:01.451245 6226 pod_ready.go:97] node "multinode-293000" hosting pod "kube-controller-manager-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.451252 6226 pod_ready.go:81] duration metric: took 239.544938ms waiting for pod "kube-controller-manager-multinode-293000" in "kube-system" namespace to be "Ready" ...
E0222 20:44:01.451261 6226 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-293000" hosting pod "kube-controller-manager-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:01.451266 6226 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-bj985" in "kube-system" namespace to be "Ready" ...
I0222 20:44:01.648242 6226 request.go:622] Waited for 196.929726ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bj985
I0222 20:44:01.648321 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bj985
I0222 20:44:01.648376 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.648389 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.648400 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.650924 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:01.650937 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.650944 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.650951 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.650957 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.650963 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.650970 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.650976 6226 round_trippers.go:580] Audit-Id: 187ad684-c4c7-4ca4-8e05-b3a2b6dd5f7f
I0222 20:44:01.651072 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-bj985","generateName":"kube-proxy-","namespace":"kube-system","uid":"36f7816d-0b3e-4210-be32-907bf62dfa61","resourceVersion":"687","creationTimestamp":"2023-02-23T04:42:15Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:42:15Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5746 chars]
I0222 20:44:01.847734 6226 request.go:622] Waited for 196.335031ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m03
I0222 20:44:01.847782 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m03
I0222 20:44:01.847790 6226 round_trippers.go:469] Request Headers:
I0222 20:44:01.847804 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:01.847870 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:01.850476 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:01.850492 6226 round_trippers.go:577] Response Headers:
I0222 20:44:01.850500 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:01.850517 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:01 GMT
I0222 20:44:01.850529 6226 round_trippers.go:580] Audit-Id: 80462e2b-f0e3-496c-a59c-14fc1c1589fd
I0222 20:44:01.850536 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:01.850543 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:01.850549 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:01.850862 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m03","uid":"181ccd63-a7fc-412c-bfee-446a1e65f4b4","resourceVersion":"698","creationTimestamp":"2023-02-23T04:42:56Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m03","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:42:56Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{
}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 4449 chars]
I0222 20:44:01.851096 6226 pod_ready.go:92] pod "kube-proxy-bj985" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:01.851104 6226 pod_ready.go:81] duration metric: took 399.840597ms waiting for pod "kube-proxy-bj985" in "kube-system" namespace to be "Ready" ...
I0222 20:44:01.851112 6226 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-pxq2s" in "kube-system" namespace to be "Ready" ...
I0222 20:44:02.047828 6226 request.go:622] Waited for 196.675284ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pxq2s
I0222 20:44:02.047953 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pxq2s
I0222 20:44:02.047963 6226 round_trippers.go:469] Request Headers:
I0222 20:44:02.047974 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:02.047984 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:02.050086 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:02.050103 6226 round_trippers.go:577] Response Headers:
I0222 20:44:02.050112 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:02 GMT
I0222 20:44:02.050121 6226 round_trippers.go:580] Audit-Id: 179a24a9-633b-47e8-841f-e7f77779419e
I0222 20:44:02.050128 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:02.050135 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:02.050145 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:02.050153 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:02.050258 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-pxq2s","generateName":"kube-proxy-","namespace":"kube-system","uid":"0ce24b37-1ce7-4772-b40d-5f88f10aaa4b","resourceVersion":"713","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5928 chars]
I0222 20:44:02.247652 6226 request.go:622] Waited for 197.141439ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:02.247696 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:02.247705 6226 round_trippers.go:469] Request Headers:
I0222 20:44:02.247715 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:02.247724 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:02.249789 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:02.249800 6226 round_trippers.go:577] Response Headers:
I0222 20:44:02.249806 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:02 GMT
I0222 20:44:02.249811 6226 round_trippers.go:580] Audit-Id: 46a96ced-4686-4338-bd8c-df0e916d3b91
I0222 20:44:02.249817 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:02.249822 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:02.249827 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:02.249833 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:02.249931 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:02.250124 6226 pod_ready.go:97] node "multinode-293000" hosting pod "kube-proxy-pxq2s" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:02.250132 6226 pod_ready.go:81] duration metric: took 399.021836ms waiting for pod "kube-proxy-pxq2s" in "kube-system" namespace to be "Ready" ...
E0222 20:44:02.250138 6226 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-293000" hosting pod "kube-proxy-pxq2s" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:02.250142 6226 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-qmsbf" in "kube-system" namespace to be "Ready" ...
I0222 20:44:02.449307 6226 request.go:622] Waited for 199.109206ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qmsbf
I0222 20:44:02.449377 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qmsbf
I0222 20:44:02.449385 6226 round_trippers.go:469] Request Headers:
I0222 20:44:02.449398 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:02.449410 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:02.452330 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:02.452345 6226 round_trippers.go:577] Response Headers:
I0222 20:44:02.452354 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:02.452363 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:02.452373 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:02.452385 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:02 GMT
I0222 20:44:02.452395 6226 round_trippers.go:580] Audit-Id: 3caf1443-a48b-490f-bf3b-ca725ce7bdc3
I0222 20:44:02.452407 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:02.452525 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-qmsbf","generateName":"kube-proxy-","namespace":"kube-system","uid":"98395ed9-2055-48e0-8d84-b931dfc0d9c7","resourceVersion":"486","creationTimestamp":"2023-02-23T04:41:26Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:41:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5541 chars]
I0222 20:44:02.649394 6226 request.go:622] Waited for 196.531343ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:44:02.649492 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:44:02.649579 6226 round_trippers.go:469] Request Headers:
I0222 20:44:02.649593 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:02.649617 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:02.652277 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:02.652293 6226 round_trippers.go:577] Response Headers:
I0222 20:44:02.652304 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:02 GMT
I0222 20:44:02.652316 6226 round_trippers.go:580] Audit-Id: c4fc2f38-4eee-462a-974b-e66e95b9037f
I0222 20:44:02.652327 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:02.652336 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:02.652344 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:02.652355 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:02.652508 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"f968bf76-422f-4a90-ba94-df00a7b8efaa","resourceVersion":"592","creationTimestamp":"2023-02-23T04:41:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:41:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:41:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.ku
bernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f [truncated 4512 chars]
I0222 20:44:02.652744 6226 pod_ready.go:92] pod "kube-proxy-qmsbf" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:02.652752 6226 pod_ready.go:81] duration metric: took 402.611768ms waiting for pod "kube-proxy-qmsbf" in "kube-system" namespace to be "Ready" ...
I0222 20:44:02.652759 6226 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:02.847410 6226 request.go:622] Waited for 194.572177ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-293000
I0222 20:44:02.847440 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-293000
I0222 20:44:02.847444 6226 round_trippers.go:469] Request Headers:
I0222 20:44:02.847450 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:02.847457 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:02.848938 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:02.848951 6226 round_trippers.go:577] Response Headers:
I0222 20:44:02.848957 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:02.848964 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:02.848971 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:02 GMT
I0222 20:44:02.848978 6226 round_trippers.go:580] Audit-Id: 7dd9c3a4-81b6-4c62-8a6a-4e31d939609e
I0222 20:44:02.848984 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:02.848990 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:02.849069 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-scheduler-multinode-293000","namespace":"kube-system","uid":"deb74301-35df-47d1-a8a9-f59943186666","resourceVersion":"711","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-scheduler","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"ef6d7c628504525048f2a505fc91f554","kubernetes.io/config.mirror":"ef6d7c628504525048f2a505fc91f554","kubernetes.io/config.seen":"2023-02-23T04:40:26.073159188Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.io/config.seen":{},
"f:kubernetes.io/config.source":{}},"f:labels":{".":{},"f:component":{} [truncated 5132 chars]
I0222 20:44:03.048426 6226 request.go:622] Waited for 199.069828ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:03.048470 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:03.048476 6226 round_trippers.go:469] Request Headers:
I0222 20:44:03.048483 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:03.048490 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:03.050125 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:03.050135 6226 round_trippers.go:577] Response Headers:
I0222 20:44:03.050141 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:03 GMT
I0222 20:44:03.050146 6226 round_trippers.go:580] Audit-Id: a5f0fa1a-6552-4b63-8aeb-a0000aad5b2a
I0222 20:44:03.050151 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:03.050156 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:03.050161 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:03.050166 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:03.050291 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:03.050492 6226 pod_ready.go:97] node "multinode-293000" hosting pod "kube-scheduler-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:03.050500 6226 pod_ready.go:81] duration metric: took 397.742199ms waiting for pod "kube-scheduler-multinode-293000" in "kube-system" namespace to be "Ready" ...
E0222 20:44:03.050506 6226 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-293000" hosting pod "kube-scheduler-multinode-293000" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000" has status "Ready":"False"
I0222 20:44:03.050511 6226 pod_ready.go:38] duration metric: took 1.858141947s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0222 20:44:03.050521 6226 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0222 20:44:03.058289 6226 command_runner.go:130] > -16
I0222 20:44:03.058535 6226 ops.go:34] apiserver oom_adj: -16
I0222 20:44:03.058543 6226 kubeadm.go:637] restartCluster took 20.708584507s
I0222 20:44:03.058547 6226 kubeadm.go:403] StartCluster complete in 20.730876089s
I0222 20:44:03.058560 6226 settings.go:142] acquiring lock: {Name:mkc26232b9c6921321370d16721303c6a865ce03 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 20:44:03.058636 6226 settings.go:150] Updating kubeconfig: /Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:44:03.058981 6226 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/15909-2565/kubeconfig: {Name:mk1b06a800cd80c445d8288b4dd64f07b28a1499 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 20:44:03.059212 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.26.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0222 20:44:03.059258 6226 addons.go:489] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false volumesnapshots:false]
I0222 20:44:03.059390 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:44:03.134470 6226 out.go:177] * Enabled addons:
I0222 20:44:03.059611 6226 loader.go:373] Config loaded from file: /Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:44:03.157202 6226 addons.go:492] enable addons completed in 97.945344ms: enabled=[]
I0222 20:44:03.157458 6226 kapi.go:59] client config for multinode-293000: &rest.Config{Host:"https://192.168.64.12:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.key", CAFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next
Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x25472a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0222 20:44:03.157716 6226 round_trippers.go:463] GET https://192.168.64.12:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale
I0222 20:44:03.157722 6226 round_trippers.go:469] Request Headers:
I0222 20:44:03.157728 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:03.157734 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:03.159333 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:03.159343 6226 round_trippers.go:577] Response Headers:
I0222 20:44:03.159349 6226 round_trippers.go:580] Audit-Id: 8009df31-a020-41db-ad81-9cc892a99ba6
I0222 20:44:03.159353 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:03.159359 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:03.159363 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:03.159369 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:03.159373 6226 round_trippers.go:580] Content-Length: 291
I0222 20:44:03.159378 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:03 GMT
I0222 20:44:03.159389 6226 request.go:1171] Response Body: {"kind":"Scale","apiVersion":"autoscaling/v1","metadata":{"name":"coredns","namespace":"kube-system","uid":"b913bddd-effc-42b2-b71d-0d3159053b5a","resourceVersion":"714","creationTimestamp":"2023-02-23T04:40:25Z"},"spec":{"replicas":1},"status":{"replicas":1,"selector":"k8s-app=kube-dns"}}
I0222 20:44:03.159506 6226 kapi.go:248] "coredns" deployment in "kube-system" namespace and "multinode-293000" context rescaled to 1 replicas
I0222 20:44:03.159522 6226 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.64.12 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0222 20:44:03.180379 6226 out.go:177] * Verifying Kubernetes components...
I0222 20:44:03.166483 6226 command_runner.go:130] > apiVersion: v1
I0222 20:44:03.180398 6226 command_runner.go:130] > data:
I0222 20:44:03.201476 6226 command_runner.go:130] > Corefile: |
I0222 20:44:03.201490 6226 command_runner.go:130] > .:53 {
I0222 20:44:03.201498 6226 command_runner.go:130] > log
I0222 20:44:03.201506 6226 command_runner.go:130] > errors
I0222 20:44:03.201511 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0222 20:44:03.201514 6226 command_runner.go:130] > health {
I0222 20:44:03.201528 6226 command_runner.go:130] > lameduck 5s
I0222 20:44:03.201536 6226 command_runner.go:130] > }
I0222 20:44:03.201543 6226 command_runner.go:130] > ready
I0222 20:44:03.201552 6226 command_runner.go:130] > kubernetes cluster.local in-addr.arpa ip6.arpa {
I0222 20:44:03.201560 6226 command_runner.go:130] > pods insecure
I0222 20:44:03.201570 6226 command_runner.go:130] > fallthrough in-addr.arpa ip6.arpa
I0222 20:44:03.201578 6226 command_runner.go:130] > ttl 30
I0222 20:44:03.201585 6226 command_runner.go:130] > }
I0222 20:44:03.201598 6226 command_runner.go:130] > prometheus :9153
I0222 20:44:03.201605 6226 command_runner.go:130] > hosts {
I0222 20:44:03.201615 6226 command_runner.go:130] > 192.168.64.1 host.minikube.internal
I0222 20:44:03.201622 6226 command_runner.go:130] > fallthrough
I0222 20:44:03.201629 6226 command_runner.go:130] > }
I0222 20:44:03.201637 6226 command_runner.go:130] > forward . /etc/resolv.conf {
I0222 20:44:03.201661 6226 command_runner.go:130] > max_concurrent 1000
I0222 20:44:03.201670 6226 command_runner.go:130] > }
I0222 20:44:03.201677 6226 command_runner.go:130] > cache 30
I0222 20:44:03.201694 6226 command_runner.go:130] > loop
I0222 20:44:03.201704 6226 command_runner.go:130] > reload
I0222 20:44:03.201712 6226 command_runner.go:130] > loadbalance
I0222 20:44:03.201719 6226 command_runner.go:130] > }
I0222 20:44:03.201728 6226 command_runner.go:130] > kind: ConfigMap
I0222 20:44:03.201736 6226 command_runner.go:130] > metadata:
I0222 20:44:03.201746 6226 command_runner.go:130] > creationTimestamp: "2023-02-23T04:40:25Z"
I0222 20:44:03.201753 6226 command_runner.go:130] > name: coredns
I0222 20:44:03.201761 6226 command_runner.go:130] > namespace: kube-system
I0222 20:44:03.201770 6226 command_runner.go:130] > resourceVersion: "358"
I0222 20:44:03.201778 6226 command_runner.go:130] > uid: 260fccb1-07e1-4dd1-a16e-c119751deab5
I0222 20:44:03.201873 6226 start.go:894] CoreDNS already contains "host.minikube.internal" host record, skipping...
I0222 20:44:03.212458 6226 node_ready.go:35] waiting up to 6m0s for node "multinode-293000" to be "Ready" ...
I0222 20:44:03.248276 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:03.248304 6226 round_trippers.go:469] Request Headers:
I0222 20:44:03.248351 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:03.248362 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:03.251161 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:03.251174 6226 round_trippers.go:577] Response Headers:
I0222 20:44:03.251183 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:03.251190 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:03.251198 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:03.251206 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:03.251213 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:03 GMT
I0222 20:44:03.251221 6226 round_trippers.go:580] Audit-Id: d4352317-ebee-4107-8feb-36b01a3bdd49
I0222 20:44:03.251418 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:03.751854 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:03.751869 6226 round_trippers.go:469] Request Headers:
I0222 20:44:03.751878 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:03.751883 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:03.753583 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:03.753592 6226 round_trippers.go:577] Response Headers:
I0222 20:44:03.753599 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:03.753613 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:03 GMT
I0222 20:44:03.753618 6226 round_trippers.go:580] Audit-Id: 207fa3df-77bf-45b1-a610-8d39066be0cf
I0222 20:44:03.753624 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:03.753629 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:03.753634 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:03.753781 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:04.251823 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:04.251837 6226 round_trippers.go:469] Request Headers:
I0222 20:44:04.251895 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:04.251902 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:04.253299 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:04.253312 6226 round_trippers.go:577] Response Headers:
I0222 20:44:04.253321 6226 round_trippers.go:580] Audit-Id: ead978f5-409c-4404-9a7d-92dad80bf5a6
I0222 20:44:04.253338 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:04.253348 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:04.253362 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:04.253369 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:04.253376 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:04 GMT
I0222 20:44:04.253446 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:04.752594 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:04.752614 6226 round_trippers.go:469] Request Headers:
I0222 20:44:04.752626 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:04.752636 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:04.755724 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:04.755738 6226 round_trippers.go:577] Response Headers:
I0222 20:44:04.755746 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:04 GMT
I0222 20:44:04.755752 6226 round_trippers.go:580] Audit-Id: 114fc980-a27d-482a-8a30-97e0d1b07115
I0222 20:44:04.755758 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:04.755766 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:04.755772 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:04.755778 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:04.755927 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:05.252211 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:05.252222 6226 round_trippers.go:469] Request Headers:
I0222 20:44:05.252229 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:05.252234 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:05.253502 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:05.253512 6226 round_trippers.go:577] Response Headers:
I0222 20:44:05.253517 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:05.253522 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:05.253528 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:05.253532 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:05 GMT
I0222 20:44:05.253537 6226 round_trippers.go:580] Audit-Id: 092f8203-8f2e-4582-a098-ce3a1e44e8cc
I0222 20:44:05.253544 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:05.253622 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:05.253814 6226 node_ready.go:58] node "multinode-293000" has status "Ready":"False"
I0222 20:44:05.752210 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:05.752223 6226 round_trippers.go:469] Request Headers:
I0222 20:44:05.752230 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:05.752238 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:05.753723 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:05.753735 6226 round_trippers.go:577] Response Headers:
I0222 20:44:05.753740 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:05.753745 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:05.753750 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:05.753754 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:05.753761 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:05 GMT
I0222 20:44:05.753770 6226 round_trippers.go:580] Audit-Id: 53f81b02-cf84-4b98-862d-0645a1d3d84f
I0222 20:44:05.753912 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:06.251699 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:06.251713 6226 round_trippers.go:469] Request Headers:
I0222 20:44:06.251720 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:06.251725 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:06.252931 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:06.252945 6226 round_trippers.go:577] Response Headers:
I0222 20:44:06.252953 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:06 GMT
I0222 20:44:06.252960 6226 round_trippers.go:580] Audit-Id: b3a9b71e-713e-4c81-8de2-ce30f2535f55
I0222 20:44:06.252967 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:06.252971 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:06.252976 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:06.252981 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:06.253134 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:06.753392 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:06.753417 6226 round_trippers.go:469] Request Headers:
I0222 20:44:06.753429 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:06.753439 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:06.756228 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:06.756249 6226 round_trippers.go:577] Response Headers:
I0222 20:44:06.756261 6226 round_trippers.go:580] Audit-Id: a768fa84-c79d-4255-bb70-088fa70fe09c
I0222 20:44:06.756270 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:06.756281 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:06.756291 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:06.756300 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:06.756310 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:06 GMT
I0222 20:44:06.756418 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"708","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5456 chars]
I0222 20:44:07.253198 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:07.253210 6226 round_trippers.go:469] Request Headers:
I0222 20:44:07.253216 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:07.253221 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:07.254796 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:07.254807 6226 round_trippers.go:577] Response Headers:
I0222 20:44:07.254812 6226 round_trippers.go:580] Audit-Id: 3dadfcd1-3841-4f2e-ae07-c27ebdb6878e
I0222 20:44:07.254818 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:07.254823 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:07.254827 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:07.254833 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:07.254838 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:07 GMT
I0222 20:44:07.254937 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:07.255117 6226 node_ready.go:49] node "multinode-293000" has status "Ready":"True"
I0222 20:44:07.255126 6226 node_ready.go:38] duration metric: took 4.042728512s waiting for node "multinode-293000" to be "Ready" ...
I0222 20:44:07.255132 6226 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0222 20:44:07.255164 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:44:07.255168 6226 round_trippers.go:469] Request Headers:
I0222 20:44:07.255174 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:07.255179 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:07.257736 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:07.257747 6226 round_trippers.go:577] Response Headers:
I0222 20:44:07.257754 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:07.257762 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:07.257769 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:07 GMT
I0222 20:44:07.257777 6226 round_trippers.go:580] Audit-Id: b747a605-b6d4-472d-a4d9-a25fd49c01bf
I0222 20:44:07.257784 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:07.257792 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:07.259253 6226 request.go:1171] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"753"},"items":[{"metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f
:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 83345 chars]
I0222 20:44:07.261040 6226 pod_ready.go:78] waiting up to 6m0s for pod "coredns-787d4945fb-b28zh" in "kube-system" namespace to be "Ready" ...
I0222 20:44:07.261075 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:07.261080 6226 round_trippers.go:469] Request Headers:
I0222 20:44:07.261085 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:07.261091 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:07.262279 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:07.262286 6226 round_trippers.go:577] Response Headers:
I0222 20:44:07.262291 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:07 GMT
I0222 20:44:07.262296 6226 round_trippers.go:580] Audit-Id: 2f9b4c1f-3ee0-4999-9274-c7b8e6a14c28
I0222 20:44:07.262301 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:07.262306 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:07.262311 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:07.262316 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:07.262459 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:07.262700 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:07.262707 6226 round_trippers.go:469] Request Headers:
I0222 20:44:07.262713 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:07.262719 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:07.263704 6226 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds
I0222 20:44:07.263722 6226 round_trippers.go:577] Response Headers:
I0222 20:44:07.263734 6226 round_trippers.go:580] Audit-Id: f4fcc4eb-f82d-45e3-a5b6-8f80a3e63cf1
I0222 20:44:07.263741 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:07.263749 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:07.263755 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:07.263764 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:07.263770 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:07 GMT
I0222 20:44:07.263842 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:07.766208 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:07.766235 6226 round_trippers.go:469] Request Headers:
I0222 20:44:07.766247 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:07.766257 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:07.768924 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:07.768942 6226 round_trippers.go:577] Response Headers:
I0222 20:44:07.768954 6226 round_trippers.go:580] Audit-Id: 76b78dcf-1d83-40ee-a846-bdaec0ca930e
I0222 20:44:07.768964 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:07.768977 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:07.768989 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:07.768998 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:07.769005 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:07 GMT
I0222 20:44:07.769175 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:07.769635 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:07.769643 6226 round_trippers.go:469] Request Headers:
I0222 20:44:07.769651 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:07.769658 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:07.771087 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:07.771096 6226 round_trippers.go:577] Response Headers:
I0222 20:44:07.771102 6226 round_trippers.go:580] Audit-Id: 97f8a2b7-0f36-4f34-9bce-4a9caa93ff09
I0222 20:44:07.771118 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:07.771130 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:07.771135 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:07.771143 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:07.771148 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:07 GMT
I0222 20:44:07.771255 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:08.264685 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:08.264708 6226 round_trippers.go:469] Request Headers:
I0222 20:44:08.264721 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:08.264731 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:08.266923 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:08.266939 6226 round_trippers.go:577] Response Headers:
I0222 20:44:08.266950 6226 round_trippers.go:580] Audit-Id: f70f1885-06ef-4345-bde4-3055634c0693
I0222 20:44:08.266961 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:08.266973 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:08.266982 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:08.266994 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:08.267004 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:08 GMT
I0222 20:44:08.267120 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:08.267469 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:08.267478 6226 round_trippers.go:469] Request Headers:
I0222 20:44:08.267486 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:08.267493 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:08.268968 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:08.268978 6226 round_trippers.go:577] Response Headers:
I0222 20:44:08.268991 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:08 GMT
I0222 20:44:08.269001 6226 round_trippers.go:580] Audit-Id: c7f88d5d-8676-434d-afd9-eba4b33756d9
I0222 20:44:08.269013 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:08.269021 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:08.269027 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:08.269031 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:08.269144 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:08.764328 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:08.764357 6226 round_trippers.go:469] Request Headers:
I0222 20:44:08.764369 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:08.764380 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:08.767276 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:08.767292 6226 round_trippers.go:577] Response Headers:
I0222 20:44:08.767300 6226 round_trippers.go:580] Audit-Id: 45c16ec4-fdee-450f-9250-6578d52046c4
I0222 20:44:08.767307 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:08.767314 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:08.767322 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:08.767330 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:08.767338 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:08 GMT
I0222 20:44:08.767501 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:08.767859 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:08.767868 6226 round_trippers.go:469] Request Headers:
I0222 20:44:08.767876 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:08.767895 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:08.769486 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:08.769499 6226 round_trippers.go:577] Response Headers:
I0222 20:44:08.769505 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:08.769510 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:08.769514 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:08.769520 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:08.769525 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:08 GMT
I0222 20:44:08.769531 6226 round_trippers.go:580] Audit-Id: 173c44a0-e1f8-4e55-9e23-155bf8c03223
I0222 20:44:08.769587 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:09.264956 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:09.264982 6226 round_trippers.go:469] Request Headers:
I0222 20:44:09.264994 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:09.265006 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:09.268574 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:09.268589 6226 round_trippers.go:577] Response Headers:
I0222 20:44:09.268597 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:09.268604 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:09.268611 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:09.268642 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:09 GMT
I0222 20:44:09.268655 6226 round_trippers.go:580] Audit-Id: f79dc78a-64f1-46c0-8354-12a6a5d6104c
I0222 20:44:09.268671 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:09.268768 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:09.269122 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:09.269130 6226 round_trippers.go:469] Request Headers:
I0222 20:44:09.269152 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:09.269158 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:09.270767 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:09.270776 6226 round_trippers.go:577] Response Headers:
I0222 20:44:09.270782 6226 round_trippers.go:580] Audit-Id: 6803d20f-9809-4c1c-a975-3f877a9cc05c
I0222 20:44:09.270787 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:09.270791 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:09.270797 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:09.270802 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:09.270807 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:09 GMT
I0222 20:44:09.270950 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:09.271128 6226 pod_ready.go:102] pod "coredns-787d4945fb-b28zh" in "kube-system" namespace has status "Ready":"False"
I0222 20:44:09.765120 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:09.765134 6226 round_trippers.go:469] Request Headers:
I0222 20:44:09.765176 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:09.765182 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:09.767062 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:09.767071 6226 round_trippers.go:577] Response Headers:
I0222 20:44:09.767077 6226 round_trippers.go:580] Audit-Id: 7f127cd6-6b74-4dbf-bd1a-62f93e2d03a2
I0222 20:44:09.767081 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:09.767087 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:09.767091 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:09.767096 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:09.767101 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:09 GMT
I0222 20:44:09.767162 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:09.767421 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:09.767427 6226 round_trippers.go:469] Request Headers:
I0222 20:44:09.767432 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:09.767438 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:09.770551 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:09.770560 6226 round_trippers.go:577] Response Headers:
I0222 20:44:09.770565 6226 round_trippers.go:580] Audit-Id: 0881a2e1-1a36-4846-b9eb-b4e96834f788
I0222 20:44:09.770571 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:09.770576 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:09.770581 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:09.770585 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:09.770590 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:09 GMT
I0222 20:44:09.770687 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:10.264176 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:10.264200 6226 round_trippers.go:469] Request Headers:
I0222 20:44:10.264300 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:10.264312 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:10.266710 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:10.266724 6226 round_trippers.go:577] Response Headers:
I0222 20:44:10.266731 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:10.266739 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:10.266746 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:10.266777 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:10.266809 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:10 GMT
I0222 20:44:10.266825 6226 round_trippers.go:580] Audit-Id: a3f30560-919a-49d2-8a40-7ef0af4ec59c
I0222 20:44:10.266994 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:10.267345 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:10.267354 6226 round_trippers.go:469] Request Headers:
I0222 20:44:10.267362 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:10.267369 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:10.268914 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:10.268923 6226 round_trippers.go:577] Response Headers:
I0222 20:44:10.268928 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:10.268933 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:10.268938 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:10.268944 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:10.268951 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:10 GMT
I0222 20:44:10.268957 6226 round_trippers.go:580] Audit-Id: 968eb4df-0a57-451b-acf1-c77f1b8f1ac0
I0222 20:44:10.269065 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:10.764695 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:10.764724 6226 round_trippers.go:469] Request Headers:
I0222 20:44:10.764805 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:10.764817 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:10.767414 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:10.767431 6226 round_trippers.go:577] Response Headers:
I0222 20:44:10.767442 6226 round_trippers.go:580] Audit-Id: 92858708-515b-4cac-83b1-21e5b9655000
I0222 20:44:10.767452 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:10.767474 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:10.767482 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:10.767489 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:10.767495 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:10 GMT
I0222 20:44:10.767636 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:10.767997 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:10.768006 6226 round_trippers.go:469] Request Headers:
I0222 20:44:10.768014 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:10.768022 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:10.769491 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:10.769502 6226 round_trippers.go:577] Response Headers:
I0222 20:44:10.769508 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:10.769515 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:10.769523 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:10 GMT
I0222 20:44:10.769530 6226 round_trippers.go:580] Audit-Id: 381602ab-7a1a-4d81-88f8-9059bfdd8578
I0222 20:44:10.769539 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:10.769547 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:10.769629 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:11.264411 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:11.264434 6226 round_trippers.go:469] Request Headers:
I0222 20:44:11.264537 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:11.264551 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:11.266988 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:11.267002 6226 round_trippers.go:577] Response Headers:
I0222 20:44:11.267009 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:11.267042 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:11.267071 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:11.267082 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:11.267089 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:11 GMT
I0222 20:44:11.267097 6226 round_trippers.go:580] Audit-Id: 42fd0bdc-db81-4ad5-9ef6-251a235531f0
I0222 20:44:11.267427 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:11.267786 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:11.267794 6226 round_trippers.go:469] Request Headers:
I0222 20:44:11.267803 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:11.267811 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:11.269454 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:11.269461 6226 round_trippers.go:577] Response Headers:
I0222 20:44:11.269466 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:11.269473 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:11.269478 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:11.269483 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:11.269488 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:11 GMT
I0222 20:44:11.269492 6226 round_trippers.go:580] Audit-Id: 3a81ad9c-9b56-4bb9-82ed-6ca17a5709b5
I0222 20:44:11.269775 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:11.764476 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:11.764497 6226 round_trippers.go:469] Request Headers:
I0222 20:44:11.764510 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:11.764519 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:11.767540 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:11.767556 6226 round_trippers.go:577] Response Headers:
I0222 20:44:11.767564 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:11.767570 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:11.767577 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:11.767584 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:11 GMT
I0222 20:44:11.767590 6226 round_trippers.go:580] Audit-Id: c5a0afbd-6315-4a91-9e75-bba531584bc9
I0222 20:44:11.767596 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:11.767949 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:11.768316 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:11.768325 6226 round_trippers.go:469] Request Headers:
I0222 20:44:11.768333 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:11.768349 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:11.771446 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:11.771455 6226 round_trippers.go:577] Response Headers:
I0222 20:44:11.771461 6226 round_trippers.go:580] Audit-Id: 553a0b0b-9005-404b-8626-01408227ceb0
I0222 20:44:11.771466 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:11.771470 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:11.771475 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:11.771480 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:11.771484 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:11 GMT
I0222 20:44:11.771653 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:11.771829 6226 pod_ready.go:102] pod "coredns-787d4945fb-b28zh" in "kube-system" namespace has status "Ready":"False"
I0222 20:44:12.265324 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:12.265348 6226 round_trippers.go:469] Request Headers:
I0222 20:44:12.265360 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:12.265371 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:12.268188 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:12.268203 6226 round_trippers.go:577] Response Headers:
I0222 20:44:12.268210 6226 round_trippers.go:580] Audit-Id: 2eb6425a-5879-4634-bafb-46dd6700d2c7
I0222 20:44:12.268217 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:12.268224 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:12.268230 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:12.268238 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:12.268244 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:12 GMT
I0222 20:44:12.268330 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:12.268758 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:12.268766 6226 round_trippers.go:469] Request Headers:
I0222 20:44:12.268774 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:12.268781 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:12.271150 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:12.271166 6226 round_trippers.go:577] Response Headers:
I0222 20:44:12.271178 6226 round_trippers.go:580] Audit-Id: 3cb95f99-63b2-471e-ae9a-4f78e5813dcd
I0222 20:44:12.271188 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:12.271199 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:12.271208 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:12.271234 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:12.271246 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:12 GMT
I0222 20:44:12.271411 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:12.764175 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:12.764198 6226 round_trippers.go:469] Request Headers:
I0222 20:44:12.764211 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:12.764221 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:12.766648 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:12.766664 6226 round_trippers.go:577] Response Headers:
I0222 20:44:12.766675 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:12.766685 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:12 GMT
I0222 20:44:12.766695 6226 round_trippers.go:580] Audit-Id: ec257de5-c379-4eb4-8e15-37633011502b
I0222 20:44:12.766705 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:12.766714 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:12.766722 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:12.766794 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:12.767158 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:12.767167 6226 round_trippers.go:469] Request Headers:
I0222 20:44:12.767175 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:12.767182 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:12.768700 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:12.768709 6226 round_trippers.go:577] Response Headers:
I0222 20:44:12.768715 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:12.768719 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:12.768725 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:12 GMT
I0222 20:44:12.768730 6226 round_trippers.go:580] Audit-Id: 8e078d1b-c908-413e-ba11-1ace517fbedc
I0222 20:44:12.768734 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:12.768740 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:12.768803 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:13.266145 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:13.266170 6226 round_trippers.go:469] Request Headers:
I0222 20:44:13.266182 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:13.266192 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:13.269376 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:13.269391 6226 round_trippers.go:577] Response Headers:
I0222 20:44:13.269398 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:13 GMT
I0222 20:44:13.269405 6226 round_trippers.go:580] Audit-Id: 11e94372-8c17-4579-8221-d8d63463eec5
I0222 20:44:13.269412 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:13.269419 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:13.269426 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:13.269433 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:13.269500 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:13.269858 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:13.269866 6226 round_trippers.go:469] Request Headers:
I0222 20:44:13.269875 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:13.269882 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:13.271191 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:13.271203 6226 round_trippers.go:577] Response Headers:
I0222 20:44:13.271211 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:13.271219 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:13.271225 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:13 GMT
I0222 20:44:13.271230 6226 round_trippers.go:580] Audit-Id: f3772cfa-f6ed-48c9-9ddd-eb9dc2257df2
I0222 20:44:13.271236 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:13.271240 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:13.271308 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:13.764385 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:13.764407 6226 round_trippers.go:469] Request Headers:
I0222 20:44:13.764420 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:13.764430 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:13.767152 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:13.767169 6226 round_trippers.go:577] Response Headers:
I0222 20:44:13.767178 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:13.767187 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:13.767196 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:13.767203 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:13 GMT
I0222 20:44:13.767210 6226 round_trippers.go:580] Audit-Id: 28e49018-d28d-4d44-8d6d-4af083881ee0
I0222 20:44:13.767217 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:13.767601 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:13.767961 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:13.767970 6226 round_trippers.go:469] Request Headers:
I0222 20:44:13.767978 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:13.767985 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:13.769424 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:13.769434 6226 round_trippers.go:577] Response Headers:
I0222 20:44:13.769440 6226 round_trippers.go:580] Audit-Id: 9e913e33-df68-419a-ac00-4efa0c62a77f
I0222 20:44:13.769445 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:13.769450 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:13.769455 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:13.769460 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:13.769464 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:13 GMT
I0222 20:44:13.769517 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:14.264681 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:14.264700 6226 round_trippers.go:469] Request Headers:
I0222 20:44:14.264715 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:14.264725 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:14.267075 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:14.267094 6226 round_trippers.go:577] Response Headers:
I0222 20:44:14.267103 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:14.267110 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:14.267116 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:14.267123 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:14.267130 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:14 GMT
I0222 20:44:14.267137 6226 round_trippers.go:580] Audit-Id: db00c5fd-e5a3-44ba-a113-0ef248f5122d
I0222 20:44:14.267339 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:14.267703 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:14.267712 6226 round_trippers.go:469] Request Headers:
I0222 20:44:14.267720 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:14.267727 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:14.269022 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:14.269032 6226 round_trippers.go:577] Response Headers:
I0222 20:44:14.269040 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:14.269048 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:14 GMT
I0222 20:44:14.269057 6226 round_trippers.go:580] Audit-Id: f7eb2128-53f5-4377-8814-5d029916abf0
I0222 20:44:14.269065 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:14.269070 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:14.269080 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:14.269217 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:14.269384 6226 pod_ready.go:102] pod "coredns-787d4945fb-b28zh" in "kube-system" namespace has status "Ready":"False"
I0222 20:44:14.764353 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:14.764366 6226 round_trippers.go:469] Request Headers:
I0222 20:44:14.764373 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:14.764379 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:14.766054 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:14.766065 6226 round_trippers.go:577] Response Headers:
I0222 20:44:14.766072 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:14.766078 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:14.766086 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:14 GMT
I0222 20:44:14.766093 6226 round_trippers.go:580] Audit-Id: 12fab6d5-cdfa-4771-a0dc-6fac4c1ba565
I0222 20:44:14.766100 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:14.766104 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:14.766173 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:14.766448 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:14.766454 6226 round_trippers.go:469] Request Headers:
I0222 20:44:14.766460 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:14.766466 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:14.767709 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:14.767719 6226 round_trippers.go:577] Response Headers:
I0222 20:44:14.767724 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:14.767729 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:14.767734 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:14 GMT
I0222 20:44:14.767739 6226 round_trippers.go:580] Audit-Id: 25d70386-7bda-40fd-9ef8-2b74cc7b4444
I0222 20:44:14.767744 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:14.767749 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:14.767839 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:15.264047 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:15.264059 6226 round_trippers.go:469] Request Headers:
I0222 20:44:15.264065 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:15.264071 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:15.265873 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:15.265894 6226 round_trippers.go:577] Response Headers:
I0222 20:44:15.265901 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:15.265906 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:15.265911 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:15.265917 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:15 GMT
I0222 20:44:15.265921 6226 round_trippers.go:580] Audit-Id: b94f7e19-33df-4fe0-a7da-6b9b44df1051
I0222 20:44:15.265926 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:15.266110 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:15.266396 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:15.266402 6226 round_trippers.go:469] Request Headers:
I0222 20:44:15.266408 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:15.266414 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:15.269196 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:15.269205 6226 round_trippers.go:577] Response Headers:
I0222 20:44:15.269210 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:15.269214 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:15.269222 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:15.269229 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:15.269236 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:15 GMT
I0222 20:44:15.269243 6226 round_trippers.go:580] Audit-Id: fdccf124-fa4b-4f0a-937c-c8b645a44e8e
I0222 20:44:15.269344 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:15.765235 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:15.765252 6226 round_trippers.go:469] Request Headers:
I0222 20:44:15.765259 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:15.765264 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:15.766930 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:15.766941 6226 round_trippers.go:577] Response Headers:
I0222 20:44:15.766947 6226 round_trippers.go:580] Audit-Id: ad3f7a2d-6d0e-432e-b099-e1df465a3502
I0222 20:44:15.766952 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:15.766957 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:15.766962 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:15.766967 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:15.766972 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:15 GMT
I0222 20:44:15.767056 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"718","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6540 chars]
I0222 20:44:15.767351 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:15.767357 6226 round_trippers.go:469] Request Headers:
I0222 20:44:15.767363 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:15.767368 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:15.768661 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:15.768670 6226 round_trippers.go:577] Response Headers:
I0222 20:44:15.768676 6226 round_trippers.go:580] Audit-Id: 200500b1-0f4e-4320-864e-9e2ab6d58706
I0222 20:44:15.768701 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:15.768719 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:15.768736 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:15.768753 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:15.768764 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:15 GMT
I0222 20:44:15.768854 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:16.264448 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:44:16.264462 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.264471 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.264481 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.266882 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:16.266893 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.266899 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.266904 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.266909 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.266914 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.266919 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.266924 6226 round_trippers.go:580] Audit-Id: 9aff5b85-3114-4ccd-85bd-9df2db11e2d1
I0222 20:44:16.267060 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"820","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6488 chars]
I0222 20:44:16.267326 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:16.267332 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.267338 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.267344 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.268432 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.268441 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.268449 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.268457 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.268463 6226 round_trippers.go:580] Audit-Id: 789b09fc-a902-4265-b8bb-4eb8a4ee2cec
I0222 20:44:16.268471 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.268479 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.268486 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.268602 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:16.268777 6226 pod_ready.go:92] pod "coredns-787d4945fb-b28zh" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:16.268787 6226 pod_ready.go:81] duration metric: took 9.007901592s waiting for pod "coredns-787d4945fb-b28zh" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.268794 6226 pod_ready.go:78] waiting up to 6m0s for pod "etcd-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.268818 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/etcd-multinode-293000
I0222 20:44:16.268822 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.268828 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.268834 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.270061 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.270069 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.270074 6226 round_trippers.go:580] Audit-Id: 00a18d5f-570c-40d5-8f3d-738dc1fc7e24
I0222 20:44:16.270079 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.270085 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.270091 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.270097 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.270101 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.270276 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"etcd-multinode-293000","namespace":"kube-system","uid":"2363a307-e6f7-4025-ae02-4920adde4561","resourceVersion":"793","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.64.12:2379","kubernetes.io/config.hash":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.mirror":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.seen":"2023-02-23T04:40:26.073140598Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-c
lient-urls":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config [truncated 6055 chars]
I0222 20:44:16.270475 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:16.270481 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.270487 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.270492 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.271618 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.271629 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.271638 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.271646 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.271653 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.271661 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.271670 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.271674 6226 round_trippers.go:580] Audit-Id: 07cb834d-60ce-465b-a06e-86da6a177ebb
I0222 20:44:16.271763 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:16.271930 6226 pod_ready.go:92] pod "etcd-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:16.271936 6226 pod_ready.go:81] duration metric: took 3.13713ms waiting for pod "etcd-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.271945 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.271970 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-multinode-293000
I0222 20:44:16.271973 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.271979 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.271986 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.273216 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.273225 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.273231 6226 round_trippers.go:580] Audit-Id: 9286c743-fe6c-4a61-8602-18a3a8831b50
I0222 20:44:16.273250 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.273261 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.273275 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.273286 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.273297 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.273365 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-apiserver-multinode-293000","namespace":"kube-system","uid":"bb2fc1a3-12c1-4854-8f8c-3c1c5664067c","resourceVersion":"748","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-apiserver","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.64.12:8443","kubernetes.io/config.hash":"578ff397a5454283a55e183c76494192","kubernetes.io/config.mirror":"578ff397a5454283a55e183c76494192","kubernetes.io/config.seen":"2023-02-23T04:40:26.073157361Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kub
ernetes.io/kube-apiserver.advertise-address.endpoint":{},"f:kubernetes. [truncated 7590 chars]
I0222 20:44:16.273583 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:16.273589 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.273595 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.273601 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.274859 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.274869 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.274875 6226 round_trippers.go:580] Audit-Id: 29b9a3ee-8f69-43bb-ac15-9b00159b8a92
I0222 20:44:16.274880 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.274885 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.274889 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.274894 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.274900 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.274955 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:16.275121 6226 pod_ready.go:92] pod "kube-apiserver-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:16.275128 6226 pod_ready.go:81] duration metric: took 3.176067ms waiting for pod "kube-apiserver-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.275133 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.275158 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-multinode-293000
I0222 20:44:16.275163 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.275168 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.275174 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.276689 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.276697 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.276703 6226 round_trippers.go:580] Audit-Id: 7aacf995-a637-4a9c-ab11-b9ba5705cba4
I0222 20:44:16.276709 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.276714 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.276719 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.276724 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.276729 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.276789 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-controller-manager-multinode-293000","namespace":"kube-system","uid":"e60be5dc-4ed1-4a87-b03c-2ac01b03001d","resourceVersion":"742","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-controller-manager","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"02b271251b67ef9dd552c569d01153ca","kubernetes.io/config.mirror":"02b271251b67ef9dd552c569d01153ca","kubernetes.io/config.seen":"2023-02-23T04:40:26.073158360Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.i
o/config.seen":{},"f:kubernetes.io/config.source":{}},"f:labels":{".":{ [truncated 7158 chars]
I0222 20:44:16.277000 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:16.277006 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.277011 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.277018 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.278138 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.278146 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.278152 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.278169 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.278176 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.278183 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.278190 6226 round_trippers.go:580] Audit-Id: 6b3b9bca-35a6-4dac-9663-e52d847924bc
I0222 20:44:16.278197 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.278315 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:16.278490 6226 pod_ready.go:92] pod "kube-controller-manager-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:16.278496 6226 pod_ready.go:81] duration metric: took 3.357195ms waiting for pod "kube-controller-manager-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.278501 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-bj985" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.278526 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bj985
I0222 20:44:16.278530 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.278536 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.278541 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.279713 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.279725 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.279734 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.279743 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.279749 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.279754 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.279759 6226 round_trippers.go:580] Audit-Id: cc3e2a6e-0607-4c81-bdfb-dac4d8d3254e
I0222 20:44:16.279764 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.280023 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-bj985","generateName":"kube-proxy-","namespace":"kube-system","uid":"36f7816d-0b3e-4210-be32-907bf62dfa61","resourceVersion":"687","creationTimestamp":"2023-02-23T04:42:15Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:42:15Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5746 chars]
I0222 20:44:16.280234 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m03
I0222 20:44:16.280239 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.280245 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.280251 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.281261 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:16.281270 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.281276 6226 round_trippers.go:580] Audit-Id: 0cc60e92-b744-4e06-b505-28009a1cb41a
I0222 20:44:16.281285 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.281290 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.281295 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.281301 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.281305 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.281449 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m03","uid":"181ccd63-a7fc-412c-bfee-446a1e65f4b4","resourceVersion":"778","creationTimestamp":"2023-02-23T04:42:56Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m03","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:42:56Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{
}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 4329 chars]
I0222 20:44:16.281596 6226 pod_ready.go:92] pod "kube-proxy-bj985" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:16.281602 6226 pod_ready.go:81] duration metric: took 3.096381ms waiting for pod "kube-proxy-bj985" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.281607 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-pxq2s" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.465001 6226 request.go:622] Waited for 183.361238ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pxq2s
I0222 20:44:16.465048 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pxq2s
I0222 20:44:16.465061 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.465160 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.465178 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.468885 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:16.468908 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.468920 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.468931 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.468942 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.468949 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.468956 6226 round_trippers.go:580] Audit-Id: 6508f5b4-46ab-4b16-b8ea-c874adb655e1
I0222 20:44:16.468963 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.469300 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-pxq2s","generateName":"kube-proxy-","namespace":"kube-system","uid":"0ce24b37-1ce7-4772-b40d-5f88f10aaa4b","resourceVersion":"720","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5738 chars]
I0222 20:44:16.666094 6226 request.go:622] Waited for 196.314811ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:16.666143 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:16.666152 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.666164 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.666177 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.669323 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:16.669338 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.669346 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.669358 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.669365 6226 round_trippers.go:580] Audit-Id: bcdfa0f0-1c74-49f0-aaa5-702c6c9ced53
I0222 20:44:16.669372 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.669378 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.669386 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.669711 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:16.669963 6226 pod_ready.go:92] pod "kube-proxy-pxq2s" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:16.669971 6226 pod_ready.go:81] duration metric: took 388.366863ms waiting for pod "kube-proxy-pxq2s" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.669979 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-qmsbf" in "kube-system" namespace to be "Ready" ...
I0222 20:44:16.864558 6226 request.go:622] Waited for 194.458236ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qmsbf
I0222 20:44:16.864611 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qmsbf
I0222 20:44:16.864621 6226 round_trippers.go:469] Request Headers:
I0222 20:44:16.864633 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:16.864648 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:16.867216 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:16.867232 6226 round_trippers.go:577] Response Headers:
I0222 20:44:16.867240 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:16.867247 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:16.867258 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:16.867267 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:16.867274 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:16 GMT
I0222 20:44:16.867282 6226 round_trippers.go:580] Audit-Id: a5698c87-87ce-4609-9e12-d4dfc265ae78
I0222 20:44:16.867645 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-qmsbf","generateName":"kube-proxy-","namespace":"kube-system","uid":"98395ed9-2055-48e0-8d84-b931dfc0d9c7","resourceVersion":"486","creationTimestamp":"2023-02-23T04:41:26Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:41:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5541 chars]
I0222 20:44:17.064975 6226 request.go:622] Waited for 197.015626ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:44:17.065068 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:44:17.065075 6226 round_trippers.go:469] Request Headers:
I0222 20:44:17.065083 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:17.065093 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:17.067331 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:17.067344 6226 round_trippers.go:577] Response Headers:
I0222 20:44:17.067350 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:17 GMT
I0222 20:44:17.067355 6226 round_trippers.go:580] Audit-Id: 9c308762-72a2-41b1-9b17-e2380e2468a4
I0222 20:44:17.067360 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:17.067365 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:17.067371 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:17.067375 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:17.067469 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"f968bf76-422f-4a90-ba94-df00a7b8efaa","resourceVersion":"592","creationTimestamp":"2023-02-23T04:41:26Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:41:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:41:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.ku
bernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f [truncated 4512 chars]
I0222 20:44:17.067643 6226 pod_ready.go:92] pod "kube-proxy-qmsbf" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:17.067649 6226 pod_ready.go:81] duration metric: took 397.67161ms waiting for pod "kube-proxy-qmsbf" in "kube-system" namespace to be "Ready" ...
I0222 20:44:17.067655 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:17.265411 6226 request.go:622] Waited for 197.701959ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-293000
I0222 20:44:17.265497 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-293000
I0222 20:44:17.265502 6226 round_trippers.go:469] Request Headers:
I0222 20:44:17.265508 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:17.265513 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:17.267192 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:44:17.267203 6226 round_trippers.go:577] Response Headers:
I0222 20:44:17.267211 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:17 GMT
I0222 20:44:17.267218 6226 round_trippers.go:580] Audit-Id: cc5b70b7-a43d-48f8-a370-b6560f684dbf
I0222 20:44:17.267227 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:17.267234 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:17.267239 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:17.267245 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:17.267305 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-scheduler-multinode-293000","namespace":"kube-system","uid":"deb74301-35df-47d1-a8a9-f59943186666","resourceVersion":"772","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-scheduler","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"ef6d7c628504525048f2a505fc91f554","kubernetes.io/config.mirror":"ef6d7c628504525048f2a505fc91f554","kubernetes.io/config.seen":"2023-02-23T04:40:26.073159188Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.io/config.seen":{},
"f:kubernetes.io/config.source":{}},"f:labels":{".":{},"f:component":{} [truncated 4888 chars]
I0222 20:44:17.464729 6226 request.go:622] Waited for 197.064672ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:17.464776 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:44:17.464784 6226 round_trippers.go:469] Request Headers:
I0222 20:44:17.464795 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:17.464806 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:17.467524 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:17.467539 6226 round_trippers.go:577] Response Headers:
I0222 20:44:17.467548 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:17 GMT
I0222 20:44:17.467554 6226 round_trippers.go:580] Audit-Id: 004c21fc-0837-4add-9738-fc3388fc99ad
I0222 20:44:17.467561 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:17.467568 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:17.467575 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:17.467583 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:17.467727 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:44:17.467977 6226 pod_ready.go:92] pod "kube-scheduler-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:44:17.467985 6226 pod_ready.go:81] duration metric: took 400.33221ms waiting for pod "kube-scheduler-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:44:17.467994 6226 pod_ready.go:38] duration metric: took 10.213039891s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0222 20:44:17.468006 6226 api_server.go:51] waiting for apiserver process to appear ...
I0222 20:44:17.468069 6226 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0222 20:44:17.477987 6226 command_runner.go:130] > 1661
I0222 20:44:17.478089 6226 api_server.go:71] duration metric: took 14.318811842s to wait for apiserver process to appear ...
I0222 20:44:17.478099 6226 api_server.go:87] waiting for apiserver healthz status ...
I0222 20:44:17.478106 6226 api_server.go:252] Checking apiserver healthz at https://192.168.64.12:8443/healthz ...
I0222 20:44:17.482844 6226 api_server.go:278] https://192.168.64.12:8443/healthz returned 200:
ok
I0222 20:44:17.482871 6226 round_trippers.go:463] GET https://192.168.64.12:8443/version
I0222 20:44:17.482878 6226 round_trippers.go:469] Request Headers:
I0222 20:44:17.482884 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:17.482890 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:17.483402 6226 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds
I0222 20:44:17.483413 6226 round_trippers.go:577] Response Headers:
I0222 20:44:17.483419 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:17 GMT
I0222 20:44:17.483425 6226 round_trippers.go:580] Audit-Id: ef2f8f70-b6f7-498f-a2be-d59c6fa0bfe1
I0222 20:44:17.483430 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:17.483436 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:17.483440 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:17.483446 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:17.483450 6226 round_trippers.go:580] Content-Length: 263
I0222 20:44:17.483461 6226 request.go:1171] Response Body: {
"major": "1",
"minor": "26",
"gitVersion": "v1.26.1",
"gitCommit": "8f94681cd294aa8cfd3407b8191f6c70214973a4",
"gitTreeState": "clean",
"buildDate": "2023-01-18T15:51:25Z",
"goVersion": "go1.19.5",
"compiler": "gc",
"platform": "linux/amd64"
}
I0222 20:44:17.483484 6226 api_server.go:140] control plane version: v1.26.1
I0222 20:44:17.483490 6226 api_server.go:130] duration metric: took 5.387882ms to wait for apiserver health ...
I0222 20:44:17.483494 6226 system_pods.go:43] waiting for kube-system pods to appear ...
I0222 20:44:17.665991 6226 request.go:622] Waited for 182.44557ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:44:17.666094 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:44:17.666186 6226 round_trippers.go:469] Request Headers:
I0222 20:44:17.666199 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:17.666210 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:17.670524 6226 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0222 20:44:17.670539 6226 round_trippers.go:577] Response Headers:
I0222 20:44:17.670548 6226 round_trippers.go:580] Audit-Id: 3e1987d2-6012-4d63-9868-1e1c22301cd5
I0222 20:44:17.670560 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:17.670574 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:17.670582 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:17.670591 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:17.670602 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:17 GMT
I0222 20:44:17.671600 6226 request.go:1171] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"835"},"items":[{"metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"820","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f
:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 82825 chars]
I0222 20:44:17.673381 6226 system_pods.go:59] 12 kube-system pods found
I0222 20:44:17.673392 6226 system_pods.go:61] "coredns-787d4945fb-b28zh" [307635d3-a26b-4eff-be8a-9d65e1f996c3] Running
I0222 20:44:17.673396 6226 system_pods.go:61] "etcd-multinode-293000" [2363a307-e6f7-4025-ae02-4920adde4561] Running
I0222 20:44:17.673400 6226 system_pods.go:61] "kindnet-bzxtr" [b3092ad6-e39a-43f2-8a95-ead97184aa40] Running
I0222 20:44:17.673403 6226 system_pods.go:61] "kindnet-nm7kn" [061817b8-aa21-408e-b432-53850cf8eb6d] Running
I0222 20:44:17.673407 6226 system_pods.go:61] "kindnet-rrx46" [df2ad52c-df28-46f4-b739-812ad756ed0e] Running
I0222 20:44:17.673411 6226 system_pods.go:61] "kube-apiserver-multinode-293000" [bb2fc1a3-12c1-4854-8f8c-3c1c5664067c] Running
I0222 20:44:17.673415 6226 system_pods.go:61] "kube-controller-manager-multinode-293000" [e60be5dc-4ed1-4a87-b03c-2ac01b03001d] Running
I0222 20:44:17.673419 6226 system_pods.go:61] "kube-proxy-bj985" [36f7816d-0b3e-4210-be32-907bf62dfa61] Running
I0222 20:44:17.673423 6226 system_pods.go:61] "kube-proxy-pxq2s" [0ce24b37-1ce7-4772-b40d-5f88f10aaa4b] Running
I0222 20:44:17.673426 6226 system_pods.go:61] "kube-proxy-qmsbf" [98395ed9-2055-48e0-8d84-b931dfc0d9c7] Running
I0222 20:44:17.673431 6226 system_pods.go:61] "kube-scheduler-multinode-293000" [deb74301-35df-47d1-a8a9-f59943186666] Running
I0222 20:44:17.673435 6226 system_pods.go:61] "storage-provisioner" [2e7410db-637a-4d25-9f92-f5e551a32c8d] Running
I0222 20:44:17.673439 6226 system_pods.go:74] duration metric: took 189.94454ms to wait for pod list to return data ...
I0222 20:44:17.673444 6226 default_sa.go:34] waiting for default service account to be created ...
I0222 20:44:17.866499 6226 request.go:622] Waited for 192.919272ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/default/serviceaccounts
I0222 20:44:17.866546 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/default/serviceaccounts
I0222 20:44:17.866555 6226 round_trippers.go:469] Request Headers:
I0222 20:44:17.866568 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:17.866580 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:17.869520 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:44:17.869535 6226 round_trippers.go:577] Response Headers:
I0222 20:44:17.869544 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:17.869550 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:17.869557 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:17.869563 6226 round_trippers.go:580] Content-Length: 261
I0222 20:44:17.869571 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:17 GMT
I0222 20:44:17.869578 6226 round_trippers.go:580] Audit-Id: e0a0acca-af45-4711-adc6-98f94ed5914a
I0222 20:44:17.869585 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:17.869599 6226 request.go:1171] Response Body: {"kind":"ServiceAccountList","apiVersion":"v1","metadata":{"resourceVersion":"836"},"items":[{"metadata":{"name":"default","namespace":"default","uid":"71d0bf82-edd0-4f65-8a8a-5f4b6f0937d3","resourceVersion":"306","creationTimestamp":"2023-02-23T04:40:39Z"}}]}
I0222 20:44:17.869724 6226 default_sa.go:45] found service account: "default"
I0222 20:44:17.869732 6226 default_sa.go:55] duration metric: took 196.287277ms for default service account to be created ...
I0222 20:44:17.869738 6226 system_pods.go:116] waiting for k8s-apps to be running ...
I0222 20:44:18.065114 6226 request.go:622] Waited for 195.323511ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:44:18.065289 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:44:18.065300 6226 round_trippers.go:469] Request Headers:
I0222 20:44:18.065313 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:18.065324 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:18.069574 6226 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds
I0222 20:44:18.069596 6226 round_trippers.go:577] Response Headers:
I0222 20:44:18.069609 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:18 GMT
I0222 20:44:18.069620 6226 round_trippers.go:580] Audit-Id: ca355e49-0cad-4659-80b7-9b110475e53b
I0222 20:44:18.069630 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:18.069655 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:18.069691 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:18.069703 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:18.070211 6226 request.go:1171] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"837"},"items":[{"metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"820","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f
:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 82825 chars]
I0222 20:44:18.072135 6226 system_pods.go:86] 12 kube-system pods found
I0222 20:44:18.072144 6226 system_pods.go:89] "coredns-787d4945fb-b28zh" [307635d3-a26b-4eff-be8a-9d65e1f996c3] Running
I0222 20:44:18.072148 6226 system_pods.go:89] "etcd-multinode-293000" [2363a307-e6f7-4025-ae02-4920adde4561] Running
I0222 20:44:18.072159 6226 system_pods.go:89] "kindnet-bzxtr" [b3092ad6-e39a-43f2-8a95-ead97184aa40] Running
I0222 20:44:18.072162 6226 system_pods.go:89] "kindnet-nm7kn" [061817b8-aa21-408e-b432-53850cf8eb6d] Running
I0222 20:44:18.072167 6226 system_pods.go:89] "kindnet-rrx46" [df2ad52c-df28-46f4-b739-812ad756ed0e] Running
I0222 20:44:18.072170 6226 system_pods.go:89] "kube-apiserver-multinode-293000" [bb2fc1a3-12c1-4854-8f8c-3c1c5664067c] Running
I0222 20:44:18.072174 6226 system_pods.go:89] "kube-controller-manager-multinode-293000" [e60be5dc-4ed1-4a87-b03c-2ac01b03001d] Running
I0222 20:44:18.072178 6226 system_pods.go:89] "kube-proxy-bj985" [36f7816d-0b3e-4210-be32-907bf62dfa61] Running
I0222 20:44:18.072182 6226 system_pods.go:89] "kube-proxy-pxq2s" [0ce24b37-1ce7-4772-b40d-5f88f10aaa4b] Running
I0222 20:44:18.072185 6226 system_pods.go:89] "kube-proxy-qmsbf" [98395ed9-2055-48e0-8d84-b931dfc0d9c7] Running
I0222 20:44:18.072189 6226 system_pods.go:89] "kube-scheduler-multinode-293000" [deb74301-35df-47d1-a8a9-f59943186666] Running
I0222 20:44:18.072193 6226 system_pods.go:89] "storage-provisioner" [2e7410db-637a-4d25-9f92-f5e551a32c8d] Running
I0222 20:44:18.072197 6226 system_pods.go:126] duration metric: took 202.458774ms to wait for k8s-apps to be running ...
I0222 20:44:18.072205 6226 system_svc.go:44] waiting for kubelet service to be running ....
I0222 20:44:18.072284 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0222 20:44:18.081691 6226 system_svc.go:56] duration metric: took 9.468944ms WaitForService to wait for kubelet.
I0222 20:44:18.081722 6226 kubeadm.go:578] duration metric: took 14.922456497s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
I0222 20:44:18.081734 6226 node_conditions.go:102] verifying NodePressure condition ...
I0222 20:44:18.264949 6226 request.go:622] Waited for 183.145764ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes
I0222 20:44:18.265042 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes
I0222 20:44:18.265053 6226 round_trippers.go:469] Request Headers:
I0222 20:44:18.265144 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:44:18.265157 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:44:18.268325 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:44:18.268341 6226 round_trippers.go:577] Response Headers:
I0222 20:44:18.268349 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:44:18 GMT
I0222 20:44:18.268363 6226 round_trippers.go:580] Audit-Id: a4ce575e-6173-4624-bdc5-1069842928a1
I0222 20:44:18.268371 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:44:18.268378 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:44:18.268385 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:44:18.268393 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:44:18.268553 6226 request.go:1171] Response Body: {"kind":"NodeList","apiVersion":"v1","metadata":{"resourceVersion":"837"},"items":[{"metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFiel
ds":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time" [truncated 16207 chars]
I0222 20:44:18.269085 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:44:18.269098 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:44:18.269107 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:44:18.269112 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:44:18.269116 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:44:18.269120 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:44:18.269124 6226 node_conditions.go:105] duration metric: took 187.390549ms to run NodePressure ...
I0222 20:44:18.269133 6226 start.go:228] waiting for startup goroutines ...
I0222 20:44:18.269141 6226 start.go:233] waiting for cluster config update ...
I0222 20:44:18.269148 6226 start.go:242] writing updated cluster config ...
I0222 20:44:18.269899 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:44:18.269957 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:44:18.292139 6226 out.go:177] * Starting worker node multinode-293000-m02 in cluster multinode-293000
I0222 20:44:18.313718 6226 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0222 20:44:18.313795 6226 cache.go:57] Caching tarball of preloaded images
I0222 20:44:18.313962 6226 preload.go:174] Found /Users/jenkins/minikube-integration/15909-2565/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0222 20:44:18.313981 6226 cache.go:60] Finished verifying existence of preloaded tar for v1.26.1 on docker
I0222 20:44:18.314108 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:44:18.315140 6226 cache.go:193] Successfully downloaded all kic artifacts
I0222 20:44:18.315171 6226 start.go:364] acquiring machines lock for multinode-293000-m02: {Name:mk88cf87535f73dae2b0686647d170168e328899 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0222 20:44:18.315260 6226 start.go:368] acquired machines lock for "multinode-293000-m02" in 71.209µs
I0222 20:44:18.315291 6226 start.go:96] Skipping create...Using existing machine configuration
I0222 20:44:18.315297 6226 fix.go:55] fixHost starting: m02
I0222 20:44:18.315701 6226 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0222 20:44:18.315727 6226 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0222 20:44:18.323356 6226 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51529
I0222 20:44:18.323693 6226 main.go:141] libmachine: () Calling .GetVersion
I0222 20:44:18.324020 6226 main.go:141] libmachine: Using API Version 1
I0222 20:44:18.324032 6226 main.go:141] libmachine: () Calling .SetConfigRaw
I0222 20:44:18.324229 6226 main.go:141] libmachine: () Calling .GetMachineName
I0222 20:44:18.324349 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:18.324438 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetState
I0222 20:44:18.324542 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:44:18.324612 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | hyperkit pid from json: 5763
I0222 20:44:18.325448 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | hyperkit pid 5763 missing from process table
I0222 20:44:18.325488 6226 fix.go:103] recreateIfNeeded on multinode-293000-m02: state=Stopped err=<nil>
I0222 20:44:18.325498 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
W0222 20:44:18.325584 6226 fix.go:129] unexpected machine state, will restart: <nil>
I0222 20:44:18.347007 6226 out.go:177] * Restarting existing hyperkit VM for "multinode-293000-m02" ...
I0222 20:44:18.368943 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .Start
I0222 20:44:18.369239 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:44:18.369278 6226 main.go:141] libmachine: (multinode-293000-m02) minikube might have been shutdown in an unclean way, the hyperkit pid file still exists: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/hyperkit.pid
I0222 20:44:18.370884 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | hyperkit pid 5763 missing from process table
I0222 20:44:18.370904 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | pid 5763 is in state "Stopped"
I0222 20:44:18.370995 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Removing stale pid file /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/hyperkit.pid...
I0222 20:44:18.371117 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Using UUID 3f0c1c76-b334-11ed-affa-149d997fca88
I0222 20:44:18.398443 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Generated MAC f6:5a:53:47:16:21
I0222 20:44:18.398464 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000
I0222 20:44:18.398601 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"3f0c1c76-b334-11ed-affa-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0003d4030)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/bzimage", Initrd:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""
, process:(*os.Process)(nil)}
I0222 20:44:18.398643 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"3f0c1c76-b334-11ed-affa-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0003d4030)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/bzimage", Initrd:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""
, process:(*os.Process)(nil)}
I0222 20:44:18.398754 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "3f0c1c76-b334-11ed-affa-149d997fca88", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/multinode-293000-m02.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/tty,log=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/bzimage,/Users/j
enkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000"}
I0222 20:44:18.398803 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U 3f0c1c76-b334-11ed-affa-149d997fca88 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/multinode-293000-m02.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/tty,log=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/console-ring -f kexec,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/bzimage,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/mult
inode-293000-m02/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000"
I0222 20:44:18.398818 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 DEBUG: hyperkit: Redirecting stdout/stderr to logger
I0222 20:44:18.399962 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 DEBUG: hyperkit: Pid is 6299
I0222 20:44:18.400427 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Attempt 0
I0222 20:44:18.400440 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:44:18.400543 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | hyperkit pid from json: 6299
I0222 20:44:18.402158 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Searching for f6:5a:53:47:16:21 in /var/db/dhcpd_leases ...
I0222 20:44:18.402215 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Found 13 entries in /var/db/dhcpd_leases!
I0222 20:44:18.402229 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.12 HWAddress:8e:8:26:1e:84:48 ID:1,8e:8:26:1e:84:48 Lease:0x63f84076}
I0222 20:44:18.402252 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.14 HWAddress:66:3a:f:a5:79:1d ID:1,66:3a:f:a5:79:1d Lease:0x63f6eeed}
I0222 20:44:18.402271 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.13 HWAddress:f6:5a:53:47:16:21 ID:1,f6:5a:53:47:16:21 Lease:0x63f83fd9}
I0222 20:44:18.402284 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | Found match: f6:5a:53:47:16:21
I0222 20:44:18.402297 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | IP: 192.168.64.13
I0222 20:44:18.402329 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetConfigRaw
I0222 20:44:18.402954 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetIP
I0222 20:44:18.403138 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:44:18.403429 6226 machine.go:88] provisioning docker machine ...
I0222 20:44:18.403439 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:18.403544 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetMachineName
I0222 20:44:18.403632 6226 buildroot.go:166] provisioning hostname "multinode-293000-m02"
I0222 20:44:18.403642 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetMachineName
I0222 20:44:18.403721 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:18.403810 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:18.403888 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:18.403971 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:18.404051 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:18.404165 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:44:18.404483 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.13 22 <nil> <nil>}
I0222 20:44:18.404492 6226 main.go:141] libmachine: About to run SSH command:
sudo hostname multinode-293000-m02 && echo "multinode-293000-m02" | sudo tee /etc/hostname
I0222 20:44:18.406984 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: Using fd 5 for I/O notifications
I0222 20:44:18.415205 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD
I0222 20:44:18.415897 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I0222 20:44:18.415908 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I0222 20:44:18.415916 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I0222 20:44:18.415923 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I0222 20:44:18.772792 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0
I0222 20:44:18.772807 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0
I0222 20:44:18.876799 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I0222 20:44:18.876820 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I0222 20:44:18.876832 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I0222 20:44:18.876843 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I0222 20:44:18.877726 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1
I0222 20:44:18.877739 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:18 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1
I0222 20:44:23.406461 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:23 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1
I0222 20:44:23.406541 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:23 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1
I0222 20:44:23.406553 6226 main.go:141] libmachine: (multinode-293000-m02) DBG | 2023/02/22 20:44:23 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1
I0222 20:44:53.477402 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-293000-m02
I0222 20:44:53.477418 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:53.477563 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:53.477664 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.477758 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.477849 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:53.477977 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:44:53.478294 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.13 22 <nil> <nil>}
I0222 20:44:53.478307 6226 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smultinode-293000-m02' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-293000-m02/g' /etc/hosts;
else
echo '127.0.1.1 multinode-293000-m02' | sudo tee -a /etc/hosts;
fi
fi
I0222 20:44:53.544756 6226 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0222 20:44:53.544770 6226 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/15909-2565/.minikube CaCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15909-2565/.minikube}
I0222 20:44:53.544779 6226 buildroot.go:174] setting up certificates
I0222 20:44:53.544784 6226 provision.go:83] configureAuth start
I0222 20:44:53.544791 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetMachineName
I0222 20:44:53.544923 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetIP
I0222 20:44:53.545028 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:53.545139 6226 provision.go:138] copyHostCerts
I0222 20:44:53.545172 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem
I0222 20:44:53.545216 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem, removing ...
I0222 20:44:53.545221 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem
I0222 20:44:53.545374 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem (1082 bytes)
I0222 20:44:53.545549 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem
I0222 20:44:53.545581 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem, removing ...
I0222 20:44:53.545585 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem
I0222 20:44:53.545652 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem (1123 bytes)
I0222 20:44:53.545778 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem
I0222 20:44:53.545808 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem, removing ...
I0222 20:44:53.545815 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem
I0222 20:44:53.545964 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem (1679 bytes)
I0222 20:44:53.546090 6226 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem org=jenkins.multinode-293000-m02 san=[192.168.64.13 192.168.64.13 localhost 127.0.0.1 minikube multinode-293000-m02]
I0222 20:44:53.652741 6226 provision.go:172] copyRemoteCerts
I0222 20:44:53.652797 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0222 20:44:53.652815 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:53.653010 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:53.653108 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.653190 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:53.653273 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.13 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/id_rsa Username:docker}
I0222 20:44:53.687999 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0222 20:44:53.688076 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0222 20:44:53.703888 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0222 20:44:53.703956 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0222 20:44:53.719429 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem -> /etc/docker/server.pem
I0222 20:44:53.719490 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem --> /etc/docker/server.pem (1237 bytes)
I0222 20:44:53.735372 6226 provision.go:86] duration metric: configureAuth took 190.57721ms
I0222 20:44:53.735382 6226 buildroot.go:189] setting minikube options for container-runtime
I0222 20:44:53.735542 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:44:53.735555 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:53.735690 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:53.735787 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:53.735879 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.735970 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.736063 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:53.736175 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:44:53.736478 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.13 22 <nil> <nil>}
I0222 20:44:53.736486 6226 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0222 20:44:53.795863 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I0222 20:44:53.795880 6226 buildroot.go:70] root file system type: tmpfs
I0222 20:44:53.795964 6226 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0222 20:44:53.795974 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:53.796105 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:53.796200 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.796284 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.796364 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:53.796494 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:44:53.796812 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.13 22 <nil> <nil>}
I0222 20:44:53.796859 6226 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
Environment="NO_PROXY=192.168.64.12"
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0222 20:44:53.864199 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
Environment=NO_PROXY=192.168.64.12
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0222 20:44:53.864218 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:53.864366 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:53.864480 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.864566 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:53.864681 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:53.864817 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:44:53.865130 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.13 22 <nil> <nil>}
I0222 20:44:53.865143 6226 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0222 20:44:54.360954 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I0222 20:44:54.360968 6226 machine.go:91] provisioned docker machine in 35.958184105s
I0222 20:44:54.360974 6226 start.go:300] post-start starting for "multinode-293000-m02" (driver="hyperkit")
I0222 20:44:54.360979 6226 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0222 20:44:54.360992 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:54.361201 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0222 20:44:54.361214 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:54.361302 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:54.361406 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:54.361507 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:54.361602 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.13 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/id_rsa Username:docker}
I0222 20:44:54.400276 6226 ssh_runner.go:195] Run: cat /etc/os-release
I0222 20:44:54.402664 6226 command_runner.go:130] > NAME=Buildroot
I0222 20:44:54.402674 6226 command_runner.go:130] > VERSION=2021.02.12-1-g41e8300-dirty
I0222 20:44:54.402678 6226 command_runner.go:130] > ID=buildroot
I0222 20:44:54.402682 6226 command_runner.go:130] > VERSION_ID=2021.02.12
I0222 20:44:54.402686 6226 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"
I0222 20:44:54.402857 6226 info.go:137] Remote host: Buildroot 2021.02.12
I0222 20:44:54.402868 6226 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15909-2565/.minikube/addons for local assets ...
I0222 20:44:54.402953 6226 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15909-2565/.minikube/files for local assets ...
I0222 20:44:54.403108 6226 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> 30412.pem in /etc/ssl/certs
I0222 20:44:54.403114 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> /etc/ssl/certs/30412.pem
I0222 20:44:54.403286 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0222 20:44:54.409793 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem --> /etc/ssl/certs/30412.pem (1708 bytes)
I0222 20:44:54.425170 6226 start.go:303] post-start completed in 64.188612ms
I0222 20:44:54.425187 6226 fix.go:57] fixHost completed within 36.110540871s
I0222 20:44:54.425199 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:54.425327 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:54.425416 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:54.425506 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:54.425587 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:54.425700 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:44:54.426001 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.13 22 <nil> <nil>}
I0222 20:44:54.426009 6226 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0222 20:44:54.486606 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: 1677127494.596382578
I0222 20:44:54.486618 6226 fix.go:207] guest clock: 1677127494.596382578
I0222 20:44:54.486624 6226 fix.go:220] Guest: 2023-02-22 20:44:54.596382578 -0800 PST Remote: 2023-02-22 20:44:54.425189 -0800 PST m=+87.890504206 (delta=171.193578ms)
I0222 20:44:54.486633 6226 fix.go:191] guest clock delta is within tolerance: 171.193578ms
I0222 20:44:54.486637 6226 start.go:83] releasing machines lock for "multinode-293000-m02", held for 36.17202281s
I0222 20:44:54.486657 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:54.486788 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetIP
I0222 20:44:54.508269 6226 out.go:177] * Found network options:
I0222 20:44:54.529274 6226 out.go:177] - NO_PROXY=192.168.64.12
W0222 20:44:54.551353 6226 proxy.go:119] fail to check proxy env: Error ip not in block
I0222 20:44:54.551402 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:54.552295 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:54.552564 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .DriverName
I0222 20:44:54.552701 6226 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0222 20:44:54.552745 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
W0222 20:44:54.552769 6226 proxy.go:119] fail to check proxy env: Error ip not in block
I0222 20:44:54.552870 6226 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0222 20:44:54.552904 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHHostname
I0222 20:44:54.552933 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:54.553103 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHPort
I0222 20:44:54.553139 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:54.553307 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHKeyPath
I0222 20:44:54.553324 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:54.553460 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.13 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/id_rsa Username:docker}
I0222 20:44:54.553516 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetSSHUsername
I0222 20:44:54.553671 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.13 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m02/id_rsa Username:docker}
I0222 20:44:54.586460 6226 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory
W0222 20:44:54.586481 6226 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0222 20:44:54.586537 6226 ssh_runner.go:195] Run: which cri-dockerd
I0222 20:44:54.622787 6226 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.
I0222 20:44:54.623712 6226 command_runner.go:130] > /usr/bin/cri-dockerd
I0222 20:44:54.623875 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0222 20:44:54.630549 6226 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (135 bytes)
I0222 20:44:54.641965 6226 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0222 20:44:54.652115 6226 command_runner.go:139] > /etc/cni/net.d/87-podman-bridge.conflist,
I0222 20:44:54.652149 6226 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0222 20:44:54.652156 6226 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0222 20:44:54.652243 6226 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0222 20:44:54.668279 6226 command_runner.go:130] > registry.k8s.io/kube-apiserver:v1.26.1
I0222 20:44:54.668292 6226 command_runner.go:130] > registry.k8s.io/kube-controller-manager:v1.26.1
I0222 20:44:54.668296 6226 command_runner.go:130] > registry.k8s.io/kube-scheduler:v1.26.1
I0222 20:44:54.668302 6226 command_runner.go:130] > registry.k8s.io/kube-proxy:v1.26.1
I0222 20:44:54.668312 6226 command_runner.go:130] > registry.k8s.io/etcd:3.5.6-0
I0222 20:44:54.668316 6226 command_runner.go:130] > registry.k8s.io/pause:3.9
I0222 20:44:54.668320 6226 command_runner.go:130] > kindest/kindnetd:v20221004-44d545d1
I0222 20:44:54.668327 6226 command_runner.go:130] > registry.k8s.io/coredns/coredns:v1.9.3
I0222 20:44:54.668332 6226 command_runner.go:130] > registry.k8s.io/pause:3.6
I0222 20:44:54.668335 6226 command_runner.go:130] > gcr.io/k8s-minikube/storage-provisioner:v5
I0222 20:44:54.668340 6226 command_runner.go:130] > gcr.io/k8s-minikube/busybox:1.28
I0222 20:44:54.669175 6226 docker.go:630] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.26.1
registry.k8s.io/kube-controller-manager:v1.26.1
registry.k8s.io/kube-scheduler:v1.26.1
registry.k8s.io/kube-proxy:v1.26.1
registry.k8s.io/etcd:3.5.6-0
registry.k8s.io/pause:3.9
kindest/kindnetd:v20221004-44d545d1
registry.k8s.io/coredns/coredns:v1.9.3
registry.k8s.io/pause:3.6
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28
-- /stdout --
I0222 20:44:54.669187 6226 docker.go:560] Images already preloaded, skipping extraction
I0222 20:44:54.669193 6226 start.go:485] detecting cgroup driver to use...
I0222 20:44:54.669261 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
image-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0222 20:44:54.680845 6226 command_runner.go:130] > runtime-endpoint: unix:///run/containerd/containerd.sock
I0222 20:44:54.680858 6226 command_runner.go:130] > image-endpoint: unix:///run/containerd/containerd.sock
I0222 20:44:54.681166 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0222 20:44:54.687635 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0222 20:44:54.693891 6226 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I0222 20:44:54.693938 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0222 20:44:54.700270 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0222 20:44:54.706633 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0222 20:44:54.712882 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0222 20:44:54.719237 6226 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0222 20:44:54.725831 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0222 20:44:54.732080 6226 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0222 20:44:54.737612 6226 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1
I0222 20:44:54.737747 6226 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0222 20:44:54.743442 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:44:54.822256 6226 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0222 20:44:54.834867 6226 start.go:485] detecting cgroup driver to use...
I0222 20:44:54.834933 6226 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0222 20:44:54.843406 6226 command_runner.go:130] > # /usr/lib/systemd/system/docker.service
I0222 20:44:54.844301 6226 command_runner.go:130] > [Unit]
I0222 20:44:54.844318 6226 command_runner.go:130] > Description=Docker Application Container Engine
I0222 20:44:54.844328 6226 command_runner.go:130] > Documentation=https://docs.docker.com
I0222 20:44:54.844341 6226 command_runner.go:130] > After=network.target minikube-automount.service docker.socket
I0222 20:44:54.844347 6226 command_runner.go:130] > Requires= minikube-automount.service docker.socket
I0222 20:44:54.844355 6226 command_runner.go:130] > StartLimitBurst=3
I0222 20:44:54.844359 6226 command_runner.go:130] > StartLimitIntervalSec=60
I0222 20:44:54.844362 6226 command_runner.go:130] > [Service]
I0222 20:44:54.844365 6226 command_runner.go:130] > Type=notify
I0222 20:44:54.844370 6226 command_runner.go:130] > Restart=on-failure
I0222 20:44:54.844373 6226 command_runner.go:130] > Environment=NO_PROXY=192.168.64.12
I0222 20:44:54.844382 6226 command_runner.go:130] > # This file is a systemd drop-in unit that inherits from the base dockerd configuration.
I0222 20:44:54.844392 6226 command_runner.go:130] > # The base configuration already specifies an 'ExecStart=...' command. The first directive
I0222 20:44:54.844398 6226 command_runner.go:130] > # here is to clear out that command inherited from the base configuration. Without this,
I0222 20:44:54.844408 6226 command_runner.go:130] > # the command from the base configuration and the command specified here are treated as
I0222 20:44:54.844415 6226 command_runner.go:130] > # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
I0222 20:44:54.844427 6226 command_runner.go:130] > # will catch this invalid input and refuse to start the service with an error like:
I0222 20:44:54.844443 6226 command_runner.go:130] > # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
I0222 20:44:54.844465 6226 command_runner.go:130] > # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
I0222 20:44:54.844481 6226 command_runner.go:130] > # container runtimes. If left unlimited, it may result in OOM issues with MySQL.
I0222 20:44:54.844488 6226 command_runner.go:130] > ExecStart=
I0222 20:44:54.844500 6226 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
I0222 20:44:54.844505 6226 command_runner.go:130] > ExecReload=/bin/kill -s HUP $MAINPID
I0222 20:44:54.844510 6226 command_runner.go:130] > # Having non-zero Limit*s causes performance problems due to accounting overhead
I0222 20:44:54.844516 6226 command_runner.go:130] > # in the kernel. We recommend using cgroups to do container-local accounting.
I0222 20:44:54.844519 6226 command_runner.go:130] > LimitNOFILE=infinity
I0222 20:44:54.844523 6226 command_runner.go:130] > LimitNPROC=infinity
I0222 20:44:54.844526 6226 command_runner.go:130] > LimitCORE=infinity
I0222 20:44:54.844533 6226 command_runner.go:130] > # Uncomment TasksMax if your systemd version supports it.
I0222 20:44:54.844538 6226 command_runner.go:130] > # Only systemd 226 and above support this version.
I0222 20:44:54.844542 6226 command_runner.go:130] > TasksMax=infinity
I0222 20:44:54.844545 6226 command_runner.go:130] > TimeoutStartSec=0
I0222 20:44:54.844557 6226 command_runner.go:130] > # set delegate yes so that systemd does not reset the cgroups of docker containers
I0222 20:44:54.844560 6226 command_runner.go:130] > Delegate=yes
I0222 20:44:54.844565 6226 command_runner.go:130] > # kill only the docker process, not all processes in the cgroup
I0222 20:44:54.844582 6226 command_runner.go:130] > KillMode=process
I0222 20:44:54.844588 6226 command_runner.go:130] > [Install]
I0222 20:44:54.844594 6226 command_runner.go:130] > WantedBy=multi-user.target
I0222 20:44:54.844789 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0222 20:44:54.856302 6226 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0222 20:44:54.869451 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0222 20:44:54.877648 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0222 20:44:54.885949 6226 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0222 20:44:54.913023 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0222 20:44:54.922260 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
image-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0222 20:44:54.933704 6226 command_runner.go:130] > runtime-endpoint: unix:///var/run/cri-dockerd.sock
I0222 20:44:54.933715 6226 command_runner.go:130] > image-endpoint: unix:///var/run/cri-dockerd.sock
I0222 20:44:54.934023 6226 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0222 20:44:55.014980 6226 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0222 20:44:55.105531 6226 docker.go:529] configuring docker to use "cgroupfs" as cgroup driver...
I0222 20:44:55.105549 6226 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
I0222 20:44:55.116799 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:44:55.196966 6226 ssh_runner.go:195] Run: sudo systemctl restart docker
I0222 20:44:56.435163 6226 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.238198156s)
I0222 20:44:56.435224 6226 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0222 20:44:56.517748 6226 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0222 20:44:56.604273 6226 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0222 20:44:56.691564 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:44:56.771800 6226 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0222 20:44:56.783317 6226 start.go:532] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0222 20:44:56.783405 6226 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0222 20:44:56.787070 6226 command_runner.go:130] > File: /var/run/cri-dockerd.sock
I0222 20:44:56.787085 6226 command_runner.go:130] > Size: 0 Blocks: 0 IO Block: 4096 socket
I0222 20:44:56.787095 6226 command_runner.go:130] > Device: 16h/22d Inode: 824 Links: 1
I0222 20:44:56.787106 6226 command_runner.go:130] > Access: (0660/srw-rw----) Uid: ( 0/ root) Gid: ( 1000/ docker)
I0222 20:44:56.787114 6226 command_runner.go:130] > Access: 2023-02-23 04:44:56.891151653 +0000
I0222 20:44:56.787118 6226 command_runner.go:130] > Modify: 2023-02-23 04:44:56.891151653 +0000
I0222 20:44:56.787123 6226 command_runner.go:130] > Change: 2023-02-23 04:44:56.893151653 +0000
I0222 20:44:56.787126 6226 command_runner.go:130] > Birth: -
I0222 20:44:56.787347 6226 start.go:553] Will wait 60s for crictl version
I0222 20:44:56.787392 6226 ssh_runner.go:195] Run: which crictl
I0222 20:44:56.789473 6226 command_runner.go:130] > /usr/bin/crictl
I0222 20:44:56.789752 6226 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0222 20:44:56.861843 6226 command_runner.go:130] > Version: 0.1.0
I0222 20:44:56.861856 6226 command_runner.go:130] > RuntimeName: docker
I0222 20:44:56.861860 6226 command_runner.go:130] > RuntimeVersion: 20.10.23
I0222 20:44:56.861864 6226 command_runner.go:130] > RuntimeApiVersion: v1alpha2
I0222 20:44:56.862801 6226 start.go:569] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 20.10.23
RuntimeApiVersion: v1alpha2
I0222 20:44:56.862903 6226 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0222 20:44:56.884991 6226 command_runner.go:130] > 20.10.23
I0222 20:44:56.885810 6226 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0222 20:44:56.904926 6226 command_runner.go:130] > 20.10.23
I0222 20:44:56.949151 6226 out.go:204] * Preparing Kubernetes v1.26.1 on Docker 20.10.23 ...
I0222 20:44:56.971245 6226 out.go:177] - env NO_PROXY=192.168.64.12
I0222 20:44:56.993196 6226 main.go:141] libmachine: (multinode-293000-m02) Calling .GetIP
I0222 20:44:56.993538 6226 ssh_runner.go:195] Run: grep 192.168.64.1 host.minikube.internal$ /etc/hosts
I0222 20:44:56.996709 6226 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.64.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0222 20:44:57.004699 6226 certs.go:56] Setting up /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000 for IP: 192.168.64.13
I0222 20:44:57.004711 6226 certs.go:186] acquiring lock for shared ca certs: {Name:mk146a2279536341f0de1f1926bcacb2037bedc8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0222 20:44:57.004850 6226 certs.go:195] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.key
I0222 20:44:57.004901 6226 certs.go:195] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.key
I0222 20:44:57.004910 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I0222 20:44:57.004934 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I0222 20:44:57.004952 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I0222 20:44:57.004969 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I0222 20:44:57.005049 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041.pem (1338 bytes)
W0222 20:44:57.005086 6226 certs.go:397] ignoring /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041_empty.pem, impossibly tiny 0 bytes
I0222 20:44:57.005096 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem (1679 bytes)
I0222 20:44:57.005130 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem (1082 bytes)
I0222 20:44:57.005159 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem (1123 bytes)
I0222 20:44:57.005188 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem (1679 bytes)
I0222 20:44:57.005256 6226 certs.go:401] found cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem (1708 bytes)
I0222 20:44:57.005288 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I0222 20:44:57.005308 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041.pem -> /usr/share/ca-certificates/3041.pem
I0222 20:44:57.005327 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> /usr/share/ca-certificates/30412.pem
I0222 20:44:57.005575 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0222 20:44:57.021751 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0222 20:44:57.037933 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0222 20:44:57.053925 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0222 20:44:57.069647 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0222 20:44:57.085266 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/3041.pem --> /usr/share/ca-certificates/3041.pem (1338 bytes)
I0222 20:44:57.101260 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem --> /usr/share/ca-certificates/30412.pem (1708 bytes)
I0222 20:44:57.117396 6226 ssh_runner.go:195] Run: openssl version
I0222 20:44:57.120692 6226 command_runner.go:130] > OpenSSL 1.1.1n 15 Mar 2022
I0222 20:44:57.120907 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/3041.pem && ln -fs /usr/share/ca-certificates/3041.pem /etc/ssl/certs/3041.pem"
I0222 20:44:57.127316 6226 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/3041.pem
I0222 20:44:57.129977 6226 command_runner.go:130] > -rw-r--r-- 1 root root 1338 Feb 23 04:28 /usr/share/ca-certificates/3041.pem
I0222 20:44:57.130172 6226 certs.go:444] hashing: -rw-r--r-- 1 root root 1338 Feb 23 04:28 /usr/share/ca-certificates/3041.pem
I0222 20:44:57.130210 6226 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/3041.pem
I0222 20:44:57.133500 6226 command_runner.go:130] > 51391683
I0222 20:44:57.133682 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/3041.pem /etc/ssl/certs/51391683.0"
I0222 20:44:57.140180 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/30412.pem && ln -fs /usr/share/ca-certificates/30412.pem /etc/ssl/certs/30412.pem"
I0222 20:44:57.146784 6226 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/30412.pem
I0222 20:44:57.149565 6226 command_runner.go:130] > -rw-r--r-- 1 root root 1708 Feb 23 04:28 /usr/share/ca-certificates/30412.pem
I0222 20:44:57.149752 6226 certs.go:444] hashing: -rw-r--r-- 1 root root 1708 Feb 23 04:28 /usr/share/ca-certificates/30412.pem
I0222 20:44:57.149790 6226 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/30412.pem
I0222 20:44:57.153077 6226 command_runner.go:130] > 3ec20f2e
I0222 20:44:57.153280 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/30412.pem /etc/ssl/certs/3ec20f2e.0"
I0222 20:44:57.159974 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0222 20:44:57.166266 6226 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0222 20:44:57.169015 6226 command_runner.go:130] > -rw-r--r-- 1 root root 1111 Feb 23 04:23 /usr/share/ca-certificates/minikubeCA.pem
I0222 20:44:57.169211 6226 certs.go:444] hashing: -rw-r--r-- 1 root root 1111 Feb 23 04:23 /usr/share/ca-certificates/minikubeCA.pem
I0222 20:44:57.169247 6226 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0222 20:44:57.172499 6226 command_runner.go:130] > b5213941
I0222 20:44:57.172716 6226 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0222 20:44:57.179185 6226 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0222 20:44:57.198336 6226 command_runner.go:130] > cgroupfs
I0222 20:44:57.199044 6226 cni.go:84] Creating CNI manager for ""
I0222 20:44:57.199056 6226 cni.go:136] 3 nodes found, recommending kindnet
I0222 20:44:57.199062 6226 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0222 20:44:57.199076 6226 kubeadm.go:172] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.64.13 APIServerPort:8443 KubernetesVersion:v1.26.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:multinode-293000 NodeName:multinode-293000-m02 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.64.12"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.64.13 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPa
th:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m]}
I0222 20:44:57.199147 6226 kubeadm.go:177] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.64.13
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/cri-dockerd.sock
name: "multinode-293000-m02"
kubeletExtraArgs:
node-ip: 192.168.64.13
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.64.12"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.26.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%!"(MISSING)
nodefs.inodesFree: "0%!"(MISSING)
imagefs.available: "0%!"(MISSING)
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0222 20:44:57.199193 6226 kubeadm.go:968] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.26.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=/var/run/cri-dockerd.sock --hostname-override=multinode-293000-m02 --image-service-endpoint=/var/run/cri-dockerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.64.13
[Install]
config:
{KubernetesVersion:v1.26.1 ClusterName:multinode-293000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0222 20:44:57.199248 6226 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.26.1
I0222 20:44:57.205093 6226 command_runner.go:130] > kubeadm
I0222 20:44:57.205100 6226 command_runner.go:130] > kubectl
I0222 20:44:57.205104 6226 command_runner.go:130] > kubelet
I0222 20:44:57.205239 6226 binaries.go:44] Found k8s binaries, skipping transfer
I0222 20:44:57.205296 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system
I0222 20:44:57.211128 6226 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (453 bytes)
I0222 20:44:57.222142 6226 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0222 20:44:57.232927 6226 ssh_runner.go:195] Run: grep 192.168.64.12 control-plane.minikube.internal$ /etc/hosts
I0222 20:44:57.235192 6226 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.64.12 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0222 20:44:57.243101 6226 host.go:66] Checking if "multinode-293000" exists ...
I0222 20:44:57.243275 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:44:57.243386 6226 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0222 20:44:57.243408 6226 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0222 20:44:57.250376 6226 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51548
I0222 20:44:57.250710 6226 main.go:141] libmachine: () Calling .GetVersion
I0222 20:44:57.251062 6226 main.go:141] libmachine: Using API Version 1
I0222 20:44:57.251078 6226 main.go:141] libmachine: () Calling .SetConfigRaw
I0222 20:44:57.251270 6226 main.go:141] libmachine: () Calling .GetMachineName
I0222 20:44:57.251378 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:44:57.251467 6226 start.go:301] JoinCluster: &{Name:multinode-293000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15849/minikube-v1.29.0-1676568791-15849-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.37-1676506612-15768@sha256:cc1cb283879fedae93096946a6953a50075ed680d467a47cbf669e0ed7d3aebc Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersi
on:v1.26.1 ClusterName:multinode-293000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.12 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true} {Name:m03 IP:192.168.64.14 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingr
ess:false ingress-dns:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath:
StaticIP:}
I0222 20:44:57.251571 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm token create --print-join-command --ttl=0"
I0222 20:44:57.251581 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:44:57.251663 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:44:57.251734 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:44:57.251801 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:44:57.251899 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.12 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/id_rsa Username:docker}
I0222 20:44:57.346629 6226 command_runner.go:130] > kubeadm join control-plane.minikube.internal:8443 --token tlyzme.3mhzgdnodrgsn6st --discovery-token-ca-cert-hash sha256:b04cace514db1b68286f4e0582e633ab5836a09959a0a1417edcdafc3829e5ca
I0222 20:44:57.346671 6226 start.go:314] removing existing worker node "m02" before attempting to rejoin cluster: &{Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true}
I0222 20:44:57.346695 6226 host.go:66] Checking if "multinode-293000" exists ...
I0222 20:44:57.346986 6226 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0222 20:44:57.347010 6226 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0222 20:44:57.354069 6226 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51551
I0222 20:44:57.354410 6226 main.go:141] libmachine: () Calling .GetVersion
I0222 20:44:57.354741 6226 main.go:141] libmachine: Using API Version 1
I0222 20:44:57.354753 6226 main.go:141] libmachine: () Calling .SetConfigRaw
I0222 20:44:57.355002 6226 main.go:141] libmachine: () Calling .GetMachineName
I0222 20:44:57.355110 6226 main.go:141] libmachine: (multinode-293000) Calling .DriverName
I0222 20:44:57.355251 6226 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.26.1/kubectl drain multinode-293000-m02 --force --grace-period=1 --skip-wait-for-delete-timeout=1 --disable-eviction --ignore-daemonsets --delete-emptydir-data --delete-local-data
I0222 20:44:57.355263 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHHostname
I0222 20:44:57.355344 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHPort
I0222 20:44:57.355420 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHKeyPath
I0222 20:44:57.355530 6226 main.go:141] libmachine: (multinode-293000) Calling .GetSSHUsername
I0222 20:44:57.355611 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.12 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000/id_rsa Username:docker}
I0222 20:44:57.464951 6226 command_runner.go:130] > node/multinode-293000-m02 cordoned
I0222 20:45:00.492802 6226 command_runner.go:130] > pod "busybox-6b86dd6d48-pz4cz" has DeletionTimestamp older than 1 seconds, skipping
I0222 20:45:00.492826 6226 command_runner.go:130] > node/multinode-293000-m02 drained
I0222 20:45:00.494164 6226 command_runner.go:130] ! Flag --delete-local-data has been deprecated, This option is deprecated and will be deleted. Use --delete-emptydir-data.
I0222 20:45:00.494175 6226 command_runner.go:130] ! Warning: ignoring DaemonSet-managed Pods: kube-system/kindnet-bzxtr, kube-system/kube-proxy-qmsbf
I0222 20:45:00.494191 6226 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.26.1/kubectl drain multinode-293000-m02 --force --grace-period=1 --skip-wait-for-delete-timeout=1 --disable-eviction --ignore-daemonsets --delete-emptydir-data --delete-local-data: (3.138982007s)
I0222 20:45:00.494199 6226 node.go:109] successfully drained node "m02"
I0222 20:45:00.494507 6226 loader.go:373] Config loaded from file: /Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:45:00.494713 6226 kapi.go:59] client config for multinode-293000: &rest.Config{Host:"https://192.168.64.12:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.key", CAFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next
Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x25472a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0222 20:45:00.494997 6226 request.go:1171] Request Body: {"kind":"DeleteOptions","apiVersion":"v1"}
I0222 20:45:00.495026 6226 round_trippers.go:463] DELETE https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:00.495030 6226 round_trippers.go:469] Request Headers:
I0222 20:45:00.495036 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:00.495042 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:00.495048 6226 round_trippers.go:473] Content-Type: application/json
I0222 20:45:00.498006 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:00.498016 6226 round_trippers.go:577] Response Headers:
I0222 20:45:00.498021 6226 round_trippers.go:580] Content-Length: 171
I0222 20:45:00.498027 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:00 GMT
I0222 20:45:00.498032 6226 round_trippers.go:580] Audit-Id: 02857edf-6958-413e-8c18-99e61fdac428
I0222 20:45:00.498037 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:00.498042 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:00.498047 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:00.498053 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:00.498157 6226 request.go:1171] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","details":{"name":"multinode-293000-m02","kind":"nodes","uid":"f968bf76-422f-4a90-ba94-df00a7b8efaa"}}
I0222 20:45:00.498182 6226 node.go:125] successfully deleted node "m02"
I0222 20:45:00.498188 6226 start.go:318] successfully removed existing worker node "m02" from cluster: &{Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true}
I0222 20:45:00.498199 6226 start.go:322] trying to join worker node "m02" to cluster: &{Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true}
I0222 20:45:00.498213 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm join control-plane.minikube.internal:8443 --token tlyzme.3mhzgdnodrgsn6st --discovery-token-ca-cert-hash sha256:b04cace514db1b68286f4e0582e633ab5836a09959a0a1417edcdafc3829e5ca --ignore-preflight-errors=all --cri-socket /var/run/cri-dockerd.sock --node-name=multinode-293000-m02"
I0222 20:45:00.561508 6226 command_runner.go:130] ! W0223 04:45:00.675776 1123 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration!
I0222 20:45:00.706566 6226 command_runner.go:130] ! [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0222 20:45:02.351569 6226 command_runner.go:130] > [preflight] Running pre-flight checks
I0222 20:45:02.351589 6226 command_runner.go:130] > [preflight] Reading configuration from the cluster...
I0222 20:45:02.351600 6226 command_runner.go:130] > [preflight] FYI: You can look at this config file with 'kubectl -n kube-system get cm kubeadm-config -o yaml'
I0222 20:45:02.351609 6226 command_runner.go:130] > [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0222 20:45:02.351615 6226 command_runner.go:130] > [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0222 20:45:02.351619 6226 command_runner.go:130] > [kubelet-start] Starting the kubelet
I0222 20:45:02.351625 6226 command_runner.go:130] > [kubelet-start] Waiting for the kubelet to perform the TLS Bootstrap...
I0222 20:45:02.351634 6226 command_runner.go:130] > This node has joined the cluster:
I0222 20:45:02.351643 6226 command_runner.go:130] > * Certificate signing request was sent to apiserver and a response was received.
I0222 20:45:02.351649 6226 command_runner.go:130] > * The Kubelet was informed of the new secure connection details.
I0222 20:45:02.351671 6226 command_runner.go:130] > Run 'kubectl get nodes' on the control-plane to see this node join the cluster.
I0222 20:45:02.351842 6226 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.26.1:$PATH" kubeadm join control-plane.minikube.internal:8443 --token tlyzme.3mhzgdnodrgsn6st --discovery-token-ca-cert-hash sha256:b04cace514db1b68286f4e0582e633ab5836a09959a0a1417edcdafc3829e5ca --ignore-preflight-errors=all --cri-socket /var/run/cri-dockerd.sock --node-name=multinode-293000-m02": (1.853644672s)
I0222 20:45:02.351861 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
I0222 20:45:02.544185 6226 command_runner.go:130] ! Created symlink /etc/systemd/system/multi-user.target.wants/kubelet.service → /usr/lib/systemd/system/kubelet.service.
I0222 20:45:02.544224 6226 start.go:303] JoinCluster complete in 5.292852458s
I0222 20:45:02.544235 6226 cni.go:84] Creating CNI manager for ""
I0222 20:45:02.544242 6226 cni.go:136] 3 nodes found, recommending kindnet
I0222 20:45:02.544335 6226 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0222 20:45:02.547556 6226 command_runner.go:130] > File: /opt/cni/bin/portmap
I0222 20:45:02.547575 6226 command_runner.go:130] > Size: 2798344 Blocks: 5472 IO Block: 4096 regular file
I0222 20:45:02.547593 6226 command_runner.go:130] > Device: 11h/17d Inode: 3542 Links: 1
I0222 20:45:02.547603 6226 command_runner.go:130] > Access: (0755/-rwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root)
I0222 20:45:02.547614 6226 command_runner.go:130] > Access: 2023-02-23 04:43:35.438869016 +0000
I0222 20:45:02.547626 6226 command_runner.go:130] > Modify: 2023-02-16 22:59:55.000000000 +0000
I0222 20:45:02.547643 6226 command_runner.go:130] > Change: 2023-02-23 04:43:33.465142217 +0000
I0222 20:45:02.547650 6226 command_runner.go:130] > Birth: -
I0222 20:45:02.547770 6226 cni.go:181] applying CNI manifest using /var/lib/minikube/binaries/v1.26.1/kubectl ...
I0222 20:45:02.547778 6226 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2428 bytes)
I0222 20:45:02.559408 6226 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.26.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0222 20:45:02.799481 6226 command_runner.go:130] > clusterrole.rbac.authorization.k8s.io/kindnet unchanged
I0222 20:45:02.801794 6226 command_runner.go:130] > clusterrolebinding.rbac.authorization.k8s.io/kindnet unchanged
I0222 20:45:02.803694 6226 command_runner.go:130] > serviceaccount/kindnet unchanged
I0222 20:45:02.810312 6226 command_runner.go:130] > daemonset.apps/kindnet configured
I0222 20:45:02.812163 6226 loader.go:373] Config loaded from file: /Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:45:02.812361 6226 kapi.go:59] client config for multinode-293000: &rest.Config{Host:"https://192.168.64.12:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.key", CAFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next
Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x25472a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0222 20:45:02.812593 6226 round_trippers.go:463] GET https://192.168.64.12:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale
I0222 20:45:02.812599 6226 round_trippers.go:469] Request Headers:
I0222 20:45:02.812605 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:02.812611 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:02.813907 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:02.813915 6226 round_trippers.go:577] Response Headers:
I0222 20:45:02.813921 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:02.813926 6226 round_trippers.go:580] Content-Length: 291
I0222 20:45:02.813931 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:02 GMT
I0222 20:45:02.813938 6226 round_trippers.go:580] Audit-Id: 08e50a36-99be-4e88-9345-82862ccf63e8
I0222 20:45:02.813945 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:02.813953 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:02.813959 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:02.813971 6226 request.go:1171] Response Body: {"kind":"Scale","apiVersion":"autoscaling/v1","metadata":{"name":"coredns","namespace":"kube-system","uid":"b913bddd-effc-42b2-b71d-0d3159053b5a","resourceVersion":"824","creationTimestamp":"2023-02-23T04:40:25Z"},"spec":{"replicas":1},"status":{"replicas":1,"selector":"k8s-app=kube-dns"}}
I0222 20:45:02.814014 6226 kapi.go:248] "coredns" deployment in "kube-system" namespace and "multinode-293000" context rescaled to 1 replicas
I0222 20:45:02.814027 6226 start.go:223] Will wait 6m0s for node &{Name:m02 IP:192.168.64.13 Port:0 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:false Worker:true}
I0222 20:45:02.835817 6226 out.go:177] * Verifying Kubernetes components...
I0222 20:45:02.879338 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0222 20:45:02.888901 6226 loader.go:373] Config loaded from file: /Users/jenkins/minikube-integration/15909-2565/kubeconfig
I0222 20:45:02.889116 6226 kapi.go:59] client config for multinode-293000: &rest.Config{Host:"https://192.168.64.12:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.crt", KeyFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/client.key", CAFile:"/Users/jenkins/minikube-integration/15909-2565/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), Next
Protos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x25472a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0222 20:45:02.889301 6226 node_ready.go:35] waiting up to 6m0s for node "multinode-293000-m02" to be "Ready" ...
I0222 20:45:02.889341 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:02.889346 6226 round_trippers.go:469] Request Headers:
I0222 20:45:02.889352 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:02.889358 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:02.890998 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:02.891007 6226 round_trippers.go:577] Response Headers:
I0222 20:45:02.891016 6226 round_trippers.go:580] Audit-Id: c750f846-102a-4337-a66c-56039256ff82
I0222 20:45:02.891022 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:02.891031 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:02.891043 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:02.891053 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:02.891058 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:03 GMT
I0222 20:45:02.891164 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"914","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsT
ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 4251 chars]
I0222 20:45:03.392088 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:03.392100 6226 round_trippers.go:469] Request Headers:
I0222 20:45:03.392106 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:03.392111 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:03.393779 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:03.393800 6226 round_trippers.go:577] Response Headers:
I0222 20:45:03.393824 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:03 GMT
I0222 20:45:03.393839 6226 round_trippers.go:580] Audit-Id: b74d8ab7-6ca6-4907-b478-df870722f932
I0222 20:45:03.393847 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:03.393864 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:03.393875 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:03.393881 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:03.393972 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"914","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsT
ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 4251 chars]
I0222 20:45:03.892385 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:03.892397 6226 round_trippers.go:469] Request Headers:
I0222 20:45:03.892403 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:03.892408 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:03.893930 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:03.893940 6226 round_trippers.go:577] Response Headers:
I0222 20:45:03.893945 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:04 GMT
I0222 20:45:03.893950 6226 round_trippers.go:580] Audit-Id: 9bb9b1e1-9ac7-4876-a291-5714292bbf73
I0222 20:45:03.893955 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:03.893960 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:03.893965 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:03.893970 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:03.894055 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"914","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsT
ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 4251 chars]
I0222 20:45:04.392299 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:04.392313 6226 round_trippers.go:469] Request Headers:
I0222 20:45:04.392321 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:04.392326 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:04.393844 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:04.393855 6226 round_trippers.go:577] Response Headers:
I0222 20:45:04.393860 6226 round_trippers.go:580] Audit-Id: adc49372-b9a4-42f9-bce4-5c160e3d4012
I0222 20:45:04.393878 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:04.393889 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:04.393897 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:04.393905 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:04.393912 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:04 GMT
I0222 20:45:04.394088 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"914","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsT
ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 4251 chars]
I0222 20:45:04.891493 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:04.891508 6226 round_trippers.go:469] Request Headers:
I0222 20:45:04.891515 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:04.891520 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:04.893229 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:04.893242 6226 round_trippers.go:577] Response Headers:
I0222 20:45:04.893249 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:04.893254 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:04.893268 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:05 GMT
I0222 20:45:04.893276 6226 round_trippers.go:580] Audit-Id: 65d32211-c023-4638-b516-a52f0cb66f2e
I0222 20:45:04.893283 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:04.893289 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:04.893372 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"914","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsT
ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 4251 chars]
I0222 20:45:04.893573 6226 node_ready.go:58] node "multinode-293000-m02" has status "Ready":"False"
I0222 20:45:05.391788 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:05.391801 6226 round_trippers.go:469] Request Headers:
I0222 20:45:05.391807 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:05.391812 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:05.393514 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:05.393526 6226 round_trippers.go:577] Response Headers:
I0222 20:45:05.393532 6226 round_trippers.go:580] Audit-Id: ab287753-2fbd-4445-8ca6-5952e871e5e6
I0222 20:45:05.393541 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:05.393547 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:05.393552 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:05.393557 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:05.393562 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:05 GMT
I0222 20:45:05.393650 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"914","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsT
ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 4251 chars]
I0222 20:45:05.891917 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:05.891929 6226 round_trippers.go:469] Request Headers:
I0222 20:45:05.891936 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:05.891941 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:05.893514 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:05.893525 6226 round_trippers.go:577] Response Headers:
I0222 20:45:05.893533 6226 round_trippers.go:580] Audit-Id: aa9b1117-5d51-49df-b575-f87e7a349e0a
I0222 20:45:05.893541 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:05.893548 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:05.893555 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:05.893568 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:05.893577 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:06 GMT
I0222 20:45:05.893716 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"914","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}}},{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsT
ype":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:vo [truncated 4251 chars]
I0222 20:45:06.391740 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:06.391752 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.391758 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.391763 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.393493 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.393509 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.393518 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:06 GMT
I0222 20:45:06.393527 6226 round_trippers.go:580] Audit-Id: 5eed6747-0b62-4b5a-a7df-39c0d0fb25e3
I0222 20:45:06.393534 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.393546 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.393551 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.393556 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.393631 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"936","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{
}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 4360 chars]
I0222 20:45:06.892240 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:06.892260 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.892267 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.892272 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.893569 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.893580 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.893586 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.893591 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.893603 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.893608 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.893613 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.893618 6226 round_trippers.go:580] Audit-Id: b0f3e2a4-9cfa-4034-8de1-3e8f8548ecc4
I0222 20:45:06.893717 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"941","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{
}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 4618 chars]
I0222 20:45:06.893903 6226 node_ready.go:49] node "multinode-293000-m02" has status "Ready":"True"
I0222 20:45:06.893913 6226 node_ready.go:38] duration metric: took 4.004675827s waiting for node "multinode-293000-m02" to be "Ready" ...
I0222 20:45:06.893918 6226 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0222 20:45:06.893952 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods
I0222 20:45:06.893957 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.893962 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.893968 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.896020 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:06.896033 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.896041 6226 round_trippers.go:580] Audit-Id: ad4ba6e0-b499-4a7c-8174-854c50392394
I0222 20:45:06.896050 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.896057 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.896066 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.896073 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.896078 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.896916 6226 request.go:1171] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"944"},"items":[{"metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"820","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f
:preferredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{ [truncated 83689 chars]
I0222 20:45:06.898830 6226 pod_ready.go:78] waiting up to 6m0s for pod "coredns-787d4945fb-b28zh" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.898867 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/coredns-787d4945fb-b28zh
I0222 20:45:06.898871 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.898878 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.898884 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.900026 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.900042 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.900048 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.900053 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.900058 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.900063 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.900068 6226 round_trippers.go:580] Audit-Id: 24d0df9d-1409-491e-9b97-3b2f32261e4b
I0222 20:45:06.900073 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.900181 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"coredns-787d4945fb-b28zh","generateName":"coredns-787d4945fb-","namespace":"kube-system","uid":"307635d3-a26b-4eff-be8a-9d65e1f996c3","resourceVersion":"820","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"787d4945fb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-787d4945fb","uid":"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:k8s-app":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"0ba7ec1b-bb04-4cc7-8760-0eaf9431e2ca\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:preferredDuringSchedulingIgnoredDuringExecution":{
}}},"f:containers":{"k:{\"name\":\"coredns\"}":{".":{},"f:args":{},"f:i [truncated 6488 chars]
I0222 20:45:06.900417 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:06.900423 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.900429 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.900434 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.901513 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.901522 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.901530 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.901538 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.901550 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.901556 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.901561 6226 round_trippers.go:580] Audit-Id: 3fc612fe-a074-4563-ab05-95de6c56a53c
I0222 20:45:06.901566 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.901681 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:45:06.901864 6226 pod_ready.go:92] pod "coredns-787d4945fb-b28zh" in "kube-system" namespace has status "Ready":"True"
I0222 20:45:06.901869 6226 pod_ready.go:81] duration metric: took 3.03073ms waiting for pod "coredns-787d4945fb-b28zh" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.901875 6226 pod_ready.go:78] waiting up to 6m0s for pod "etcd-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.901901 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/etcd-multinode-293000
I0222 20:45:06.901906 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.901911 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.901917 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.902899 6226 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds
I0222 20:45:06.902906 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.902911 6226 round_trippers.go:580] Audit-Id: bce1a718-2de7-4e3d-88fd-d37cb19950f7
I0222 20:45:06.902916 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.902922 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.902926 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.902934 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.902939 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.903273 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"etcd-multinode-293000","namespace":"kube-system","uid":"2363a307-e6f7-4025-ae02-4920adde4561","resourceVersion":"793","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"etcd","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.64.12:2379","kubernetes.io/config.hash":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.mirror":"71afa40fe524f16fc5e2219fb9d1d91b","kubernetes.io/config.seen":"2023-02-23T04:40:26.073140598Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kubernetes.io/etcd.advertise-c
lient-urls":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config [truncated 6055 chars]
I0222 20:45:06.903477 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:06.903483 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.903489 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.903494 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.904553 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.904562 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.904567 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.904573 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.904578 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.904583 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.904588 6226 round_trippers.go:580] Audit-Id: 83c3c739-2c6d-4858-85b9-0f6de7012ace
I0222 20:45:06.904593 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.904744 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:45:06.904907 6226 pod_ready.go:92] pod "etcd-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:45:06.904913 6226 pod_ready.go:81] duration metric: took 3.033371ms waiting for pod "etcd-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.904925 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.904952 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-multinode-293000
I0222 20:45:06.904957 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.904963 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.904969 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.906181 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.906191 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.906197 6226 round_trippers.go:580] Audit-Id: 6befa1e8-d194-432e-8667-2ccb2fd77788
I0222 20:45:06.906202 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.906207 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.906211 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.906217 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.906222 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.906501 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-apiserver-multinode-293000","namespace":"kube-system","uid":"bb2fc1a3-12c1-4854-8f8c-3c1c5664067c","resourceVersion":"748","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-apiserver","tier":"control-plane"},"annotations":{"kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.64.12:8443","kubernetes.io/config.hash":"578ff397a5454283a55e183c76494192","kubernetes.io/config.mirror":"578ff397a5454283a55e183c76494192","kubernetes.io/config.seen":"2023-02-23T04:40:26.073157361Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubeadm.kub
ernetes.io/kube-apiserver.advertise-address.endpoint":{},"f:kubernetes. [truncated 7590 chars]
I0222 20:45:06.906747 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:06.906753 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.906758 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.906764 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.907973 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.907982 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.907991 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.908000 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.908009 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.908018 6226 round_trippers.go:580] Audit-Id: bc795608-0e81-4988-840f-e2b75fbc974d
I0222 20:45:06.908031 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.908040 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.908129 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:45:06.908307 6226 pod_ready.go:92] pod "kube-apiserver-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:45:06.908315 6226 pod_ready.go:81] duration metric: took 3.38336ms waiting for pod "kube-apiserver-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.908321 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.908350 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-multinode-293000
I0222 20:45:06.908355 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.908360 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.908368 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.909550 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.909557 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.909562 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.909567 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.909573 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.909577 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.909583 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.909588 6226 round_trippers.go:580] Audit-Id: 677a73f2-1f14-4198-a0b3-b456db3f4356
I0222 20:45:06.909713 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-controller-manager-multinode-293000","namespace":"kube-system","uid":"e60be5dc-4ed1-4a87-b03c-2ac01b03001d","resourceVersion":"742","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-controller-manager","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"02b271251b67ef9dd552c569d01153ca","kubernetes.io/config.mirror":"02b271251b67ef9dd552c569d01153ca","kubernetes.io/config.seen":"2023-02-23T04:40:26.073158360Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.i
o/config.seen":{},"f:kubernetes.io/config.source":{}},"f:labels":{".":{ [truncated 7158 chars]
I0222 20:45:06.909951 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:06.909957 6226 round_trippers.go:469] Request Headers:
I0222 20:45:06.909963 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:06.909968 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:06.911178 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:06.911185 6226 round_trippers.go:577] Response Headers:
I0222 20:45:06.911190 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:06.911195 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:06.911200 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:06.911204 6226 round_trippers.go:580] Audit-Id: af6e5f9e-8886-405b-b37b-d28b8133856b
I0222 20:45:06.911210 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:06.911216 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:06.911348 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:45:06.911516 6226 pod_ready.go:92] pod "kube-controller-manager-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:45:06.911521 6226 pod_ready.go:81] duration metric: took 3.195134ms waiting for pod "kube-controller-manager-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:06.911526 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-bj985" in "kube-system" namespace to be "Ready" ...
I0222 20:45:07.092939 6226 request.go:622] Waited for 181.331895ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bj985
I0222 20:45:07.092977 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-bj985
I0222 20:45:07.092983 6226 round_trippers.go:469] Request Headers:
I0222 20:45:07.092995 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:07.093001 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:07.094927 6226 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds
I0222 20:45:07.094937 6226 round_trippers.go:577] Response Headers:
I0222 20:45:07.094943 6226 round_trippers.go:580] Audit-Id: fae56b53-82fa-493b-9458-0d62a847f5ce
I0222 20:45:07.094948 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:07.094953 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:07.094958 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:07.094963 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:07.094968 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:07.095105 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-bj985","generateName":"kube-proxy-","namespace":"kube-system","uid":"36f7816d-0b3e-4210-be32-907bf62dfa61","resourceVersion":"875","creationTimestamp":"2023-02-23T04:42:15Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:42:15Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5971 chars]
I0222 20:45:07.292936 6226 request.go:622] Waited for 197.564573ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m03
I0222 20:45:07.293011 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m03
I0222 20:45:07.293038 6226 round_trippers.go:469] Request Headers:
I0222 20:45:07.293054 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:07.293067 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:07.296218 6226 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds
I0222 20:45:07.296234 6226 round_trippers.go:577] Response Headers:
I0222 20:45:07.296242 6226 round_trippers.go:580] Audit-Id: 25b3b0be-3d8b-4185-afb7-d0b4cd9db4da
I0222 20:45:07.296249 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:07.296258 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:07.296268 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:07.296275 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:07.296281 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:07.296599 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m03","uid":"181ccd63-a7fc-412c-bfee-446a1e65f4b4","resourceVersion":"873","creationTimestamp":"2023-02-23T04:42:56Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m03","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:42:56Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{
}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 4988 chars]
I0222 20:45:07.296865 6226 pod_ready.go:97] node "multinode-293000-m03" hosting pod "kube-proxy-bj985" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000-m03" has status "Ready":"Unknown"
I0222 20:45:07.296891 6226 pod_ready.go:81] duration metric: took 385.352206ms waiting for pod "kube-proxy-bj985" in "kube-system" namespace to be "Ready" ...
E0222 20:45:07.296898 6226 pod_ready.go:66] WaitExtra: waitPodCondition: node "multinode-293000-m03" hosting pod "kube-proxy-bj985" in "kube-system" namespace is currently not "Ready" (skipping!): node "multinode-293000-m03" has status "Ready":"Unknown"
I0222 20:45:07.296903 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-pxq2s" in "kube-system" namespace to be "Ready" ...
I0222 20:45:07.492448 6226 request.go:622] Waited for 195.50692ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pxq2s
I0222 20:45:07.492507 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pxq2s
I0222 20:45:07.492519 6226 round_trippers.go:469] Request Headers:
I0222 20:45:07.492531 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:07.492542 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:07.495239 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:07.495262 6226 round_trippers.go:577] Response Headers:
I0222 20:45:07.495274 6226 round_trippers.go:580] Audit-Id: f42ec6c2-b81d-4508-8409-dc9b907a02cf
I0222 20:45:07.495285 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:07.495295 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:07.495302 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:07.495310 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:07.495317 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:07.495453 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-pxq2s","generateName":"kube-proxy-","namespace":"kube-system","uid":"0ce24b37-1ce7-4772-b40d-5f88f10aaa4b","resourceVersion":"720","creationTimestamp":"2023-02-23T04:40:39Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:39Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5738 chars]
I0222 20:45:07.692322 6226 request.go:622] Waited for 196.533071ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:07.692412 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:07.692418 6226 round_trippers.go:469] Request Headers:
I0222 20:45:07.692425 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:07.692432 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:07.694732 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:07.694745 6226 round_trippers.go:577] Response Headers:
I0222 20:45:07.694751 6226 round_trippers.go:580] Audit-Id: 9889670a-0e67-43e2-b493-f6a21902e518
I0222 20:45:07.694757 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:07.694762 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:07.694767 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:07.694772 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:07.694777 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:07 GMT
I0222 20:45:07.694886 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:45:07.695084 6226 pod_ready.go:92] pod "kube-proxy-pxq2s" in "kube-system" namespace has status "Ready":"True"
I0222 20:45:07.695089 6226 pod_ready.go:81] duration metric: took 398.189383ms waiting for pod "kube-proxy-pxq2s" in "kube-system" namespace to be "Ready" ...
I0222 20:45:07.695096 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-qmsbf" in "kube-system" namespace to be "Ready" ...
I0222 20:45:07.894139 6226 request.go:622] Waited for 198.922314ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qmsbf
I0222 20:45:07.894194 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qmsbf
I0222 20:45:07.894205 6226 round_trippers.go:469] Request Headers:
I0222 20:45:07.894223 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:07.894235 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:07.896655 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:07.896669 6226 round_trippers.go:577] Response Headers:
I0222 20:45:07.896676 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:07.896683 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:07.896689 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:07.896696 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:07.896704 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:08 GMT
I0222 20:45:07.896713 6226 round_trippers.go:580] Audit-Id: eff4222b-6e0b-46cc-9ee0-6d738200e195
I0222 20:45:07.897019 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-proxy-qmsbf","generateName":"kube-proxy-","namespace":"kube-system","uid":"98395ed9-2055-48e0-8d84-b931dfc0d9c7","resourceVersion":"928","creationTimestamp":"2023-02-23T04:41:26Z","labels":{"controller-revision-hash":"6bc4695d8c","k8s-app":"kube-proxy","pod-template-generation":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube-proxy","uid":"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:41:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:controller-revision-hash":{},"f:k8s-app":{},"f:pod-template-generation":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"c5fc6f2b-0c5e-4abf-bb53-db554c61bb80\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:nodeAffinity":{".":{},"f:r
equiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k: [truncated 5750 chars]
I0222 20:45:08.092607 6226 request.go:622] Waited for 195.249412ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:08.092664 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000-m02
I0222 20:45:08.092675 6226 round_trippers.go:469] Request Headers:
I0222 20:45:08.092739 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:08.092753 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:08.095387 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:08.095403 6226 round_trippers.go:577] Response Headers:
I0222 20:45:08.095410 6226 round_trippers.go:580] Audit-Id: fce5b8f3-b008-43b7-9608-f8d52e2cf740
I0222 20:45:08.095419 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:08.095431 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:08.095454 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:08.095468 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:08.095475 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:08 GMT
I0222 20:45:08.095587 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000-m02","uid":"bc74b431-d9fa-4d3f-bef7-8e14334a5a93","resourceVersion":"941","creationTimestamp":"2023-02-23T04:45:01Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000-m02","kubernetes.io/os":"linux"},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"/var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:45:01Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{
}}}}},{"manager":"kubeadm","operation":"Update","apiVersion":"v1","time [truncated 4618 chars]
I0222 20:45:08.095823 6226 pod_ready.go:92] pod "kube-proxy-qmsbf" in "kube-system" namespace has status "Ready":"True"
I0222 20:45:08.095831 6226 pod_ready.go:81] duration metric: took 400.738052ms waiting for pod "kube-proxy-qmsbf" in "kube-system" namespace to be "Ready" ...
I0222 20:45:08.095840 6226 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:08.293697 6226 request.go:622] Waited for 197.819416ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-293000
I0222 20:45:08.293757 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-multinode-293000
I0222 20:45:08.293769 6226 round_trippers.go:469] Request Headers:
I0222 20:45:08.293783 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:08.293794 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:08.296459 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:08.296473 6226 round_trippers.go:577] Response Headers:
I0222 20:45:08.296481 6226 round_trippers.go:580] Audit-Id: 33423e76-7c35-46d8-8a30-2163e85c79c3
I0222 20:45:08.296488 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:08.296495 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:08.296509 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:08.296516 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:08.296523 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:08 GMT
I0222 20:45:08.296665 6226 request.go:1171] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kube-scheduler-multinode-293000","namespace":"kube-system","uid":"deb74301-35df-47d1-a8a9-f59943186666","resourceVersion":"772","creationTimestamp":"2023-02-23T04:40:26Z","labels":{"component":"kube-scheduler","tier":"control-plane"},"annotations":{"kubernetes.io/config.hash":"ef6d7c628504525048f2a505fc91f554","kubernetes.io/config.mirror":"ef6d7c628504525048f2a505fc91f554","kubernetes.io/config.seen":"2023-02-23T04:40:26.073159188Z","kubernetes.io/config.source":"file"},"ownerReferences":[{"apiVersion":"v1","kind":"Node","name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","controller":true}],"managedFields":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time":"2023-02-23T04:40:26Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:annotations":{".":{},"f:kubernetes.io/config.hash":{},"f:kubernetes.io/config.mirror":{},"f:kubernetes.io/config.seen":{},
"f:kubernetes.io/config.source":{}},"f:labels":{".":{},"f:component":{} [truncated 4888 chars]
I0222 20:45:08.492581 6226 request.go:622] Waited for 195.581412ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:08.492675 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes/multinode-293000
I0222 20:45:08.492686 6226 round_trippers.go:469] Request Headers:
I0222 20:45:08.492698 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:08.492709 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:08.495609 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:08.495626 6226 round_trippers.go:577] Response Headers:
I0222 20:45:08.495637 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:08.495646 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:08 GMT
I0222 20:45:08.495661 6226 round_trippers.go:580] Audit-Id: 3b238647-1e00-469b-a710-8236ebc0475a
I0222 20:45:08.495668 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:08.495674 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:08.495680 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:08.495757 6226 request.go:1171] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFields":[{"manager":"kubelet","operation":"Update","api
Version":"v1","time":"2023-02-23T04:40:23Z","fieldsType":"FieldsV1","fi [truncated 5329 chars]
I0222 20:45:08.496016 6226 pod_ready.go:92] pod "kube-scheduler-multinode-293000" in "kube-system" namespace has status "Ready":"True"
I0222 20:45:08.496026 6226 pod_ready.go:81] duration metric: took 400.185846ms waiting for pod "kube-scheduler-multinode-293000" in "kube-system" namespace to be "Ready" ...
I0222 20:45:08.496035 6226 pod_ready.go:38] duration metric: took 1.602138604s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0222 20:45:08.496047 6226 system_svc.go:44] waiting for kubelet service to be running ....
I0222 20:45:08.496123 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0222 20:45:08.504968 6226 system_svc.go:56] duration metric: took 8.916927ms WaitForService to wait for kubelet.
I0222 20:45:08.504981 6226 kubeadm.go:578] duration metric: took 5.691039142s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
I0222 20:45:08.504998 6226 node_conditions.go:102] verifying NodePressure condition ...
I0222 20:45:08.693034 6226 request.go:622] Waited for 187.98291ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.64.12:8443/api/v1/nodes
I0222 20:45:08.693150 6226 round_trippers.go:463] GET https://192.168.64.12:8443/api/v1/nodes
I0222 20:45:08.693173 6226 round_trippers.go:469] Request Headers:
I0222 20:45:08.693189 6226 round_trippers.go:473] Accept: application/json, */*
I0222 20:45:08.693215 6226 round_trippers.go:473] User-Agent: minikube-darwin-amd64/v0.0.0 (darwin/amd64) kubernetes/$Format
I0222 20:45:08.696210 6226 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds
I0222 20:45:08.696228 6226 round_trippers.go:577] Response Headers:
I0222 20:45:08.696240 6226 round_trippers.go:580] Audit-Id: 35840ac1-9bc6-4a0b-9cac-4ccbe32d3b4c
I0222 20:45:08.696248 6226 round_trippers.go:580] Cache-Control: no-cache, private
I0222 20:45:08.696260 6226 round_trippers.go:580] Content-Type: application/json
I0222 20:45:08.696270 6226 round_trippers.go:580] X-Kubernetes-Pf-Flowschema-Uid: 783d30a8-2e33-4acf-bab1-705755461da2
I0222 20:45:08.696281 6226 round_trippers.go:580] X-Kubernetes-Pf-Prioritylevel-Uid: 37239393-c381-4c38-b0c5-c74fe2103fd2
I0222 20:45:08.696293 6226 round_trippers.go:580] Date: Thu, 23 Feb 2023 04:45:08 GMT
I0222 20:45:08.696739 6226 request.go:1171] Response Body: {"kind":"NodeList","apiVersion":"v1","metadata":{"resourceVersion":"945"},"items":[{"metadata":{"name":"multinode-293000","uid":"4a919185-6aed-4e56-af3e-94e44484fb45","resourceVersion":"751","creationTimestamp":"2023-02-23T04:40:23Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/os":"linux","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"multinode-293000","kubernetes.io/os":"linux","minikube.k8s.io/commit":"66d56dc3ac28a702789778ac47e90f12526a0321","minikube.k8s.io/name":"multinode-293000","minikube.k8s.io/primary":"true","minikube.k8s.io/updated_at":"2023_02_22T20_40_27_0700","minikube.k8s.io/version":"v1.29.0","node-role.kubernetes.io/control-plane":"","node.kubernetes.io/exclude-from-external-load-balancers":""},"annotations":{"kubeadm.alpha.kubernetes.io/cri-socket":"unix:///var/run/cri-dockerd.sock","node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"},"managedFiel
ds":[{"manager":"kubelet","operation":"Update","apiVersion":"v1","time" [truncated 16972 chars]
I0222 20:45:08.697330 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:45:08.697343 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:45:08.697352 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:45:08.697358 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:45:08.697365 6226 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki
I0222 20:45:08.697370 6226 node_conditions.go:123] node cpu capacity is 2
I0222 20:45:08.697375 6226 node_conditions.go:105] duration metric: took 192.375598ms to run NodePressure ...
I0222 20:45:08.697386 6226 start.go:228] waiting for startup goroutines ...
I0222 20:45:08.697407 6226 start.go:242] writing updated cluster config ...
I0222 20:45:08.698115 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:45:08.698183 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:45:08.741951 6226 out.go:177] * Starting worker node multinode-293000-m03 in cluster multinode-293000
I0222 20:45:08.763724 6226 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0222 20:45:08.763769 6226 cache.go:57] Caching tarball of preloaded images
I0222 20:45:08.763864 6226 preload.go:174] Found /Users/jenkins/minikube-integration/15909-2565/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0222 20:45:08.763874 6226 cache.go:60] Finished verifying existence of preloaded tar for v1.26.1 on docker
I0222 20:45:08.763958 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:45:08.764499 6226 cache.go:193] Successfully downloaded all kic artifacts
I0222 20:45:08.764514 6226 start.go:364] acquiring machines lock for multinode-293000-m03: {Name:mk88cf87535f73dae2b0686647d170168e328899 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0222 20:45:08.764560 6226 start.go:368] acquired machines lock for "multinode-293000-m03" in 33.016µs
I0222 20:45:08.764576 6226 start.go:96] Skipping create...Using existing machine configuration
I0222 20:45:08.764581 6226 fix.go:55] fixHost starting: m03
I0222 20:45:08.764812 6226 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0222 20:45:08.764832 6226 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0222 20:45:08.771823 6226 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51554
I0222 20:45:08.772173 6226 main.go:141] libmachine: () Calling .GetVersion
I0222 20:45:08.772542 6226 main.go:141] libmachine: Using API Version 1
I0222 20:45:08.772561 6226 main.go:141] libmachine: () Calling .SetConfigRaw
I0222 20:45:08.772765 6226 main.go:141] libmachine: () Calling .GetMachineName
I0222 20:45:08.772885 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:08.772968 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetState
I0222 20:45:08.773055 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:45:08.773147 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | hyperkit pid from json: 6146
I0222 20:45:08.774001 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | hyperkit pid 6146 missing from process table
I0222 20:45:08.774035 6226 fix.go:103] recreateIfNeeded on multinode-293000-m03: state=Stopped err=<nil>
I0222 20:45:08.774046 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
W0222 20:45:08.774125 6226 fix.go:129] unexpected machine state, will restart: <nil>
I0222 20:45:08.796003 6226 out.go:177] * Restarting existing hyperkit VM for "multinode-293000-m03" ...
I0222 20:45:08.837919 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .Start
I0222 20:45:08.838206 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:45:08.838262 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/hyperkit.pid
I0222 20:45:08.838338 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | Using UUID 63b17e68-b334-11ed-87a5-149d997fca88
I0222 20:45:08.866674 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | Generated MAC 66:3a:f:a5:79:1d
I0222 20:45:08.866696 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000
I0222 20:45:08.866830 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"63b17e68-b334-11ed-87a5-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0002c7650)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/bzimage", Initrd:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""
, process:(*os.Process)(nil)}
I0222 20:45:08.866871 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"63b17e68-b334-11ed-87a5-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0002c7650)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/bzimage", Initrd:"/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:""
, process:(*os.Process)(nil)}
I0222 20:45:08.866948 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "63b17e68-b334-11ed-87a5-149d997fca88", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/multinode-293000-m03.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/tty,log=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/bzimage,/Users/j
enkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000"}
I0222 20:45:08.867044 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U 63b17e68-b334-11ed-87a5-149d997fca88 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/multinode-293000-m03.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/tty,log=/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/console-ring -f kexec,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/bzimage,/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/mult
inode-293000-m03/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-293000"
I0222 20:45:08.867060 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 DEBUG: hyperkit: Redirecting stdout/stderr to logger
I0222 20:45:08.868195 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 DEBUG: hyperkit: Pid is 6359
I0222 20:45:08.868535 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | Attempt 0
I0222 20:45:08.868546 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0222 20:45:08.868636 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | hyperkit pid from json: 6359
I0222 20:45:08.869569 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | Searching for 66:3a:f:a5:79:1d in /var/db/dhcpd_leases ...
I0222 20:45:08.869624 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | Found 13 entries in /var/db/dhcpd_leases!
I0222 20:45:08.869636 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.13 HWAddress:f6:5a:53:47:16:21 ID:1,f6:5a:53:47:16:21 Lease:0x63f840aa}
I0222 20:45:08.869645 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.12 HWAddress:8e:8:26:1e:84:48 ID:1,8e:8:26:1e:84:48 Lease:0x63f84076}
I0222 20:45:08.869656 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.14 HWAddress:66:3a:f:a5:79:1d ID:1,66:3a:f:a5:79:1d Lease:0x63f6eeed}
I0222 20:45:08.869675 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | Found match: 66:3a:f:a5:79:1d
I0222 20:45:08.869687 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | IP: 192.168.64.14
I0222 20:45:08.869717 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetConfigRaw
I0222 20:45:08.870387 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetIP
I0222 20:45:08.870565 6226 profile.go:148] Saving config to /Users/jenkins/minikube-integration/15909-2565/.minikube/profiles/multinode-293000/config.json ...
I0222 20:45:08.870883 6226 machine.go:88] provisioning docker machine ...
I0222 20:45:08.870893 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:08.870993 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetMachineName
I0222 20:45:08.871074 6226 buildroot.go:166] provisioning hostname "multinode-293000-m03"
I0222 20:45:08.871084 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetMachineName
I0222 20:45:08.871170 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:08.871259 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:08.871337 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:08.871412 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:08.871485 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:08.871589 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:45:08.871910 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.14 22 <nil> <nil>}
I0222 20:45:08.871920 6226 main.go:141] libmachine: About to run SSH command:
sudo hostname multinode-293000-m03 && echo "multinode-293000-m03" | sudo tee /etc/hostname
I0222 20:45:08.874682 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 INFO : hyperkit: stderr: Using fd 5 for I/O notifications
I0222 20:45:08.882216 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD
I0222 20:45:08.882943 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I0222 20:45:08.882954 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I0222 20:45:08.882964 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I0222 20:45:08.882971 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:08 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I0222 20:45:09.245825 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0
I0222 20:45:09.245841 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0
I0222 20:45:09.349892 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I0222 20:45:09.349919 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I0222 20:45:09.349935 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I0222 20:45:09.349945 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I0222 20:45:09.350754 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1
I0222 20:45:09.350764 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:09 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1
I0222 20:45:13.874057 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:13 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1
I0222 20:45:13.874092 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:13 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1
I0222 20:45:13.874100 6226 main.go:141] libmachine: (multinode-293000-m03) DBG | 2023/02/22 20:45:13 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1
I0222 20:45:16.782770 6226 main.go:141] libmachine: Error dialing TCP: dial tcp 192.168.64.14:22: connect: connection refused
I0222 20:45:19.855607 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-293000-m03
I0222 20:45:19.855625 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:19.855757 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:19.855856 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:19.855947 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:19.856055 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:19.856191 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:45:19.856504 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.14 22 <nil> <nil>}
I0222 20:45:19.856517 6226 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smultinode-293000-m03' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-293000-m03/g' /etc/hosts;
else
echo '127.0.1.1 multinode-293000-m03' | sudo tee -a /etc/hosts;
fi
fi
I0222 20:45:19.923607 6226 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0222 20:45:19.923624 6226 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/15909-2565/.minikube CaCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/15909-2565/.minikube}
I0222 20:45:19.923631 6226 buildroot.go:174] setting up certificates
I0222 20:45:19.923636 6226 provision.go:83] configureAuth start
I0222 20:45:19.923642 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetMachineName
I0222 20:45:19.923790 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetIP
I0222 20:45:19.923876 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:19.923963 6226 provision.go:138] copyHostCerts
I0222 20:45:19.924000 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem
I0222 20:45:19.924049 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem, removing ...
I0222 20:45:19.924058 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem
I0222 20:45:19.924203 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/ca.pem (1082 bytes)
I0222 20:45:19.924364 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem
I0222 20:45:19.924402 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem, removing ...
I0222 20:45:19.924407 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem
I0222 20:45:19.924463 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/cert.pem (1123 bytes)
I0222 20:45:19.924584 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem
I0222 20:45:19.924613 6226 exec_runner.go:144] found /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem, removing ...
I0222 20:45:19.924618 6226 exec_runner.go:207] rm: /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem
I0222 20:45:19.924675 6226 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/15909-2565/.minikube/key.pem (1679 bytes)
I0222 20:45:19.924795 6226 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca-key.pem org=jenkins.multinode-293000-m03 san=[192.168.64.14 192.168.64.14 localhost 127.0.0.1 minikube multinode-293000-m03]
I0222 20:45:20.004242 6226 provision.go:172] copyRemoteCerts
I0222 20:45:20.004287 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0222 20:45:20.004304 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:20.004458 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.004551 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.004638 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.004722 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.14 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/id_rsa Username:docker}
I0222 20:45:20.042897 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0222 20:45:20.042968 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0222 20:45:20.058658 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem -> /etc/docker/server.pem
I0222 20:45:20.058717 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server.pem --> /etc/docker/server.pem (1237 bytes)
I0222 20:45:20.074291 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0222 20:45:20.074355 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0222 20:45:20.089809 6226 provision.go:86] duration metric: configureAuth took 166.169671ms
I0222 20:45:20.089822 6226 buildroot.go:189] setting minikube options for container-runtime
I0222 20:45:20.090008 6226 config.go:182] Loaded profile config "multinode-293000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0222 20:45:20.090022 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:20.090151 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:20.090266 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.090372 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.090459 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.090538 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.090652 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:45:20.090949 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.14 22 <nil> <nil>}
I0222 20:45:20.090957 6226 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0222 20:45:20.153395 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I0222 20:45:20.153407 6226 buildroot.go:70] root file system type: tmpfs
I0222 20:45:20.153484 6226 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0222 20:45:20.153496 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:20.153618 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.153723 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.153807 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.153911 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.154051 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:45:20.154367 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.14 22 <nil> <nil>}
I0222 20:45:20.154412 6226 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
Environment="NO_PROXY=192.168.64.12"
Environment="NO_PROXY=192.168.64.12,192.168.64.13"
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0222 20:45:20.224832 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
Environment=NO_PROXY=192.168.64.12
Environment=NO_PROXY=192.168.64.12,192.168.64.13
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0222 20:45:20.224851 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:20.224987 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.225084 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.225177 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.225262 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.225391 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:45:20.225703 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.14 22 <nil> <nil>}
I0222 20:45:20.225715 6226 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0222 20:45:20.732412 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I0222 20:45:20.732430 6226 machine.go:91] provisioned docker machine in 11.861754679s
I0222 20:45:20.732437 6226 start.go:300] post-start starting for "multinode-293000-m03" (driver="hyperkit")
I0222 20:45:20.732452 6226 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0222 20:45:20.732468 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:20.732657 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0222 20:45:20.732672 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:20.732766 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.732873 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.732953 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.733035 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.14 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/id_rsa Username:docker}
I0222 20:45:20.770518 6226 ssh_runner.go:195] Run: cat /etc/os-release
I0222 20:45:20.772819 6226 command_runner.go:130] > NAME=Buildroot
I0222 20:45:20.772827 6226 command_runner.go:130] > VERSION=2021.02.12-1-g41e8300-dirty
I0222 20:45:20.772831 6226 command_runner.go:130] > ID=buildroot
I0222 20:45:20.772837 6226 command_runner.go:130] > VERSION_ID=2021.02.12
I0222 20:45:20.772842 6226 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"
I0222 20:45:20.773060 6226 info.go:137] Remote host: Buildroot 2021.02.12
I0222 20:45:20.773070 6226 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15909-2565/.minikube/addons for local assets ...
I0222 20:45:20.773150 6226 filesync.go:126] Scanning /Users/jenkins/minikube-integration/15909-2565/.minikube/files for local assets ...
I0222 20:45:20.773294 6226 filesync.go:149] local asset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> 30412.pem in /etc/ssl/certs
I0222 20:45:20.773301 6226 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem -> /etc/ssl/certs/30412.pem
I0222 20:45:20.773462 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0222 20:45:20.778996 6226 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/15909-2565/.minikube/files/etc/ssl/certs/30412.pem --> /etc/ssl/certs/30412.pem (1708 bytes)
I0222 20:45:20.794906 6226 start.go:303] post-start completed in 62.454223ms
I0222 20:45:20.794916 6226 fix.go:57] fixHost completed within 12.030553709s
I0222 20:45:20.794928 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:20.795057 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.795151 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.795231 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.795308 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.795422 6226 main.go:141] libmachine: Using SSH client type: native
I0222 20:45:20.795730 6226 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x140f720] 0x1412660 <nil> [] 0s} 192.168.64.14 22 <nil> <nil>}
I0222 20:45:20.795738 6226 main.go:141] libmachine: About to run SSH command:
date +%!s(MISSING).%!N(MISSING)
I0222 20:45:20.857423 6226 main.go:141] libmachine: SSH cmd err, output: <nil>: 1677127520.731422810
I0222 20:45:20.857435 6226 fix.go:207] guest clock: 1677127520.731422810
I0222 20:45:20.857441 6226 fix.go:220] Guest: 2023-02-22 20:45:20.73142281 -0800 PST Remote: 2023-02-22 20:45:20.794918 -0800 PST m=+114.260712075 (delta=-63.49519ms)
I0222 20:45:20.857450 6226 fix.go:191] guest clock delta is within tolerance: -63.49519ms
I0222 20:45:20.857454 6226 start.go:83] releasing machines lock for "multinode-293000-m03", held for 12.093107673s
I0222 20:45:20.857473 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:20.857598 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetIP
I0222 20:45:20.880215 6226 out.go:177] * Found network options:
I0222 20:45:20.902155 6226 out.go:177] - NO_PROXY=192.168.64.12,192.168.64.13
W0222 20:45:20.924180 6226 proxy.go:119] fail to check proxy env: Error ip not in block
W0222 20:45:20.924222 6226 proxy.go:119] fail to check proxy env: Error ip not in block
I0222 20:45:20.924242 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:20.925119 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:20.925340 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .DriverName
I0222 20:45:20.925485 6226 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0222 20:45:20.925525 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
W0222 20:45:20.925551 6226 proxy.go:119] fail to check proxy env: Error ip not in block
W0222 20:45:20.925574 6226 proxy.go:119] fail to check proxy env: Error ip not in block
I0222 20:45:20.925697 6226 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0222 20:45:20.925724 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHHostname
I0222 20:45:20.925831 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.925962 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHPort
I0222 20:45:20.926084 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.926178 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHKeyPath
I0222 20:45:20.926294 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.926351 6226 main.go:141] libmachine: (multinode-293000-m03) Calling .GetSSHUsername
I0222 20:45:20.926507 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.14 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/id_rsa Username:docker}
I0222 20:45:20.926541 6226 sshutil.go:53] new ssh client: &{IP:192.168.64.14 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/15909-2565/.minikube/machines/multinode-293000-m03/id_rsa Username:docker}
I0222 20:45:20.962222 6226 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory
W0222 20:45:20.962245 6226 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0222 20:45:20.962290 6226 ssh_runner.go:195] Run: which cri-dockerd
I0222 20:45:20.999990 6226 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.
I0222 20:45:21.000458 6226 command_runner.go:130] > /usr/bin/cri-dockerd
I0222 20:45:21.000559 6226 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0222 20:45:21.006362 6226 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (135 bytes)
I0222 20:45:21.017458 6226 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0222 20:45:21.027003 6226 command_runner.go:139] > /etc/cni/net.d/87-podman-bridge.conflist,
I0222 20:45:21.027031 6226 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0222 20:45:21.027038 6226 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0222 20:45:21.027122 6226 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0222 20:45:21.042804 6226 command_runner.go:130] > registry.k8s.io/kube-apiserver:v1.26.1
I0222 20:45:21.042817 6226 command_runner.go:130] > registry.k8s.io/kube-controller-manager:v1.26.1
I0222 20:45:21.042822 6226 command_runner.go:130] > registry.k8s.io/kube-scheduler:v1.26.1
I0222 20:45:21.042826 6226 command_runner.go:130] > registry.k8s.io/kube-proxy:v1.26.1
I0222 20:45:21.042836 6226 command_runner.go:130] > registry.k8s.io/etcd:3.5.6-0
I0222 20:45:21.042842 6226 command_runner.go:130] > registry.k8s.io/pause:3.9
I0222 20:45:21.042847 6226 command_runner.go:130] > kindest/kindnetd:v20221004-44d545d1
I0222 20:45:21.042852 6226 command_runner.go:130] > registry.k8s.io/coredns/coredns:v1.9.3
I0222 20:45:21.042855 6226 command_runner.go:130] > registry.k8s.io/pause:3.6
I0222 20:45:21.042872 6226 command_runner.go:130] > gcr.io/k8s-minikube/storage-provisioner:v5
I0222 20:45:21.043818 6226 docker.go:630] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.26.1
registry.k8s.io/kube-controller-manager:v1.26.1
registry.k8s.io/kube-scheduler:v1.26.1
registry.k8s.io/kube-proxy:v1.26.1
registry.k8s.io/etcd:3.5.6-0
registry.k8s.io/pause:3.9
kindest/kindnetd:v20221004-44d545d1
registry.k8s.io/coredns/coredns:v1.9.3
registry.k8s.io/pause:3.6
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0222 20:45:21.043829 6226 docker.go:560] Images already preloaded, skipping extraction
I0222 20:45:21.043834 6226 start.go:485] detecting cgroup driver to use...
I0222 20:45:21.043904 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
image-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0222 20:45:21.063989 6226 command_runner.go:130] > runtime-endpoint: unix:///run/containerd/containerd.sock
I0222 20:45:21.064002 6226 command_runner.go:130] > image-endpoint: unix:///run/containerd/containerd.sock
I0222 20:45:21.064389 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0222 20:45:21.071737 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0222 20:45:21.079115 6226 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I0222 20:45:21.079181 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0222 20:45:21.089062 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0222 20:45:21.100610 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0222 20:45:21.110994 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0222 20:45:21.118130 6226 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0222 20:45:21.124560 6226 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0222 20:45:21.131048 6226 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0222 20:45:21.136924 6226 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1
I0222 20:45:21.137062 6226 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0222 20:45:21.142754 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:45:21.226342 6226 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0222 20:45:21.238824 6226 start.go:485] detecting cgroup driver to use...
I0222 20:45:21.238904 6226 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0222 20:45:21.259355 6226 command_runner.go:130] > # /usr/lib/systemd/system/docker.service
I0222 20:45:21.260057 6226 command_runner.go:130] > [Unit]
I0222 20:45:21.260066 6226 command_runner.go:130] > Description=Docker Application Container Engine
I0222 20:45:21.260073 6226 command_runner.go:130] > Documentation=https://docs.docker.com
I0222 20:45:21.260078 6226 command_runner.go:130] > After=network.target minikube-automount.service docker.socket
I0222 20:45:21.260083 6226 command_runner.go:130] > Requires= minikube-automount.service docker.socket
I0222 20:45:21.260090 6226 command_runner.go:130] > StartLimitBurst=3
I0222 20:45:21.260094 6226 command_runner.go:130] > StartLimitIntervalSec=60
I0222 20:45:21.260099 6226 command_runner.go:130] > [Service]
I0222 20:45:21.260103 6226 command_runner.go:130] > Type=notify
I0222 20:45:21.260107 6226 command_runner.go:130] > Restart=on-failure
I0222 20:45:21.260111 6226 command_runner.go:130] > Environment=NO_PROXY=192.168.64.12
I0222 20:45:21.260115 6226 command_runner.go:130] > Environment=NO_PROXY=192.168.64.12,192.168.64.13
I0222 20:45:21.260125 6226 command_runner.go:130] > # This file is a systemd drop-in unit that inherits from the base dockerd configuration.
I0222 20:45:21.260133 6226 command_runner.go:130] > # The base configuration already specifies an 'ExecStart=...' command. The first directive
I0222 20:45:21.260138 6226 command_runner.go:130] > # here is to clear out that command inherited from the base configuration. Without this,
I0222 20:45:21.260144 6226 command_runner.go:130] > # the command from the base configuration and the command specified here are treated as
I0222 20:45:21.260150 6226 command_runner.go:130] > # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
I0222 20:45:21.260156 6226 command_runner.go:130] > # will catch this invalid input and refuse to start the service with an error like:
I0222 20:45:21.260169 6226 command_runner.go:130] > # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
I0222 20:45:21.260177 6226 command_runner.go:130] > # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
I0222 20:45:21.260186 6226 command_runner.go:130] > # container runtimes. If left unlimited, it may result in OOM issues with MySQL.
I0222 20:45:21.260190 6226 command_runner.go:130] > ExecStart=
I0222 20:45:21.260203 6226 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
I0222 20:45:21.260210 6226 command_runner.go:130] > ExecReload=/bin/kill -s HUP $MAINPID
I0222 20:45:21.260215 6226 command_runner.go:130] > # Having non-zero Limit*s causes performance problems due to accounting overhead
I0222 20:45:21.260221 6226 command_runner.go:130] > # in the kernel. We recommend using cgroups to do container-local accounting.
I0222 20:45:21.260225 6226 command_runner.go:130] > LimitNOFILE=infinity
I0222 20:45:21.260232 6226 command_runner.go:130] > LimitNPROC=infinity
I0222 20:45:21.260236 6226 command_runner.go:130] > LimitCORE=infinity
I0222 20:45:21.260241 6226 command_runner.go:130] > # Uncomment TasksMax if your systemd version supports it.
I0222 20:45:21.260245 6226 command_runner.go:130] > # Only systemd 226 and above support this version.
I0222 20:45:21.260248 6226 command_runner.go:130] > TasksMax=infinity
I0222 20:45:21.260252 6226 command_runner.go:130] > TimeoutStartSec=0
I0222 20:45:21.260257 6226 command_runner.go:130] > # set delegate yes so that systemd does not reset the cgroups of docker containers
I0222 20:45:21.260261 6226 command_runner.go:130] > Delegate=yes
I0222 20:45:21.260271 6226 command_runner.go:130] > # kill only the docker process, not all processes in the cgroup
I0222 20:45:21.260275 6226 command_runner.go:130] > KillMode=process
I0222 20:45:21.260278 6226 command_runner.go:130] > [Install]
I0222 20:45:21.260282 6226 command_runner.go:130] > WantedBy=multi-user.target
I0222 20:45:21.260557 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0222 20:45:21.272348 6226 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0222 20:45:21.287341 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0222 20:45:21.296390 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0222 20:45:21.304619 6226 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0222 20:45:21.329294 6226 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0222 20:45:21.338036 6226 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
image-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0222 20:45:21.349887 6226 command_runner.go:130] > runtime-endpoint: unix:///var/run/cri-dockerd.sock
I0222 20:45:21.349901 6226 command_runner.go:130] > image-endpoint: unix:///var/run/cri-dockerd.sock
I0222 20:45:21.350226 6226 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0222 20:45:21.436177 6226 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0222 20:45:21.525894 6226 docker.go:529] configuring docker to use "cgroupfs" as cgroup driver...
I0222 20:45:21.525910 6226 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
I0222 20:45:21.538086 6226 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0222 20:45:21.633720 6226 ssh_runner.go:195] Run: sudo systemctl restart docker
I0222 20:46:22.452405 6226 command_runner.go:130] ! Job for docker.service failed because the control process exited with error code.
I0222 20:46:22.452419 6226 command_runner.go:130] ! See "systemctl status docker.service" and "journalctl -xe" for details.
I0222 20:46:22.452428 6226 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1m0.816571721s)
I0222 20:46:22.490645 6226 out.go:177]
W0222 20:46:22.512302 6226 out.go:239] X Exiting due to RUNTIME_ENABLE: sudo systemctl restart docker: Process exited with status 1
stdout:
stderr:
Job for docker.service failed because the control process exited with error code.
See "systemctl status docker.service" and "journalctl -xe" for details.
W0222 20:46:22.512331 6226 out.go:239] *
W0222 20:46:22.513584 6226 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0222 20:46:22.599050 6226 out.go:177]
*
* ==> Docker <==
* -- Journal begins at Thu 2023-02-23 04:43:34 UTC, ends at Thu 2023-02-23 04:46:23 UTC. --
Feb 23 04:44:14 multinode-293000 dockerd[891]: time="2023-02-23T04:44:14.760260949Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Feb 23 04:44:14 multinode-293000 dockerd[891]: time="2023-02-23T04:44:14.760343230Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Feb 23 04:44:14 multinode-293000 dockerd[891]: time="2023-02-23T04:44:14.760352498Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Feb 23 04:44:14 multinode-293000 dockerd[891]: time="2023-02-23T04:44:14.760943416Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/559689c8c5b05b41b7c84259b34e0100733f82a2a31f37bfba099e59816ff4ed pid=3456 runtime=io.containerd.runc.v2
Feb 23 04:44:15 multinode-293000 dockerd[891]: time="2023-02-23T04:44:15.257778432Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Feb 23 04:44:15 multinode-293000 dockerd[891]: time="2023-02-23T04:44:15.257841787Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Feb 23 04:44:15 multinode-293000 dockerd[891]: time="2023-02-23T04:44:15.257851714Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Feb 23 04:44:15 multinode-293000 dockerd[891]: time="2023-02-23T04:44:15.258074050Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/09776515c7c315e565bed8d5b0653a7c93c04aa9cc69a3e07511d384a0dbf6e2 pid=3648 runtime=io.containerd.runc.v2
Feb 23 04:44:15 multinode-293000 dockerd[891]: time="2023-02-23T04:44:15.398948878Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Feb 23 04:44:15 multinode-293000 dockerd[891]: time="2023-02-23T04:44:15.399089887Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Feb 23 04:44:15 multinode-293000 dockerd[891]: time="2023-02-23T04:44:15.399099958Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Feb 23 04:44:15 multinode-293000 dockerd[891]: time="2023-02-23T04:44:15.399273229Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/a1ca13b590e428c68be8f19b9148a6670dff4d50432f5e97ac3b3ac183c18093 pid=3727 runtime=io.containerd.runc.v2
Feb 23 04:44:15 multinode-293000 dockerd[891]: time="2023-02-23T04:44:15.874240671Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Feb 23 04:44:15 multinode-293000 dockerd[891]: time="2023-02-23T04:44:15.874317267Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Feb 23 04:44:15 multinode-293000 dockerd[891]: time="2023-02-23T04:44:15.874326900Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Feb 23 04:44:15 multinode-293000 dockerd[891]: time="2023-02-23T04:44:15.874748370Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/bb450d7c0756cd8cb5aad4a83c84a793c0a7500f91162becd7e1e36b523e2d51 pid=3809 runtime=io.containerd.runc.v2
Feb 23 04:44:30 multinode-293000 dockerd[891]: time="2023-02-23T04:44:30.879137511Z" level=info msg="shim disconnected" id=b5ea45d0fc008fc8260a91fa0b682b52c3a04559adc7fd67ea85aeb7c875cee8
Feb 23 04:44:30 multinode-293000 dockerd[891]: time="2023-02-23T04:44:30.879227140Z" level=warning msg="cleaning up after shim disconnected" id=b5ea45d0fc008fc8260a91fa0b682b52c3a04559adc7fd67ea85aeb7c875cee8 namespace=moby
Feb 23 04:44:30 multinode-293000 dockerd[891]: time="2023-02-23T04:44:30.879236319Z" level=info msg="cleaning up dead shim"
Feb 23 04:44:30 multinode-293000 dockerd[885]: time="2023-02-23T04:44:30.879432928Z" level=info msg="ignoring event" container=b5ea45d0fc008fc8260a91fa0b682b52c3a04559adc7fd67ea85aeb7c875cee8 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Feb 23 04:44:30 multinode-293000 dockerd[891]: time="2023-02-23T04:44:30.887550491Z" level=warning msg="cleanup warnings time=\"2023-02-23T04:44:30Z\" level=info msg=\"starting signal loop\" namespace=moby pid=4087 runtime=io.containerd.runc.v2\n"
Feb 23 04:44:46 multinode-293000 dockerd[891]: time="2023-02-23T04:44:46.835257330Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Feb 23 04:44:46 multinode-293000 dockerd[891]: time="2023-02-23T04:44:46.835314672Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Feb 23 04:44:46 multinode-293000 dockerd[891]: time="2023-02-23T04:44:46.835324183Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Feb 23 04:44:46 multinode-293000 dockerd[891]: time="2023-02-23T04:44:46.835408527Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/9a6cc4df5b9bea31257f7c519cd73d464439f29914f06ec1a9b99f53bb08a1b6 pid=4280 runtime=io.containerd.runc.v2
*
* ==> container status <==
* CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID
9a6cc4df5b9be 6e38f40d628db About a minute ago Running storage-provisioner 2 8d189ce4c54b8
bb450d7c0756c 8c811b4aec35f 2 minutes ago Running busybox 1 a1ca13b590e42
09776515c7c31 5185b96f0becf 2 minutes ago Running coredns 1 559689c8c5b05
45c94319d8e4c d6e3e26021b60 2 minutes ago Running kindnet-cni 1 441d02843542d
b5ea45d0fc008 6e38f40d628db 2 minutes ago Exited storage-provisioner 1 8d189ce4c54b8
e716cfa05a898 46a6bb3c77ce0 2 minutes ago Running kube-proxy 1 3a5526dadb677
6c26fbc738c9b fce326961ae2d 2 minutes ago Running etcd 1 25bd12824a3d3
1b4f70dbb74eb 655493523f607 2 minutes ago Running kube-scheduler 1 6df92d153709d
17e72c6f43c2e e9c08e11b07f6 2 minutes ago Running kube-controller-manager 1 daded6d1c0846
32b4e9141edbe deb04688c4a35 2 minutes ago Running kube-apiserver 1 d4b62645822ce
4e41e5af96e59 gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12 4 minutes ago Exited busybox 0 0baca591db69d
ca2f5eddf90fb 5185b96f0becf 5 minutes ago Exited coredns 0 949ea4d7145b0
0c82552907802 kindest/kindnetd@sha256:273469d84ede51824194a31f6a405e3d3686b8b87cd161ea40f6bc3ff8e04ffe 5 minutes ago Exited kindnet-cni 0 6d623202802d0
1684370ceee74 46a6bb3c77ce0 5 minutes ago Exited kube-proxy 0 41f088cd951f7
84e0fe46ac29a fce326961ae2d 6 minutes ago Exited etcd 0 7efc215d8e687
dedc068e64af3 655493523f607 6 minutes ago Exited kube-scheduler 0 0d2b73b122a02
dba4607b22f43 e9c08e11b07f6 6 minutes ago Exited kube-controller-manager 0 9c9e2bb93c682
141cda940cdc0 deb04688c4a35 6 minutes ago Exited kube-apiserver 0 7bd801790b1af
*
* ==> coredns [09776515c7c3] <==
* .:53
[INFO] plugin/reload: Running configuration SHA512 = 82b95b61957b89eeea31bdaf6987f010031330ef97d5f8469dbdaa80b119a5b0c9955b961009dd5b77ee3ada002b456836be781510516cbd9d015b1a704a24ea
CoreDNS-1.9.3
linux/amd64, go1.18.2, 45b0a11
[INFO] 127.0.0.1:41058 - 22991 "HINFO IN 2011230882998953136.3238462253989188988. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.009414692s
*
* ==> coredns [ca2f5eddf90f] <==
* [INFO] 10.244.1.2:55560 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000099328s
[INFO] 10.244.1.2:53256 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.0001183s
[INFO] 10.244.1.2:46218 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000083024s
[INFO] 10.244.1.2:42918 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000111065s
[INFO] 10.244.1.2:56389 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000046594s
[INFO] 10.244.1.2:38672 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000118523s
[INFO] 10.244.1.2:57017 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000040076s
[INFO] 10.244.0.3:43880 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000123747s
[INFO] 10.244.0.3:45726 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000064756s
[INFO] 10.244.0.3:43856 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000103877s
[INFO] 10.244.0.3:47153 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000054024s
[INFO] 10.244.1.2:46268 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000096514s
[INFO] 10.244.1.2:41044 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00006751s
[INFO] 10.244.1.2:35152 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000060904s
[INFO] 10.244.1.2:48230 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000092505s
[INFO] 10.244.0.3:52844 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00008998s
[INFO] 10.244.0.3:36109 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.00013284s
[INFO] 10.244.0.3:33025 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000064637s
[INFO] 10.244.0.3:35029 - 5 "PTR IN 1.64.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.00011698s
[INFO] 10.244.1.2:49364 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000092872s
[INFO] 10.244.1.2:59344 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000115931s
[INFO] 10.244.1.2:56658 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000083846s
[INFO] 10.244.1.2:42621 - 5 "PTR IN 1.64.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000118851s
[INFO] SIGTERM: Shutting down servers then terminating
[INFO] plugin/health: Going into lameduck mode for 5s
*
* ==> describe nodes <==
* Name: multinode-293000
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-293000
kubernetes.io/os=linux
minikube.k8s.io/commit=66d56dc3ac28a702789778ac47e90f12526a0321
minikube.k8s.io/name=multinode-293000
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2023_02_22T20_40_27_0700
minikube.k8s.io/version=v1.29.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 23 Feb 2023 04:40:23 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: multinode-293000
AcquireTime: <unset>
RenewTime: Thu, 23 Feb 2023 04:46:21 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 23 Feb 2023 04:44:07 +0000 Thu, 23 Feb 2023 04:40:21 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 23 Feb 2023 04:44:07 +0000 Thu, 23 Feb 2023 04:40:21 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 23 Feb 2023 04:44:07 +0000 Thu, 23 Feb 2023 04:40:21 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 23 Feb 2023 04:44:07 +0000 Thu, 23 Feb 2023 04:44:07 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.64.12
Hostname: multinode-293000
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2166052Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2166052Ki
pods: 110
System Info:
Machine ID: cd181c8f159840b0b1aa5b5502f03dae
System UUID: 1ad011ed-0000-0000-affa-149d997fca88
Boot ID: 1594749c-d707-4b36-8e5a-b863f82e5340
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://20.10.23
Kubelet Version: v1.26.1
Kube-Proxy Version: v1.26.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (9 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-6b86dd6d48-5nxg2 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m40s
kube-system coredns-787d4945fb-b28zh 100m (5%!)(MISSING) 0 (0%!)(MISSING) 70Mi (3%!)(MISSING) 170Mi (8%!)(MISSING) 5m45s
kube-system etcd-multinode-293000 100m (5%!)(MISSING) 0 (0%!)(MISSING) 100Mi (4%!)(MISSING) 0 (0%!)(MISSING) 5m58s
kube-system kindnet-nm7kn 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 5m45s
kube-system kube-apiserver-multinode-293000 250m (12%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m58s
kube-system kube-controller-manager-multinode-293000 200m (10%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m58s
kube-system kube-proxy-pxq2s 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m45s
kube-system kube-scheduler-multinode-293000 100m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m58s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m44s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (42%!)(MISSING) 100m (5%!)(MISSING)
memory 220Mi (10%!)(MISSING) 220Mi (10%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 5m43s kube-proxy
Normal Starting 2m23s kube-proxy
Normal NodeHasSufficientPID 5m58s kubelet Node multinode-293000 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 5m58s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 5m58s kubelet Node multinode-293000 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 5m58s kubelet Node multinode-293000 status is now: NodeHasNoDiskPressure
Normal Starting 5m58s kubelet Starting kubelet.
Normal RegisteredNode 5m45s node-controller Node multinode-293000 event: Registered Node multinode-293000 in Controller
Normal NodeReady 5m38s kubelet Node multinode-293000 status is now: NodeReady
Normal Starting 2m31s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 2m31s (x8 over 2m31s) kubelet Node multinode-293000 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 2m31s (x8 over 2m31s) kubelet Node multinode-293000 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 2m31s (x7 over 2m31s) kubelet Node multinode-293000 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 2m31s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 2m13s node-controller Node multinode-293000 event: Registered Node multinode-293000 in Controller
Name: multinode-293000-m02
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-293000-m02
kubernetes.io/os=linux
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 23 Feb 2023 04:45:01 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: multinode-293000-m02
AcquireTime: <unset>
RenewTime: Thu, 23 Feb 2023 04:46:22 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 23 Feb 2023 04:45:06 +0000 Thu, 23 Feb 2023 04:45:01 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 23 Feb 2023 04:45:06 +0000 Thu, 23 Feb 2023 04:45:01 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 23 Feb 2023 04:45:06 +0000 Thu, 23 Feb 2023 04:45:01 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 23 Feb 2023 04:45:06 +0000 Thu, 23 Feb 2023 04:45:06 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.64.13
Hostname: multinode-293000-m02
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2166052Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2166052Ki
pods: 110
System Info:
Machine ID: fd9ed6ab6e774856be7c78f9030224bf
System UUID: 3f0c11ed-0000-0000-affa-149d997fca88
Boot ID: 46d2d6f5-2ced-41c0-a1a4-27f223b82209
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://20.10.23
Kubelet Version: v1.26.1
Kube-Proxy Version: v1.26.1
PodCIDR: 10.244.1.0/24
PodCIDRs: 10.244.1.0/24
Non-terminated Pods: (3 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-6b86dd6d48-mktgv 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 87s
kube-system kindnet-bzxtr 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 4m58s
kube-system kube-proxy-qmsbf 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m58s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (5%!)(MISSING) 100m (5%!)(MISSING)
memory 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 4m47s kube-proxy
Normal Starting 80s kube-proxy
Normal NodeHasSufficientMemory 4m58s (x8 over 5m11s) kubelet Node multinode-293000-m02 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 4m58s (x8 over 5m11s) kubelet Node multinode-293000-m02 status is now: NodeHasNoDiskPressure
Normal Starting 83s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 83s (x2 over 83s) kubelet Node multinode-293000-m02 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 83s (x2 over 83s) kubelet Node multinode-293000-m02 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 83s (x2 over 83s) kubelet Node multinode-293000-m02 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 83s kubelet Updated Node Allocatable limit across pods
Normal RegisteredNode 78s node-controller Node multinode-293000-m02 event: Registered Node multinode-293000-m02 in Controller
Normal NodeReady 78s kubelet Node multinode-293000-m02 status is now: NodeReady
Name: multinode-293000-m03
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=multinode-293000-m03
kubernetes.io/os=linux
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 23 Feb 2023 04:42:56 +0000
Taints: node.kubernetes.io/unreachable:NoExecute
node.kubernetes.io/unreachable:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: multinode-293000-m03
AcquireTime: <unset>
RenewTime: Thu, 23 Feb 2023 04:43:06 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure Unknown Thu, 23 Feb 2023 04:43:05 +0000 Thu, 23 Feb 2023 04:44:51 +0000 NodeStatusUnknown Kubelet stopped posting node status.
DiskPressure Unknown Thu, 23 Feb 2023 04:43:05 +0000 Thu, 23 Feb 2023 04:44:51 +0000 NodeStatusUnknown Kubelet stopped posting node status.
PIDPressure Unknown Thu, 23 Feb 2023 04:43:05 +0000 Thu, 23 Feb 2023 04:44:51 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Ready Unknown Thu, 23 Feb 2023 04:43:05 +0000 Thu, 23 Feb 2023 04:44:51 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Addresses:
InternalIP: 192.168.64.14
Hostname: multinode-293000-m03
Capacity:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2166052Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 17784752Ki
hugepages-2Mi: 0
memory: 2166052Ki
pods: 110
System Info:
Machine ID: 3d2c20a02c644bd7a1b897fb38ac7990
System UUID: 63b111ed-0000-0000-87a5-149d997fca88
Boot ID: 2fb186ac-80c4-4ae4-a037-4a0ed9a6fda1
Kernel Version: 5.10.57
OS Image: Buildroot 2021.02.12
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://20.10.23
Kubelet Version: v1.26.1
Kube-Proxy Version: v1.26.1
PodCIDR: 10.244.3.0/24
PodCIDRs: 10.244.3.0/24
Non-terminated Pods: (2 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system kindnet-rrx46 100m (5%!)(MISSING) 100m (5%!)(MISSING) 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING) 4m9s
kube-system kube-proxy-bj985 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m9s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (5%!)(MISSING) 100m (5%!)(MISSING)
memory 50Mi (2%!)(MISSING) 50Mi (2%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 4m4s kube-proxy
Normal Starting 3m25s kube-proxy
Normal Starting 4m10s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 4m10s (x2 over 4m10s) kubelet Node multinode-293000-m03 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 4m10s (x2 over 4m10s) kubelet Node multinode-293000-m03 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 4m10s (x2 over 4m10s) kubelet Node multinode-293000-m03 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 4m10s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 3m56s kubelet Node multinode-293000-m03 status is now: NodeReady
Normal Starting 3m28s kubelet Starting kubelet.
Normal NodeHasSufficientMemory 3m28s (x2 over 3m28s) kubelet Node multinode-293000-m03 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 3m28s (x2 over 3m28s) kubelet Node multinode-293000-m03 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 3m28s (x2 over 3m28s) kubelet Node multinode-293000-m03 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 3m28s kubelet Updated Node Allocatable limit across pods
Normal NodeReady 3m19s kubelet Node multinode-293000-m03 status is now: NodeReady
Normal RegisteredNode 2m13s node-controller Node multinode-293000-m03 event: Registered Node multinode-293000-m03 in Controller
Normal NodeNotReady 93s node-controller Node multinode-293000-m03 status is now: NodeNotReady
*
* ==> dmesg <==
* [ +0.027738] ACPI BIOS Warning (bug): Incorrect checksum in table [DSDT] - 0xBE, should be 0x1B (20200925/tbprint-173)
[ +4.638579] ACPI Error: Could not enable RealTimeClock event (20200925/evxfevnt-182)
[ +0.000002] ACPI Warning: Could not enable fixed event - RealTimeClock (4) (20200925/evxface-618)
[ +0.007331] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[ +2.155574] systemd-fstab-generator[125]: Ignoring "noauto" for root device
[ +0.037861] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[ +1.885655] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[ +0.000007] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery
[ +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)
[ +2.521390] systemd-fstab-generator[509]: Ignoring "noauto" for root device
[ +0.087334] systemd-fstab-generator[520]: Ignoring "noauto" for root device
[ +0.795077] systemd-fstab-generator[815]: Ignoring "noauto" for root device
[ +0.191674] systemd-fstab-generator[852]: Ignoring "noauto" for root device
[ +0.087609] systemd-fstab-generator[863]: Ignoring "noauto" for root device
[ +0.105488] systemd-fstab-generator[876]: Ignoring "noauto" for root device
[ +1.219140] kauditd_printk_skb: 30 callbacks suppressed
[ +0.149851] systemd-fstab-generator[1024]: Ignoring "noauto" for root device
[ +0.088619] systemd-fstab-generator[1035]: Ignoring "noauto" for root device
[ +0.080556] systemd-fstab-generator[1046]: Ignoring "noauto" for root device
[ +0.086094] systemd-fstab-generator[1057]: Ignoring "noauto" for root device
[ +11.612543] systemd-fstab-generator[1293]: Ignoring "noauto" for root device
[ +0.257064] kauditd_printk_skb: 29 callbacks suppressed
[Feb23 04:44] kauditd_printk_skb: 8 callbacks suppressed
[ +10.566361] kauditd_printk_skb: 16 callbacks suppressed
*
* ==> etcd [6c26fbc738c9] <==
* {"level":"info","ts":"2023-02-23T04:43:55.846Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}
{"level":"info","ts":"2023-02-23T04:43:55.846Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}
{"level":"info","ts":"2023-02-23T04:43:55.849Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"893b0beac40933c0 switched to configuration voters=(9888510509761246144)"}
{"level":"info","ts":"2023-02-23T04:43:55.849Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"51ecae2d8304f353","local-member-id":"893b0beac40933c0","added-peer-id":"893b0beac40933c0","added-peer-peer-urls":["https://192.168.64.12:2380"]}
{"level":"info","ts":"2023-02-23T04:43:55.850Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"51ecae2d8304f353","local-member-id":"893b0beac40933c0","cluster-version":"3.5"}
{"level":"info","ts":"2023-02-23T04:43:55.850Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2023-02-23T04:43:55.852Z","caller":"embed/etcd.go:687","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2023-02-23T04:43:55.852Z","caller":"embed/etcd.go:275","msg":"now serving peer/client/metrics","local-member-id":"893b0beac40933c0","initial-advertise-peer-urls":["https://192.168.64.12:2380"],"listen-peer-urls":["https://192.168.64.12:2380"],"advertise-client-urls":["https://192.168.64.12:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.64.12:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2023-02-23T04:43:55.852Z","caller":"embed/etcd.go:762","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2023-02-23T04:43:55.854Z","caller":"embed/etcd.go:586","msg":"serving peer traffic","address":"192.168.64.12:2380"}
{"level":"info","ts":"2023-02-23T04:43:55.855Z","caller":"embed/etcd.go:558","msg":"cmux::serve","address":"192.168.64.12:2380"}
{"level":"info","ts":"2023-02-23T04:43:56.929Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"893b0beac40933c0 is starting a new election at term 2"}
{"level":"info","ts":"2023-02-23T04:43:56.929Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"893b0beac40933c0 became pre-candidate at term 2"}
{"level":"info","ts":"2023-02-23T04:43:56.929Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"893b0beac40933c0 received MsgPreVoteResp from 893b0beac40933c0 at term 2"}
{"level":"info","ts":"2023-02-23T04:43:56.929Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"893b0beac40933c0 became candidate at term 3"}
{"level":"info","ts":"2023-02-23T04:43:56.930Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"893b0beac40933c0 received MsgVoteResp from 893b0beac40933c0 at term 3"}
{"level":"info","ts":"2023-02-23T04:43:56.930Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"893b0beac40933c0 became leader at term 3"}
{"level":"info","ts":"2023-02-23T04:43:56.930Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 893b0beac40933c0 elected leader 893b0beac40933c0 at term 3"}
{"level":"info","ts":"2023-02-23T04:43:56.936Z","caller":"etcdserver/server.go:2054","msg":"published local member to cluster through raft","local-member-id":"893b0beac40933c0","local-member-attributes":"{Name:multinode-293000 ClientURLs:[https://192.168.64.12:2379]}","request-path":"/0/members/893b0beac40933c0/attributes","cluster-id":"51ecae2d8304f353","publish-timeout":"7s"}
{"level":"info","ts":"2023-02-23T04:43:56.936Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
{"level":"info","ts":"2023-02-23T04:43:56.936Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
{"level":"info","ts":"2023-02-23T04:43:56.939Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
{"level":"info","ts":"2023-02-23T04:43:56.940Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2023-02-23T04:43:56.940Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2023-02-23T04:43:56.942Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.64.12:2379"}
*
* ==> etcd [84e0fe46ac29] <==
* {"level":"info","ts":"2023-02-23T04:40:21.179Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"51ecae2d8304f353","local-member-id":"893b0beac40933c0","added-peer-id":"893b0beac40933c0","added-peer-peer-urls":["https://192.168.64.12:2380"]}
{"level":"info","ts":"2023-02-23T04:40:21.565Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"893b0beac40933c0 is starting a new election at term 1"}
{"level":"info","ts":"2023-02-23T04:40:21.565Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"893b0beac40933c0 became pre-candidate at term 1"}
{"level":"info","ts":"2023-02-23T04:40:21.565Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"893b0beac40933c0 received MsgPreVoteResp from 893b0beac40933c0 at term 1"}
{"level":"info","ts":"2023-02-23T04:40:21.565Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"893b0beac40933c0 became candidate at term 2"}
{"level":"info","ts":"2023-02-23T04:40:21.565Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"893b0beac40933c0 received MsgVoteResp from 893b0beac40933c0 at term 2"}
{"level":"info","ts":"2023-02-23T04:40:21.565Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"893b0beac40933c0 became leader at term 2"}
{"level":"info","ts":"2023-02-23T04:40:21.565Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 893b0beac40933c0 elected leader 893b0beac40933c0 at term 2"}
{"level":"info","ts":"2023-02-23T04:40:21.568Z","caller":"etcdserver/server.go:2054","msg":"published local member to cluster through raft","local-member-id":"893b0beac40933c0","local-member-attributes":"{Name:multinode-293000 ClientURLs:[https://192.168.64.12:2379]}","request-path":"/0/members/893b0beac40933c0/attributes","cluster-id":"51ecae2d8304f353","publish-timeout":"7s"}
{"level":"info","ts":"2023-02-23T04:40:21.569Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
{"level":"info","ts":"2023-02-23T04:40:21.569Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
{"level":"info","ts":"2023-02-23T04:40:21.569Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.64.12:2379"}
{"level":"info","ts":"2023-02-23T04:40:21.569Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
{"level":"info","ts":"2023-02-23T04:40:21.570Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2023-02-23T04:40:21.575Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2023-02-23T04:40:21.570Z","caller":"etcdserver/server.go:2563","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2023-02-23T04:40:21.575Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"51ecae2d8304f353","local-member-id":"893b0beac40933c0","cluster-version":"3.5"}
{"level":"info","ts":"2023-02-23T04:40:21.576Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2023-02-23T04:40:21.576Z","caller":"etcdserver/server.go:2587","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2023-02-23T04:43:08.484Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}
{"level":"info","ts":"2023-02-23T04:43:08.484Z","caller":"embed/etcd.go:373","msg":"closing etcd server","name":"multinode-293000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.64.12:2380"],"advertise-client-urls":["https://192.168.64.12:2379"]}
{"level":"info","ts":"2023-02-23T04:43:08.505Z","caller":"etcdserver/server.go:1465","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"893b0beac40933c0","current-leader-member-id":"893b0beac40933c0"}
{"level":"info","ts":"2023-02-23T04:43:08.506Z","caller":"embed/etcd.go:568","msg":"stopping serving peer traffic","address":"192.168.64.12:2380"}
{"level":"info","ts":"2023-02-23T04:43:08.508Z","caller":"embed/etcd.go:573","msg":"stopped serving peer traffic","address":"192.168.64.12:2380"}
{"level":"info","ts":"2023-02-23T04:43:08.508Z","caller":"embed/etcd.go:375","msg":"closed etcd server","name":"multinode-293000","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.64.12:2380"],"advertise-client-urls":["https://192.168.64.12:2379"]}
*
* ==> kernel <==
* 04:46:24 up 2 min, 0 users, load average: 0.34, 0.17, 0.06
Linux multinode-293000 5.10.57 #1 SMP Thu Feb 16 22:09:52 UTC 2023 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2021.02.12"
*
* ==> kindnet [0c8255290780] <==
* I0223 04:42:36.101450 1 main.go:223] Handling node with IPs: map[192.168.64.12:{}]
I0223 04:42:36.101486 1 main.go:227] handling current node
I0223 04:42:36.101495 1 main.go:223] Handling node with IPs: map[192.168.64.13:{}]
I0223 04:42:36.101500 1 main.go:250] Node multinode-293000-m02 has CIDR [10.244.1.0/24]
I0223 04:42:36.101788 1 main.go:223] Handling node with IPs: map[192.168.64.14:{}]
I0223 04:42:36.101849 1 main.go:250] Node multinode-293000-m03 has CIDR [10.244.2.0/24]
I0223 04:42:46.107061 1 main.go:223] Handling node with IPs: map[192.168.64.12:{}]
I0223 04:42:46.107097 1 main.go:227] handling current node
I0223 04:42:46.107105 1 main.go:223] Handling node with IPs: map[192.168.64.13:{}]
I0223 04:42:46.107110 1 main.go:250] Node multinode-293000-m02 has CIDR [10.244.1.0/24]
I0223 04:42:46.107177 1 main.go:223] Handling node with IPs: map[192.168.64.14:{}]
I0223 04:42:46.107201 1 main.go:250] Node multinode-293000-m03 has CIDR [10.244.2.0/24]
I0223 04:42:56.110095 1 main.go:223] Handling node with IPs: map[192.168.64.12:{}]
I0223 04:42:56.110127 1 main.go:227] handling current node
I0223 04:42:56.110134 1 main.go:223] Handling node with IPs: map[192.168.64.13:{}]
I0223 04:42:56.110139 1 main.go:250] Node multinode-293000-m02 has CIDR [10.244.1.0/24]
I0223 04:42:56.110578 1 main.go:223] Handling node with IPs: map[192.168.64.14:{}]
I0223 04:42:56.110607 1 main.go:250] Node multinode-293000-m03 has CIDR [10.244.2.0/24]
I0223 04:43:06.122388 1 main.go:223] Handling node with IPs: map[192.168.64.12:{}]
I0223 04:43:06.122626 1 main.go:227] handling current node
I0223 04:43:06.122768 1 main.go:223] Handling node with IPs: map[192.168.64.13:{}]
I0223 04:43:06.122818 1 main.go:250] Node multinode-293000-m02 has CIDR [10.244.1.0/24]
I0223 04:43:06.122958 1 main.go:223] Handling node with IPs: map[192.168.64.14:{}]
I0223 04:43:06.123018 1 main.go:250] Node multinode-293000-m03 has CIDR [10.244.3.0/24]
I0223 04:43:06.123212 1 routes.go:62] Adding route {Ifindex: 0 Dst: 10.244.3.0/24 Src: <nil> Gw: 192.168.64.14 Flags: [] Table: 0}
*
* ==> kindnet [45c94319d8e4] <==
* I0223 04:45:43.620144 1 main.go:250] Node multinode-293000-m03 has CIDR [10.244.3.0/24]
I0223 04:45:53.632393 1 main.go:223] Handling node with IPs: map[192.168.64.12:{}]
I0223 04:45:53.632427 1 main.go:227] handling current node
I0223 04:45:53.632434 1 main.go:223] Handling node with IPs: map[192.168.64.13:{}]
I0223 04:45:53.632447 1 main.go:250] Node multinode-293000-m02 has CIDR [10.244.1.0/24]
I0223 04:45:53.632636 1 main.go:223] Handling node with IPs: map[192.168.64.14:{}]
I0223 04:45:53.632666 1 main.go:250] Node multinode-293000-m03 has CIDR [10.244.3.0/24]
I0223 04:46:03.644795 1 main.go:223] Handling node with IPs: map[192.168.64.12:{}]
I0223 04:46:03.644828 1 main.go:227] handling current node
I0223 04:46:03.644835 1 main.go:223] Handling node with IPs: map[192.168.64.13:{}]
I0223 04:46:03.644840 1 main.go:250] Node multinode-293000-m02 has CIDR [10.244.1.0/24]
I0223 04:46:03.645048 1 main.go:223] Handling node with IPs: map[192.168.64.14:{}]
I0223 04:46:03.645195 1 main.go:250] Node multinode-293000-m03 has CIDR [10.244.3.0/24]
I0223 04:46:13.651650 1 main.go:223] Handling node with IPs: map[192.168.64.12:{}]
I0223 04:46:13.651787 1 main.go:227] handling current node
I0223 04:46:13.651840 1 main.go:223] Handling node with IPs: map[192.168.64.13:{}]
I0223 04:46:13.651918 1 main.go:250] Node multinode-293000-m02 has CIDR [10.244.1.0/24]
I0223 04:46:13.652056 1 main.go:223] Handling node with IPs: map[192.168.64.14:{}]
I0223 04:46:13.652137 1 main.go:250] Node multinode-293000-m03 has CIDR [10.244.3.0/24]
I0223 04:46:23.664077 1 main.go:223] Handling node with IPs: map[192.168.64.12:{}]
I0223 04:46:23.664091 1 main.go:227] handling current node
I0223 04:46:23.664098 1 main.go:223] Handling node with IPs: map[192.168.64.13:{}]
I0223 04:46:23.664102 1 main.go:250] Node multinode-293000-m02 has CIDR [10.244.1.0/24]
I0223 04:46:23.664197 1 main.go:223] Handling node with IPs: map[192.168.64.14:{}]
I0223 04:46:23.664205 1 main.go:250] Node multinode-293000-m03 has CIDR [10.244.3.0/24]
*
* ==> kube-apiserver [141cda940cdc] <==
* W0223 04:43:08.494500 1 logging.go:59] [core] [Channel #127 SubChannel #128] grpc: addrConn.createTransport failed to connect to {
"Addr": "127.0.0.1:2379",
"ServerName": "127.0.0.1",
"Attributes": null,
"BalancerAttributes": null,
"Type": 0,
"Metadata": null
}. Err: connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused"
W0223 04:43:08.494440 1 logging.go:59] [core] [Channel #124 SubChannel #125] grpc: addrConn.createTransport failed to connect to {
"Addr": "127.0.0.1:2379",
"ServerName": "127.0.0.1",
"Attributes": null,
"BalancerAttributes": null,
"Type": 0,
"Metadata": null
}. Err: connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused"
W0223 04:43:08.494539 1 logging.go:59] [core] [Channel #175 SubChannel #176] grpc: addrConn.createTransport failed to connect to {
"Addr": "127.0.0.1:2379",
"ServerName": "127.0.0.1",
"Attributes": null,
"BalancerAttributes": null,
"Type": 0,
"Metadata": null
}. Err: connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused"
I0223 04:43:08.500780 1 controller.go:211] Shutting down kubernetes service endpoint reconciler
*
* ==> kube-apiserver [32b4e9141edb] <==
* I0223 04:43:58.550006 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
I0223 04:43:58.550056 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0223 04:43:58.550207 1 crd_finalizer.go:266] Starting CRDFinalizer
I0223 04:43:58.550256 1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0223 04:43:58.550261 1 shared_informer.go:273] Waiting for caches to sync for crd-autoregister
I0223 04:43:58.676061 1 controller.go:615] quota admission added evaluator for: leases.coordination.k8s.io
E0223 04:43:58.692478 1 controller.go:159] Error removing old endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
I0223 04:43:58.735629 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0223 04:43:58.735677 1 cache.go:39] Caches are synced for AvailableConditionController controller
I0223 04:43:58.736838 1 cache.go:39] Caches are synced for autoregister controller
I0223 04:43:58.735691 1 shared_informer.go:280] Caches are synced for configmaps
I0223 04:43:58.737129 1 apf_controller.go:366] Running API Priority and Fairness config worker
I0223 04:43:58.737163 1 apf_controller.go:369] Running API Priority and Fairness periodic rebalancing process
I0223 04:43:58.737266 1 shared_informer.go:280] Caches are synced for cluster_authentication_trust_controller
I0223 04:43:58.751229 1 shared_informer.go:280] Caches are synced for crd-autoregister
I0223 04:43:58.756729 1 shared_informer.go:280] Caches are synced for node_authorizer
I0223 04:43:59.349969 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0223 04:43:59.544520 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
I0223 04:44:01.169288 1 controller.go:615] quota admission added evaluator for: daemonsets.apps
I0223 04:44:01.264444 1 controller.go:615] quota admission added evaluator for: serviceaccounts
I0223 04:44:01.270798 1 controller.go:615] quota admission added evaluator for: deployments.apps
I0223 04:44:01.306334 1 controller.go:615] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0223 04:44:01.310335 1 controller.go:615] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0223 04:44:11.421170 1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io
I0223 04:44:11.469025 1 controller.go:615] quota admission added evaluator for: endpoints
*
* ==> kube-controller-manager [17e72c6f43c2] <==
* I0223 04:44:11.170251 1 shared_informer.go:280] Caches are synced for job
I0223 04:44:11.250951 1 shared_informer.go:280] Caches are synced for ClusterRoleAggregator
I0223 04:44:11.274547 1 shared_informer.go:280] Caches are synced for resource quota
I0223 04:44:11.295057 1 shared_informer.go:280] Caches are synced for resource quota
I0223 04:44:11.339742 1 shared_informer.go:280] Caches are synced for disruption
I0223 04:44:11.352299 1 shared_informer.go:280] Caches are synced for ReplicationController
I0223 04:44:11.709058 1 shared_informer.go:280] Caches are synced for garbage collector
I0223 04:44:11.733481 1 shared_informer.go:280] Caches are synced for garbage collector
I0223 04:44:11.733550 1 garbagecollector.go:163] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0223 04:44:51.153946 1 event.go:294] "Event occurred" object="multinode-293000-m02" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="NodeNotReady" message="Node multinode-293000-m02 status is now: NodeNotReady"
W0223 04:44:51.154488 1 topologycache.go:232] Can't get CPU or zone information for multinode-293000-m03 node
I0223 04:44:51.158085 1 event.go:294] "Event occurred" object="default/busybox-6b86dd6d48-pz4cz" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0223 04:44:51.168125 1 event.go:294] "Event occurred" object="kube-system/kindnet-bzxtr" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0223 04:44:51.175123 1 event.go:294] "Event occurred" object="kube-system/kube-proxy-qmsbf" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0223 04:44:51.180146 1 event.go:294] "Event occurred" object="multinode-293000-m03" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="NodeNotReady" message="Node multinode-293000-m03 status is now: NodeNotReady"
I0223 04:44:51.192277 1 event.go:294] "Event occurred" object="kube-system/kindnet-rrx46" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0223 04:44:51.203653 1 event.go:294] "Event occurred" object="kube-system/kube-proxy-bj985" fieldPath="" kind="Pod" apiVersion="v1" type="Warning" reason="NodeNotReady" message="Node is not ready"
I0223 04:44:57.630607 1 event.go:294] "Event occurred" object="default/busybox-6b86dd6d48" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: busybox-6b86dd6d48-mktgv"
I0223 04:45:01.204204 1 event.go:294] "Event occurred" object="multinode-293000-m02" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RemovingNode" message="Node multinode-293000-m02 event: Removing Node multinode-293000-m02 from Controller"
W0223 04:45:01.452798 1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="multinode-293000-m02" does not exist
I0223 04:45:01.453663 1 event.go:294] "Event occurred" object="default/busybox-6b86dd6d48-pz4cz" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod default/busybox-6b86dd6d48-pz4cz"
I0223 04:45:01.460177 1 range_allocator.go:372] Set node multinode-293000-m02 PodCIDR to [10.244.1.0/24]
I0223 04:45:06.205816 1 event.go:294] "Event occurred" object="multinode-293000-m02" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node multinode-293000-m02 event: Registered Node multinode-293000-m02 in Controller"
W0223 04:45:07.014453 1 topologycache.go:232] Can't get CPU or zone information for multinode-293000-m02 node
I0223 04:45:11.211639 1 event.go:294] "Event occurred" object="default/busybox-6b86dd6d48-pz4cz" fieldPath="" kind="Pod" apiVersion="" type="Normal" reason="TaintManagerEviction" message="Cancelling deletion of Pod default/busybox-6b86dd6d48-pz4cz"
*
* ==> kube-controller-manager [dba4607b22f4] <==
* I0223 04:40:39.882346 1 shared_informer.go:280] Caches are synced for garbage collector
I0223 04:40:49.305831 1 node_lifecycle_controller.go:1231] Controller detected that some Nodes are Ready. Exiting master disruption mode.
W0223 04:41:26.342453 1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="multinode-293000-m02" does not exist
I0223 04:41:26.359563 1 range_allocator.go:372] Set node multinode-293000-m02 PodCIDR to [10.244.1.0/24]
I0223 04:41:26.362437 1 event.go:294] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-qmsbf"
I0223 04:41:26.365271 1 event.go:294] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-bzxtr"
W0223 04:41:29.318888 1 node_lifecycle_controller.go:1053] Missing timestamp for Node multinode-293000-m02. Assuming now as a timestamp.
I0223 04:41:29.319072 1 event.go:294] "Event occurred" object="multinode-293000-m02" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node multinode-293000-m02 event: Registered Node multinode-293000-m02 in Controller"
W0223 04:41:42.491661 1 topologycache.go:232] Can't get CPU or zone information for multinode-293000-m02 node
I0223 04:41:44.642236 1 event.go:294] "Event occurred" object="default/busybox" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set busybox-6b86dd6d48 to 2"
I0223 04:41:44.685136 1 event.go:294] "Event occurred" object="default/busybox-6b86dd6d48" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: busybox-6b86dd6d48-pz4cz"
I0223 04:41:44.692701 1 event.go:294] "Event occurred" object="default/busybox-6b86dd6d48" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: busybox-6b86dd6d48-5nxg2"
W0223 04:42:15.040586 1 topologycache.go:232] Can't get CPU or zone information for multinode-293000-m02 node
W0223 04:42:15.040613 1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="multinode-293000-m03" does not exist
I0223 04:42:15.055330 1 range_allocator.go:372] Set node multinode-293000-m03 PodCIDR to [10.244.2.0/24]
I0223 04:42:15.057598 1 event.go:294] "Event occurred" object="kube-system/kindnet" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kindnet-rrx46"
I0223 04:42:15.057630 1 event.go:294] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-bj985"
W0223 04:42:19.332867 1 node_lifecycle_controller.go:1053] Missing timestamp for Node multinode-293000-m03. Assuming now as a timestamp.
I0223 04:42:19.333174 1 event.go:294] "Event occurred" object="multinode-293000-m03" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node multinode-293000-m03 event: Registered Node multinode-293000-m03 in Controller"
W0223 04:42:28.522221 1 topologycache.go:232] Can't get CPU or zone information for multinode-293000-m02 node
W0223 04:42:56.193208 1 topologycache.go:232] Can't get CPU or zone information for multinode-293000-m02 node
W0223 04:42:56.992626 1 topologycache.go:232] Can't get CPU or zone information for multinode-293000-m02 node
W0223 04:42:56.993153 1 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="multinode-293000-m03" does not exist
I0223 04:42:57.001248 1 range_allocator.go:372] Set node multinode-293000-m03 PodCIDR to [10.244.3.0/24]
W0223 04:43:05.521074 1 topologycache.go:232] Can't get CPU or zone information for multinode-293000-m02 node
*
* ==> kube-proxy [1684370ceee7] <==
* I0223 04:40:40.572836 1 node.go:163] Successfully retrieved node IP: 192.168.64.12
I0223 04:40:40.572923 1 server_others.go:109] "Detected node IP" address="192.168.64.12"
I0223 04:40:40.572934 1 server_others.go:535] "Using iptables proxy"
I0223 04:40:40.602129 1 server_others.go:170] "kube-proxy running in single-stack mode, this ipFamily is not supported" ipFamily=IPv6
I0223 04:40:40.602194 1 server_others.go:176] "Using iptables Proxier"
I0223 04:40:40.602319 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0223 04:40:40.602682 1 server.go:655] "Version info" version="v1.26.1"
I0223 04:40:40.602795 1 server.go:657] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0223 04:40:40.603339 1 config.go:317] "Starting service config controller"
I0223 04:40:40.603403 1 shared_informer.go:273] Waiting for caches to sync for service config
I0223 04:40:40.603456 1 config.go:226] "Starting endpoint slice config controller"
I0223 04:40:40.603542 1 shared_informer.go:273] Waiting for caches to sync for endpoint slice config
I0223 04:40:40.603984 1 config.go:444] "Starting node config controller"
I0223 04:40:40.604090 1 shared_informer.go:273] Waiting for caches to sync for node config
I0223 04:40:40.704084 1 shared_informer.go:280] Caches are synced for endpoint slice config
I0223 04:40:40.704109 1 shared_informer.go:280] Caches are synced for service config
I0223 04:40:40.704321 1 shared_informer.go:280] Caches are synced for node config
*
* ==> kube-proxy [e716cfa05a89] <==
* I0223 04:44:00.783640 1 node.go:163] Successfully retrieved node IP: 192.168.64.12
I0223 04:44:00.783759 1 server_others.go:109] "Detected node IP" address="192.168.64.12"
I0223 04:44:00.783822 1 server_others.go:535] "Using iptables proxy"
I0223 04:44:00.887569 1 server_others.go:170] "kube-proxy running in single-stack mode, this ipFamily is not supported" ipFamily=IPv6
I0223 04:44:00.887622 1 server_others.go:176] "Using iptables Proxier"
I0223 04:44:00.888273 1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
I0223 04:44:00.888652 1 server.go:655] "Version info" version="v1.26.1"
I0223 04:44:00.888680 1 server.go:657] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0223 04:44:00.891202 1 config.go:317] "Starting service config controller"
I0223 04:44:00.891650 1 shared_informer.go:273] Waiting for caches to sync for service config
I0223 04:44:00.891686 1 config.go:226] "Starting endpoint slice config controller"
I0223 04:44:00.891691 1 shared_informer.go:273] Waiting for caches to sync for endpoint slice config
I0223 04:44:00.892653 1 config.go:444] "Starting node config controller"
I0223 04:44:00.893682 1 shared_informer.go:273] Waiting for caches to sync for node config
I0223 04:44:00.992340 1 shared_informer.go:280] Caches are synced for endpoint slice config
I0223 04:44:00.992390 1 shared_informer.go:280] Caches are synced for service config
I0223 04:44:00.994022 1 shared_informer.go:280] Caches are synced for node config
*
* ==> kube-scheduler [1b4f70dbb74e] <==
* I0223 04:43:56.654338 1 serving.go:348] Generated self-signed cert in-memory
W0223 04:43:58.594216 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W0223 04:43:58.594253 1 authentication.go:349] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W0223 04:43:58.594262 1 authentication.go:350] Continuing without authentication configuration. This may treat all requests as anonymous.
W0223 04:43:58.594267 1 authentication.go:351] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I0223 04:43:58.660263 1 server.go:152] "Starting Kubernetes Scheduler" version="v1.26.1"
I0223 04:43:58.660458 1 server.go:154] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0223 04:43:58.665440 1 secure_serving.go:210] Serving securely on 127.0.0.1:10259
I0223 04:43:58.668635 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0223 04:43:58.668671 1 shared_informer.go:273] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0223 04:43:58.668857 1 tlsconfig.go:240] "Starting DynamicServingCertificateController"
I0223 04:43:58.769226 1 shared_informer.go:280] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
*
* ==> kube-scheduler [dedc068e64af] <==
* W0223 04:40:23.097754 1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0223 04:40:23.097802 1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
W0223 04:40:23.097900 1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0223 04:40:23.097980 1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
W0223 04:40:23.098122 1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0223 04:40:23.098207 1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
W0223 04:40:23.098252 1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0223 04:40:23.098330 1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0223 04:40:23.098354 1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0223 04:40:23.098368 1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
W0223 04:40:23.925737 1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0223 04:40:23.925791 1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W0223 04:40:23.994441 1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0223 04:40:23.994609 1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
W0223 04:40:24.069943 1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0223 04:40:24.070644 1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
W0223 04:40:24.076157 1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0223 04:40:24.076478 1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
W0223 04:40:24.179212 1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0223 04:40:24.179426 1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
I0223 04:40:24.584208 1 shared_informer.go:280] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0223 04:43:08.562455 1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"
I0223 04:43:08.562577 1 secure_serving.go:255] Stopped listening on 127.0.0.1:10259
E0223 04:43:08.562787 1 scheduling_queue.go:1065] "Error while retrieving next pod from scheduling queue" err="scheduling queue is closed"
E0223 04:43:08.562809 1 run.go:74] "command failed" err="finished without leader elect"
*
* ==> kubelet <==
* -- Journal begins at Thu 2023-02-23 04:43:34 UTC, ends at Thu 2023-02-23 04:46:25 UTC. --
Feb 23 04:44:00 multinode-293000 kubelet[1299]: E0223 04:44:00.798312 1299 pod_workers.go:965] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized" pod="kube-system/coredns-787d4945fb-b28zh" podUID=307635d3-a26b-4eff-be8a-9d65e1f996c3
Feb 23 04:44:01 multinode-293000 kubelet[1299]: E0223 04:44:01.080497 1299 projected.go:292] Couldn't get configMap default/kube-root-ca.crt: object "default"/"kube-root-ca.crt" not registered
Feb 23 04:44:01 multinode-293000 kubelet[1299]: E0223 04:44:01.080518 1299 projected.go:198] Error preparing data for projected volume kube-api-access-c998x for pod default/busybox-6b86dd6d48-5nxg2: object "default"/"kube-root-ca.crt" not registered
Feb 23 04:44:01 multinode-293000 kubelet[1299]: E0223 04:44:01.080551 1299 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dc9b647-ec81-44b3-aaec-b38ed85ceb4e-kube-api-access-c998x podName:7dc9b647-ec81-44b3-aaec-b38ed85ceb4e nodeName:}" failed. No retries permitted until 2023-02-23 04:44:03.080541647 +0000 UTC m=+9.534139228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c998x" (UniqueName: "kubernetes.io/projected/7dc9b647-ec81-44b3-aaec-b38ed85ceb4e-kube-api-access-c998x") pod "busybox-6b86dd6d48-5nxg2" (UID: "7dc9b647-ec81-44b3-aaec-b38ed85ceb4e") : object "default"/"kube-root-ca.crt" not registered
Feb 23 04:44:02 multinode-293000 kubelet[1299]: E0223 04:44:02.392810 1299 configmap.go:199] Couldn't get configMap kube-system/coredns: object "kube-system"/"coredns" not registered
Feb 23 04:44:02 multinode-293000 kubelet[1299]: E0223 04:44:02.392894 1299 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/307635d3-a26b-4eff-be8a-9d65e1f996c3-config-volume podName:307635d3-a26b-4eff-be8a-9d65e1f996c3 nodeName:}" failed. No retries permitted until 2023-02-23 04:44:06.392876883 +0000 UTC m=+12.846474484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-volume" (UniqueName: "kubernetes.io/configmap/307635d3-a26b-4eff-be8a-9d65e1f996c3-config-volume") pod "coredns-787d4945fb-b28zh" (UID: "307635d3-a26b-4eff-be8a-9d65e1f996c3") : object "kube-system"/"coredns" not registered
Feb 23 04:44:02 multinode-293000 kubelet[1299]: I0223 04:44:02.943608 1299 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="441d02843542dc40c715e7d1ab5503f4191f022b4deafd3b4667ec0a04333510"
Feb 23 04:44:03 multinode-293000 kubelet[1299]: E0223 04:44:03.097817 1299 projected.go:292] Couldn't get configMap default/kube-root-ca.crt: object "default"/"kube-root-ca.crt" not registered
Feb 23 04:44:03 multinode-293000 kubelet[1299]: E0223 04:44:03.097865 1299 projected.go:198] Error preparing data for projected volume kube-api-access-c998x for pod default/busybox-6b86dd6d48-5nxg2: object "default"/"kube-root-ca.crt" not registered
Feb 23 04:44:03 multinode-293000 kubelet[1299]: E0223 04:44:03.097903 1299 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dc9b647-ec81-44b3-aaec-b38ed85ceb4e-kube-api-access-c998x podName:7dc9b647-ec81-44b3-aaec-b38ed85ceb4e nodeName:}" failed. No retries permitted until 2023-02-23 04:44:07.097891225 +0000 UTC m=+13.551488811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c998x" (UniqueName: "kubernetes.io/projected/7dc9b647-ec81-44b3-aaec-b38ed85ceb4e-kube-api-access-c998x") pod "busybox-6b86dd6d48-5nxg2" (UID: "7dc9b647-ec81-44b3-aaec-b38ed85ceb4e") : object "default"/"kube-root-ca.crt" not registered
Feb 23 04:44:03 multinode-293000 kubelet[1299]: E0223 04:44:03.999597 1299 pod_workers.go:965] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized" pod="kube-system/coredns-787d4945fb-b28zh" podUID=307635d3-a26b-4eff-be8a-9d65e1f996c3
Feb 23 04:44:03 multinode-293000 kubelet[1299]: E0223 04:44:03.999734 1299 pod_workers.go:965] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized" pod="default/busybox-6b86dd6d48-5nxg2" podUID=7dc9b647-ec81-44b3-aaec-b38ed85ceb4e
Feb 23 04:44:05 multinode-293000 kubelet[1299]: E0223 04:44:05.799336 1299 pod_workers.go:965] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized" pod="default/busybox-6b86dd6d48-5nxg2" podUID=7dc9b647-ec81-44b3-aaec-b38ed85ceb4e
Feb 23 04:44:05 multinode-293000 kubelet[1299]: E0223 04:44:05.799422 1299 pod_workers.go:965] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized" pod="kube-system/coredns-787d4945fb-b28zh" podUID=307635d3-a26b-4eff-be8a-9d65e1f996c3
Feb 23 04:44:06 multinode-293000 kubelet[1299]: E0223 04:44:06.425400 1299 configmap.go:199] Couldn't get configMap kube-system/coredns: object "kube-system"/"coredns" not registered
Feb 23 04:44:06 multinode-293000 kubelet[1299]: E0223 04:44:06.425530 1299 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/307635d3-a26b-4eff-be8a-9d65e1f996c3-config-volume podName:307635d3-a26b-4eff-be8a-9d65e1f996c3 nodeName:}" failed. No retries permitted until 2023-02-23 04:44:14.425511708 +0000 UTC m=+20.879109304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-volume" (UniqueName: "kubernetes.io/configmap/307635d3-a26b-4eff-be8a-9d65e1f996c3-config-volume") pod "coredns-787d4945fb-b28zh" (UID: "307635d3-a26b-4eff-be8a-9d65e1f996c3") : object "kube-system"/"coredns" not registered
Feb 23 04:44:07 multinode-293000 kubelet[1299]: I0223 04:44:07.034375 1299 kubelet_node_status.go:493] "Fast updating node status as it just became ready"
Feb 23 04:44:07 multinode-293000 kubelet[1299]: E0223 04:44:07.129859 1299 projected.go:292] Couldn't get configMap default/kube-root-ca.crt: object "default"/"kube-root-ca.crt" not registered
Feb 23 04:44:07 multinode-293000 kubelet[1299]: E0223 04:44:07.129898 1299 projected.go:198] Error preparing data for projected volume kube-api-access-c998x for pod default/busybox-6b86dd6d48-5nxg2: object "default"/"kube-root-ca.crt" not registered
Feb 23 04:44:07 multinode-293000 kubelet[1299]: E0223 04:44:07.130001 1299 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dc9b647-ec81-44b3-aaec-b38ed85ceb4e-kube-api-access-c998x podName:7dc9b647-ec81-44b3-aaec-b38ed85ceb4e nodeName:}" failed. No retries permitted until 2023-02-23 04:44:15.129977501 +0000 UTC m=+21.583575098 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c998x" (UniqueName: "kubernetes.io/projected/7dc9b647-ec81-44b3-aaec-b38ed85ceb4e-kube-api-access-c998x") pod "busybox-6b86dd6d48-5nxg2" (UID: "7dc9b647-ec81-44b3-aaec-b38ed85ceb4e") : object "default"/"kube-root-ca.crt" not registered
Feb 23 04:44:15 multinode-293000 kubelet[1299]: I0223 04:44:15.201272 1299 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="559689c8c5b05b41b7c84259b34e0100733f82a2a31f37bfba099e59816ff4ed"
Feb 23 04:44:31 multinode-293000 kubelet[1299]: I0223 04:44:31.363644 1299 scope.go:115] "RemoveContainer" containerID="6dd7f81ec2fa4581eb521d4384be86c6cdd48152d879c51e439bc0e35d6efc5e"
Feb 23 04:44:31 multinode-293000 kubelet[1299]: I0223 04:44:31.363851 1299 scope.go:115] "RemoveContainer" containerID="b5ea45d0fc008fc8260a91fa0b682b52c3a04559adc7fd67ea85aeb7c875cee8"
Feb 23 04:44:31 multinode-293000 kubelet[1299]: E0223 04:44:31.363956 1299 pod_workers.go:965] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-provisioner\" with CrashLoopBackOff: \"back-off 10s restarting failed container=storage-provisioner pod=storage-provisioner_kube-system(2e7410db-637a-4d25-9f92-f5e551a32c8d)\"" pod="kube-system/storage-provisioner" podUID=2e7410db-637a-4d25-9f92-f5e551a32c8d
Feb 23 04:44:46 multinode-293000 kubelet[1299]: I0223 04:44:46.798490 1299 scope.go:115] "RemoveContainer" containerID="b5ea45d0fc008fc8260a91fa0b682b52c3a04559adc7fd67ea85aeb7c875cee8"
*
* ==> storage-provisioner [9a6cc4df5b9b] <==
* I0223 04:44:46.891912 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0223 04:44:46.899988 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0223 04:44:46.900433 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0223 04:45:04.299515 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0223 04:45:04.300102 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_multinode-293000_5e406335-782a-43bb-b506-9eae9caa288a!
I0223 04:45:04.299999 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"d3383cb2-817f-46da-a643-82ef7e1e54aa", APIVersion:"v1", ResourceVersion:"925", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' multinode-293000_5e406335-782a-43bb-b506-9eae9caa288a became leader
I0223 04:45:04.401698 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_multinode-293000_5e406335-782a-43bb-b506-9eae9caa288a!
*
* ==> storage-provisioner [b5ea45d0fc00] <==
* I0223 04:44:00.859207 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
F0223 04:44:30.867142 1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-darwin-amd64 status --format={{.APIServer}} -p multinode-293000 -n multinode-293000
helpers_test.go:261: (dbg) Run: kubectl --context multinode-293000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestMultiNode/serial/RestartKeepsNodes FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiNode/serial/RestartKeepsNodes (198.55s)