=== RUN TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:86: (dbg) Run: out/minikube-darwin-amd64 start -p multinode-449000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit
multinode_test.go:86: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-449000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit : exit status 90 (14.925390987s)
-- stdout --
* [multinode-449000] minikube v1.32.0 on Darwin 14.2
- MINIKUBE_LOCATION=17777
- KUBECONFIG=/Users/jenkins/minikube-integration/17777-1259/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/17777-1259/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the hyperkit driver based on user configuration
* Starting control plane node multinode-449000 in cluster multinode-449000
* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
-- /stdout --
** stderr **
I1212 15:10:21.470862 3520 out.go:296] Setting OutFile to fd 1 ...
I1212 15:10:21.471091 3520 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1212 15:10:21.471096 3520 out.go:309] Setting ErrFile to fd 2...
I1212 15:10:21.471100 3520 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1212 15:10:21.471271 3520 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17777-1259/.minikube/bin
I1212 15:10:21.472701 3520 out.go:303] Setting JSON to false
I1212 15:10:21.494932 3520 start.go:128] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":2392,"bootTime":1702420229,"procs":436,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.2","kernelVersion":"23.2.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
W1212 15:10:21.495046 3520 start.go:136] gopshost.Virtualization returned error: not implemented yet
I1212 15:10:21.517392 3520 out.go:177] * [multinode-449000] minikube v1.32.0 on Darwin 14.2
I1212 15:10:21.560123 3520 out.go:177] - MINIKUBE_LOCATION=17777
I1212 15:10:21.560302 3520 notify.go:220] Checking for updates...
I1212 15:10:21.602849 3520 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/17777-1259/kubeconfig
I1212 15:10:21.624063 3520 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I1212 15:10:21.644956 3520 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1212 15:10:21.665952 3520 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17777-1259/.minikube
I1212 15:10:21.688947 3520 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1212 15:10:21.710566 3520 driver.go:392] Setting default libvirt URI to qemu:///system
I1212 15:10:21.741008 3520 out.go:177] * Using the hyperkit driver based on user configuration
I1212 15:10:21.783147 3520 start.go:298] selected driver: hyperkit
I1212 15:10:21.783174 3520 start.go:902] validating driver "hyperkit" against <nil>
I1212 15:10:21.783197 3520 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1212 15:10:21.787528 3520 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1212 15:10:21.787623 3520 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17777-1259/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
I1212 15:10:21.795421 3520 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
I1212 15:10:21.799229 3520 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1212 15:10:21.799252 3520 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
I1212 15:10:21.799282 3520 start_flags.go:309] no existing cluster config was found, will generate one from the flags
I1212 15:10:21.799494 3520 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1212 15:10:21.799562 3520 cni.go:84] Creating CNI manager for ""
I1212 15:10:21.799570 3520 cni.go:136] 0 nodes found, recommending kindnet
I1212 15:10:21.799577 3520 start_flags.go:318] Found "CNI" CNI - setting NetworkPlugin=cni
I1212 15:10:21.799589 3520 start_flags.go:323] config:
{Name:multinode-449000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1702334074-17764@sha256:242468f3f874ac6982f8a024f9c4a97f957667e2ee92ef27b2ae70cc267db401 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-449000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:
docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
I1212 15:10:21.799729 3520 iso.go:125] acquiring lock: {Name:mk96a55b7848c6dd3321ed62339797ab51ac6b5a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1212 15:10:21.842121 3520 out.go:177] * Starting control plane node multinode-449000 in cluster multinode-449000
I1212 15:10:21.863225 3520 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
I1212 15:10:21.863296 3520 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17777-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
I1212 15:10:21.863329 3520 cache.go:56] Caching tarball of preloaded images
I1212 15:10:21.863543 3520 preload.go:174] Found /Users/jenkins/minikube-integration/17777-1259/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I1212 15:10:21.863562 3520 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
I1212 15:10:21.864073 3520 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17777-1259/.minikube/profiles/multinode-449000/config.json ...
I1212 15:10:21.864111 3520 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17777-1259/.minikube/profiles/multinode-449000/config.json: {Name:mkc2472e7d5f2805774069becb49f4ae7180bc73 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1212 15:10:21.864879 3520 start.go:365] acquiring machines lock for multinode-449000: {Name:mk51496c390b032727acf9b9a5f67e389f19ec26 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1212 15:10:21.865012 3520 start.go:369] acquired machines lock for "multinode-449000" in 111.579µs
I1212 15:10:21.865058 3520 start.go:93] Provisioning new machine with config: &{Name:multinode-449000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17738/minikube-v1.32.1-1701996673-17738-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1702334074-17764@sha256:242468f3f874ac6982f8a024f9c4a97f957667e2ee92ef27b2ae70cc267db401 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernete
sConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-449000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144
MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
I1212 15:10:21.865140 3520 start.go:125] createHost starting for "" (driver="hyperkit")
I1212 15:10:21.906971 3520 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I1212 15:10:21.907368 3520 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1212 15:10:21.907445 3520 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1212 15:10:21.916498 3520 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51139
I1212 15:10:21.916865 3520 main.go:141] libmachine: () Calling .GetVersion
I1212 15:10:21.917284 3520 main.go:141] libmachine: Using API Version 1
I1212 15:10:21.917294 3520 main.go:141] libmachine: () Calling .SetConfigRaw
I1212 15:10:21.917536 3520 main.go:141] libmachine: () Calling .GetMachineName
I1212 15:10:21.917637 3520 main.go:141] libmachine: (multinode-449000) Calling .GetMachineName
I1212 15:10:21.917727 3520 main.go:141] libmachine: (multinode-449000) Calling .DriverName
I1212 15:10:21.917831 3520 start.go:159] libmachine.API.Create for "multinode-449000" (driver="hyperkit")
I1212 15:10:21.917854 3520 client.go:168] LocalClient.Create starting
I1212 15:10:21.917887 3520 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17777-1259/.minikube/certs/ca.pem
I1212 15:10:21.917936 3520 main.go:141] libmachine: Decoding PEM data...
I1212 15:10:21.917962 3520 main.go:141] libmachine: Parsing certificate...
I1212 15:10:21.918030 3520 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17777-1259/.minikube/certs/cert.pem
I1212 15:10:21.918066 3520 main.go:141] libmachine: Decoding PEM data...
I1212 15:10:21.918078 3520 main.go:141] libmachine: Parsing certificate...
I1212 15:10:21.918091 3520 main.go:141] libmachine: Running pre-create checks...
I1212 15:10:21.918102 3520 main.go:141] libmachine: (multinode-449000) Calling .PreCreateCheck
I1212 15:10:21.918184 3520 main.go:141] libmachine: (multinode-449000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1212 15:10:21.918350 3520 main.go:141] libmachine: (multinode-449000) Calling .GetConfigRaw
I1212 15:10:21.918769 3520 main.go:141] libmachine: Creating machine...
I1212 15:10:21.918777 3520 main.go:141] libmachine: (multinode-449000) Calling .Create
I1212 15:10:21.918852 3520 main.go:141] libmachine: (multinode-449000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1212 15:10:21.919006 3520 main.go:141] libmachine: (multinode-449000) DBG | I1212 15:10:21.918850 3528 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17777-1259/.minikube
I1212 15:10:21.919060 3520 main.go:141] libmachine: (multinode-449000) Downloading /Users/jenkins/minikube-integration/17777-1259/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17777-1259/.minikube/cache/iso/amd64/minikube-v1.32.1-1701996673-17738-amd64.iso...
I1212 15:10:22.081162 3520 main.go:141] libmachine: (multinode-449000) DBG | I1212 15:10:22.081062 3528 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/id_rsa...
I1212 15:10:22.262831 3520 main.go:141] libmachine: (multinode-449000) DBG | I1212 15:10:22.262742 3528 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/multinode-449000.rawdisk...
I1212 15:10:22.262846 3520 main.go:141] libmachine: (multinode-449000) DBG | Writing magic tar header
I1212 15:10:22.262859 3520 main.go:141] libmachine: (multinode-449000) DBG | Writing SSH key tar header
I1212 15:10:22.263698 3520 main.go:141] libmachine: (multinode-449000) DBG | I1212 15:10:22.263637 3528 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000 ...
I1212 15:10:22.587520 3520 main.go:141] libmachine: (multinode-449000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1212 15:10:22.587539 3520 main.go:141] libmachine: (multinode-449000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/hyperkit.pid
I1212 15:10:22.587569 3520 main.go:141] libmachine: (multinode-449000) DBG | Using UUID 9fde523a-9943-11ee-8111-f01898ef957c
I1212 15:10:22.708128 3520 main.go:141] libmachine: (multinode-449000) DBG | Generated MAC f2:78:2:3f:65:80
I1212 15:10:22.708160 3520 main.go:141] libmachine: (multinode-449000) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-449000
I1212 15:10:22.708216 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:22 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"9fde523a-9943-11ee-8111-f01898ef957c", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc00009f1d0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/bzimage", Initrd:"/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Proce
ss)(nil)}
I1212 15:10:22.708267 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:22 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"9fde523a-9943-11ee-8111-f01898ef957c", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc00009f1d0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/bzimage", Initrd:"/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Proce
ss)(nil)}
I1212 15:10:22.708345 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:22 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "9fde523a-9943-11ee-8111-f01898ef957c", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/multinode-449000.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/tty,log=/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/bzimage,/Users/jenkins/minikube-integration/1777
7-1259/.minikube/machines/multinode-449000/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-449000"}
I1212 15:10:22.708406 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:22 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U 9fde523a-9943-11ee-8111-f01898ef957c -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/multinode-449000.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/tty,log=/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/console-ring -f kexec,/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/bzimage,/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/initrd,earlyprintk=
serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=multinode-449000"
I1212 15:10:22.708430 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:22 DEBUG: hyperkit: Redirecting stdout/stderr to logger
I1212 15:10:22.711161 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:22 DEBUG: hyperkit: Pid is 3531
I1212 15:10:22.711630 3520 main.go:141] libmachine: (multinode-449000) DBG | Attempt 0
I1212 15:10:22.711645 3520 main.go:141] libmachine: (multinode-449000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1212 15:10:22.711775 3520 main.go:141] libmachine: (multinode-449000) DBG | hyperkit pid from json: 3531
I1212 15:10:22.712666 3520 main.go:141] libmachine: (multinode-449000) DBG | Searching for f2:78:2:3f:65:80 in /var/db/dhcpd_leases ...
I1212 15:10:22.712757 3520 main.go:141] libmachine: (multinode-449000) DBG | Found 11 entries in /var/db/dhcpd_leases!
I1212 15:10:22.712771 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.12 HWAddress:ae:69:eb:53:8c:5b ID:1,ae:69:eb:53:8c:5b Lease:0x6578e85b}
I1212 15:10:22.712804 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.11 HWAddress:6a:5c:e0:d8:73:5b ID:1,6a:5c:e0:d8:73:5b Lease:0x6578e846}
I1212 15:10:22.712826 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.10 HWAddress:22:bc:7e:11:6c:f5 ID:1,22:bc:7e:11:6c:f5 Lease:0x657a397e}
I1212 15:10:22.712850 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.9 HWAddress:fe:39:cb:bf:ae:44 ID:1,fe:39:cb:bf:ae:44 Lease:0x657a3959}
I1212 15:10:22.712859 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.8 HWAddress:9a:c9:f7:34:af:5d ID:1,9a:c9:f7:34:af:5d Lease:0x657a391e}
I1212 15:10:22.712866 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.7 HWAddress:1e:8d:b0:a8:5f:be ID:1,1e:8d:b0:a8:5f:be Lease:0x657a388a}
I1212 15:10:22.712873 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.6 HWAddress:e2:94:44:d7:9:11 ID:1,e2:94:44:d7:9:11 Lease:0x6578e6f7}
I1212 15:10:22.712884 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:9a:a8:f:4a:47:90 ID:1,9a:a8:f:4a:47:90 Lease:0x657a3755}
I1212 15:10:22.712893 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:c6:cb:3c:63:0:f6 ID:1,c6:cb:3c:63:0:f6 Lease:0x657a3728}
I1212 15:10:22.712900 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:ea:48:d3:f6:3:6b ID:1,ea:48:d3:f6:3:6b Lease:0x657a3638}
I1212 15:10:22.712910 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name: IPAddress:192.169.0.2 HWAddress:82:2b:f6:5b:7f:bf ID:1,82:2b:f6:5b:7f:bf Lease:0x657a35f5}
I1212 15:10:22.718886 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:22 INFO : hyperkit: stderr: Using fd 5 for I/O notifications
I1212 15:10:22.771819 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:22 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD
I1212 15:10:22.772392 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:22 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I1212 15:10:22.772413 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:22 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I1212 15:10:22.772422 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:22 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I1212 15:10:22.772432 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:22 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I1212 15:10:23.139450 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:23 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0
I1212 15:10:23.139466 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:23 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0
I1212 15:10:23.243394 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:23 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I1212 15:10:23.243412 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:23 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I1212 15:10:23.243430 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:23 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I1212 15:10:23.243446 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:23 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I1212 15:10:23.244344 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:23 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1
I1212 15:10:23.244367 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:23 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1
I1212 15:10:24.713398 3520 main.go:141] libmachine: (multinode-449000) DBG | Attempt 1
I1212 15:10:24.713419 3520 main.go:141] libmachine: (multinode-449000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1212 15:10:24.713488 3520 main.go:141] libmachine: (multinode-449000) DBG | hyperkit pid from json: 3531
I1212 15:10:24.714567 3520 main.go:141] libmachine: (multinode-449000) DBG | Searching for f2:78:2:3f:65:80 in /var/db/dhcpd_leases ...
I1212 15:10:24.714624 3520 main.go:141] libmachine: (multinode-449000) DBG | Found 11 entries in /var/db/dhcpd_leases!
I1212 15:10:24.714642 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.12 HWAddress:ae:69:eb:53:8c:5b ID:1,ae:69:eb:53:8c:5b Lease:0x6578e85b}
I1212 15:10:24.714652 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.11 HWAddress:6a:5c:e0:d8:73:5b ID:1,6a:5c:e0:d8:73:5b Lease:0x6578e846}
I1212 15:10:24.714663 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.10 HWAddress:22:bc:7e:11:6c:f5 ID:1,22:bc:7e:11:6c:f5 Lease:0x657a397e}
I1212 15:10:24.714672 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.9 HWAddress:fe:39:cb:bf:ae:44 ID:1,fe:39:cb:bf:ae:44 Lease:0x657a3959}
I1212 15:10:24.714690 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.8 HWAddress:9a:c9:f7:34:af:5d ID:1,9a:c9:f7:34:af:5d Lease:0x657a391e}
I1212 15:10:24.714701 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.7 HWAddress:1e:8d:b0:a8:5f:be ID:1,1e:8d:b0:a8:5f:be Lease:0x657a388a}
I1212 15:10:24.714720 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.6 HWAddress:e2:94:44:d7:9:11 ID:1,e2:94:44:d7:9:11 Lease:0x6578e6f7}
I1212 15:10:24.714730 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:9a:a8:f:4a:47:90 ID:1,9a:a8:f:4a:47:90 Lease:0x657a3755}
I1212 15:10:24.714738 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:c6:cb:3c:63:0:f6 ID:1,c6:cb:3c:63:0:f6 Lease:0x657a3728}
I1212 15:10:24.714747 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:ea:48:d3:f6:3:6b ID:1,ea:48:d3:f6:3:6b Lease:0x657a3638}
I1212 15:10:24.714759 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name: IPAddress:192.169.0.2 HWAddress:82:2b:f6:5b:7f:bf ID:1,82:2b:f6:5b:7f:bf Lease:0x657a35f5}
I1212 15:10:26.715960 3520 main.go:141] libmachine: (multinode-449000) DBG | Attempt 2
I1212 15:10:26.715982 3520 main.go:141] libmachine: (multinode-449000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1212 15:10:26.716076 3520 main.go:141] libmachine: (multinode-449000) DBG | hyperkit pid from json: 3531
I1212 15:10:26.716884 3520 main.go:141] libmachine: (multinode-449000) DBG | Searching for f2:78:2:3f:65:80 in /var/db/dhcpd_leases ...
I1212 15:10:26.716925 3520 main.go:141] libmachine: (multinode-449000) DBG | Found 11 entries in /var/db/dhcpd_leases!
I1212 15:10:26.716941 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.12 HWAddress:ae:69:eb:53:8c:5b ID:1,ae:69:eb:53:8c:5b Lease:0x6578e85b}
I1212 15:10:26.716956 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.11 HWAddress:6a:5c:e0:d8:73:5b ID:1,6a:5c:e0:d8:73:5b Lease:0x6578e846}
I1212 15:10:26.716967 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.10 HWAddress:22:bc:7e:11:6c:f5 ID:1,22:bc:7e:11:6c:f5 Lease:0x657a397e}
I1212 15:10:26.716986 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.9 HWAddress:fe:39:cb:bf:ae:44 ID:1,fe:39:cb:bf:ae:44 Lease:0x657a3959}
I1212 15:10:26.716996 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.8 HWAddress:9a:c9:f7:34:af:5d ID:1,9a:c9:f7:34:af:5d Lease:0x657a391e}
I1212 15:10:26.717004 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.7 HWAddress:1e:8d:b0:a8:5f:be ID:1,1e:8d:b0:a8:5f:be Lease:0x657a388a}
I1212 15:10:26.717014 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.6 HWAddress:e2:94:44:d7:9:11 ID:1,e2:94:44:d7:9:11 Lease:0x6578e6f7}
I1212 15:10:26.717022 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:9a:a8:f:4a:47:90 ID:1,9a:a8:f:4a:47:90 Lease:0x657a3755}
I1212 15:10:26.717031 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:c6:cb:3c:63:0:f6 ID:1,c6:cb:3c:63:0:f6 Lease:0x657a3728}
I1212 15:10:26.717043 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:ea:48:d3:f6:3:6b ID:1,ea:48:d3:f6:3:6b Lease:0x657a3638}
I1212 15:10:26.717052 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name: IPAddress:192.169.0.2 HWAddress:82:2b:f6:5b:7f:bf ID:1,82:2b:f6:5b:7f:bf Lease:0x657a35f5}
I1212 15:10:28.164384 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:28 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1
I1212 15:10:28.164478 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:28 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1
I1212 15:10:28.164487 3520 main.go:141] libmachine: (multinode-449000) DBG | 2023/12/12 15:10:28 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1
I1212 15:10:28.717827 3520 main.go:141] libmachine: (multinode-449000) DBG | Attempt 3
I1212 15:10:28.717844 3520 main.go:141] libmachine: (multinode-449000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1212 15:10:28.717954 3520 main.go:141] libmachine: (multinode-449000) DBG | hyperkit pid from json: 3531
I1212 15:10:28.718762 3520 main.go:141] libmachine: (multinode-449000) DBG | Searching for f2:78:2:3f:65:80 in /var/db/dhcpd_leases ...
I1212 15:10:28.718820 3520 main.go:141] libmachine: (multinode-449000) DBG | Found 11 entries in /var/db/dhcpd_leases!
I1212 15:10:28.718832 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.12 HWAddress:ae:69:eb:53:8c:5b ID:1,ae:69:eb:53:8c:5b Lease:0x6578e85b}
I1212 15:10:28.718865 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.11 HWAddress:6a:5c:e0:d8:73:5b ID:1,6a:5c:e0:d8:73:5b Lease:0x6578e846}
I1212 15:10:28.718878 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.10 HWAddress:22:bc:7e:11:6c:f5 ID:1,22:bc:7e:11:6c:f5 Lease:0x657a397e}
I1212 15:10:28.718887 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.9 HWAddress:fe:39:cb:bf:ae:44 ID:1,fe:39:cb:bf:ae:44 Lease:0x657a3959}
I1212 15:10:28.718916 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.8 HWAddress:9a:c9:f7:34:af:5d ID:1,9a:c9:f7:34:af:5d Lease:0x657a391e}
I1212 15:10:28.718932 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.7 HWAddress:1e:8d:b0:a8:5f:be ID:1,1e:8d:b0:a8:5f:be Lease:0x657a388a}
I1212 15:10:28.718952 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.6 HWAddress:e2:94:44:d7:9:11 ID:1,e2:94:44:d7:9:11 Lease:0x6578e6f7}
I1212 15:10:28.718966 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:9a:a8:f:4a:47:90 ID:1,9a:a8:f:4a:47:90 Lease:0x657a3755}
I1212 15:10:28.718976 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:c6:cb:3c:63:0:f6 ID:1,c6:cb:3c:63:0:f6 Lease:0x657a3728}
I1212 15:10:28.718987 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:ea:48:d3:f6:3:6b ID:1,ea:48:d3:f6:3:6b Lease:0x657a3638}
I1212 15:10:28.718996 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name: IPAddress:192.169.0.2 HWAddress:82:2b:f6:5b:7f:bf ID:1,82:2b:f6:5b:7f:bf Lease:0x657a35f5}
I1212 15:10:30.719017 3520 main.go:141] libmachine: (multinode-449000) DBG | Attempt 4
I1212 15:10:30.719033 3520 main.go:141] libmachine: (multinode-449000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1212 15:10:30.719089 3520 main.go:141] libmachine: (multinode-449000) DBG | hyperkit pid from json: 3531
I1212 15:10:30.719912 3520 main.go:141] libmachine: (multinode-449000) DBG | Searching for f2:78:2:3f:65:80 in /var/db/dhcpd_leases ...
I1212 15:10:30.719933 3520 main.go:141] libmachine: (multinode-449000) DBG | Found 11 entries in /var/db/dhcpd_leases!
I1212 15:10:30.719956 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.12 HWAddress:ae:69:eb:53:8c:5b ID:1,ae:69:eb:53:8c:5b Lease:0x6578e85b}
I1212 15:10:30.719966 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.11 HWAddress:6a:5c:e0:d8:73:5b ID:1,6a:5c:e0:d8:73:5b Lease:0x6578e846}
I1212 15:10:30.719977 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.10 HWAddress:22:bc:7e:11:6c:f5 ID:1,22:bc:7e:11:6c:f5 Lease:0x657a397e}
I1212 15:10:30.719991 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.9 HWAddress:fe:39:cb:bf:ae:44 ID:1,fe:39:cb:bf:ae:44 Lease:0x657a3959}
I1212 15:10:30.720004 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.8 HWAddress:9a:c9:f7:34:af:5d ID:1,9a:c9:f7:34:af:5d Lease:0x657a391e}
I1212 15:10:30.720035 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.7 HWAddress:1e:8d:b0:a8:5f:be ID:1,1e:8d:b0:a8:5f:be Lease:0x657a388a}
I1212 15:10:30.720046 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.6 HWAddress:e2:94:44:d7:9:11 ID:1,e2:94:44:d7:9:11 Lease:0x6578e6f7}
I1212 15:10:30.720057 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.5 HWAddress:9a:a8:f:4a:47:90 ID:1,9a:a8:f:4a:47:90 Lease:0x657a3755}
I1212 15:10:30.720066 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.4 HWAddress:c6:cb:3c:63:0:f6 ID:1,c6:cb:3c:63:0:f6 Lease:0x657a3728}
I1212 15:10:30.720075 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:ea:48:d3:f6:3:6b ID:1,ea:48:d3:f6:3:6b Lease:0x657a3638}
I1212 15:10:30.720083 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name: IPAddress:192.169.0.2 HWAddress:82:2b:f6:5b:7f:bf ID:1,82:2b:f6:5b:7f:bf Lease:0x657a35f5}
I1212 15:10:32.721385 3520 main.go:141] libmachine: (multinode-449000) DBG | Attempt 5
I1212 15:10:32.721409 3520 main.go:141] libmachine: (multinode-449000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1212 15:10:32.721493 3520 main.go:141] libmachine: (multinode-449000) DBG | hyperkit pid from json: 3531
I1212 15:10:32.722946 3520 main.go:141] libmachine: (multinode-449000) DBG | Searching for f2:78:2:3f:65:80 in /var/db/dhcpd_leases ...
I1212 15:10:32.723037 3520 main.go:141] libmachine: (multinode-449000) DBG | Found 12 entries in /var/db/dhcpd_leases!
I1212 15:10:32.723054 3520 main.go:141] libmachine: (multinode-449000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.13 HWAddress:f2:78:2:3f:65:80 ID:1,f2:78:2:3f:65:80 Lease:0x657a39e7}
I1212 15:10:32.723067 3520 main.go:141] libmachine: (multinode-449000) DBG | Found match: f2:78:2:3f:65:80
I1212 15:10:32.723076 3520 main.go:141] libmachine: (multinode-449000) DBG | IP: 192.169.0.13
I1212 15:10:32.723121 3520 main.go:141] libmachine: (multinode-449000) Calling .GetConfigRaw
I1212 15:10:32.723845 3520 main.go:141] libmachine: (multinode-449000) Calling .DriverName
I1212 15:10:32.724030 3520 main.go:141] libmachine: (multinode-449000) Calling .DriverName
I1212 15:10:32.724167 3520 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I1212 15:10:32.724186 3520 main.go:141] libmachine: (multinode-449000) Calling .GetState
I1212 15:10:32.724321 3520 main.go:141] libmachine: (multinode-449000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1212 15:10:32.724404 3520 main.go:141] libmachine: (multinode-449000) DBG | hyperkit pid from json: 3531
I1212 15:10:32.725322 3520 main.go:141] libmachine: Detecting operating system of created instance...
I1212 15:10:32.725334 3520 main.go:141] libmachine: Waiting for SSH to be available...
I1212 15:10:32.725339 3520 main.go:141] libmachine: Getting to WaitForSSH function...
I1212 15:10:32.725346 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHHostname
I1212 15:10:32.725449 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHPort
I1212 15:10:32.725543 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:32.725645 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:32.725740 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHUsername
I1212 15:10:32.725871 3520 main.go:141] libmachine: Using SSH client type: native
I1212 15:10:32.726166 3520 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406180] 0x1408e60 <nil> [] 0s} 192.169.0.13 22 <nil> <nil>}
I1212 15:10:32.726174 3520 main.go:141] libmachine: About to run SSH command:
exit 0
I1212 15:10:32.787810 3520 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1212 15:10:32.787823 3520 main.go:141] libmachine: Detecting the provisioner...
I1212 15:10:32.787829 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHHostname
I1212 15:10:32.787955 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHPort
I1212 15:10:32.788045 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:32.788145 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:32.788240 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHUsername
I1212 15:10:32.788377 3520 main.go:141] libmachine: Using SSH client type: native
I1212 15:10:32.788636 3520 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406180] 0x1408e60 <nil> [] 0s} 192.169.0.13 22 <nil> <nil>}
I1212 15:10:32.788645 3520 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I1212 15:10:32.851671 3520 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g0ec83c8-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I1212 15:10:32.851729 3520 main.go:141] libmachine: found compatible host: buildroot
I1212 15:10:32.851736 3520 main.go:141] libmachine: Provisioning with buildroot...
I1212 15:10:32.851744 3520 main.go:141] libmachine: (multinode-449000) Calling .GetMachineName
I1212 15:10:32.851871 3520 buildroot.go:166] provisioning hostname "multinode-449000"
I1212 15:10:32.851880 3520 main.go:141] libmachine: (multinode-449000) Calling .GetMachineName
I1212 15:10:32.851972 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHHostname
I1212 15:10:32.852052 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHPort
I1212 15:10:32.852137 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:32.852221 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:32.852307 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHUsername
I1212 15:10:32.852440 3520 main.go:141] libmachine: Using SSH client type: native
I1212 15:10:32.852677 3520 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406180] 0x1408e60 <nil> [] 0s} 192.169.0.13 22 <nil> <nil>}
I1212 15:10:32.852686 3520 main.go:141] libmachine: About to run SSH command:
sudo hostname multinode-449000 && echo "multinode-449000" | sudo tee /etc/hostname
I1212 15:10:32.924230 3520 main.go:141] libmachine: SSH cmd err, output: <nil>: multinode-449000
I1212 15:10:32.924250 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHHostname
I1212 15:10:32.924382 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHPort
I1212 15:10:32.924474 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:32.924572 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:32.924685 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHUsername
I1212 15:10:32.924833 3520 main.go:141] libmachine: Using SSH client type: native
I1212 15:10:32.925103 3520 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406180] 0x1408e60 <nil> [] 0s} 192.169.0.13 22 <nil> <nil>}
I1212 15:10:32.925116 3520 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\smultinode-449000' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 multinode-449000/g' /etc/hosts;
else
echo '127.0.1.1 multinode-449000' | sudo tee -a /etc/hosts;
fi
fi
I1212 15:10:32.991426 3520 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1212 15:10:32.991447 3520 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17777-1259/.minikube CaCertPath:/Users/jenkins/minikube-integration/17777-1259/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17777-1259/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17777-1259/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17777-1259/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17777-1259/.minikube}
I1212 15:10:32.991460 3520 buildroot.go:174] setting up certificates
I1212 15:10:32.991472 3520 provision.go:83] configureAuth start
I1212 15:10:32.991480 3520 main.go:141] libmachine: (multinode-449000) Calling .GetMachineName
I1212 15:10:32.991635 3520 main.go:141] libmachine: (multinode-449000) Calling .GetIP
I1212 15:10:32.991723 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHHostname
I1212 15:10:32.991811 3520 provision.go:138] copyHostCerts
I1212 15:10:32.991844 3520 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17777-1259/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/17777-1259/.minikube/ca.pem
I1212 15:10:32.991892 3520 exec_runner.go:144] found /Users/jenkins/minikube-integration/17777-1259/.minikube/ca.pem, removing ...
I1212 15:10:32.991901 3520 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17777-1259/.minikube/ca.pem
I1212 15:10:32.992029 3520 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17777-1259/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17777-1259/.minikube/ca.pem (1082 bytes)
I1212 15:10:32.992238 3520 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17777-1259/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/17777-1259/.minikube/cert.pem
I1212 15:10:32.992269 3520 exec_runner.go:144] found /Users/jenkins/minikube-integration/17777-1259/.minikube/cert.pem, removing ...
I1212 15:10:32.992274 3520 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17777-1259/.minikube/cert.pem
I1212 15:10:32.992361 3520 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17777-1259/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17777-1259/.minikube/cert.pem (1123 bytes)
I1212 15:10:32.992514 3520 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17777-1259/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/17777-1259/.minikube/key.pem
I1212 15:10:32.992561 3520 exec_runner.go:144] found /Users/jenkins/minikube-integration/17777-1259/.minikube/key.pem, removing ...
I1212 15:10:32.992566 3520 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17777-1259/.minikube/key.pem
I1212 15:10:32.992646 3520 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17777-1259/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17777-1259/.minikube/key.pem (1675 bytes)
I1212 15:10:32.992792 3520 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17777-1259/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17777-1259/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17777-1259/.minikube/certs/ca-key.pem org=jenkins.multinode-449000 san=[192.169.0.13 192.169.0.13 localhost 127.0.0.1 minikube multinode-449000]
I1212 15:10:33.047926 3520 provision.go:172] copyRemoteCerts
I1212 15:10:33.047979 3520 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1212 15:10:33.047993 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHHostname
I1212 15:10:33.048190 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHPort
I1212 15:10:33.048288 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:33.048404 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHUsername
I1212 15:10:33.048493 3520 sshutil.go:53] new ssh client: &{IP:192.169.0.13 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/id_rsa Username:docker}
I1212 15:10:33.086749 3520 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17777-1259/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I1212 15:10:33.086808 3520 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17777-1259/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I1212 15:10:33.102401 3520 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17777-1259/.minikube/machines/server.pem -> /etc/docker/server.pem
I1212 15:10:33.102474 3520 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17777-1259/.minikube/machines/server.pem --> /etc/docker/server.pem (1224 bytes)
I1212 15:10:33.118183 3520 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17777-1259/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I1212 15:10:33.118247 3520 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17777-1259/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1212 15:10:33.133764 3520 provision.go:86] duration metric: configureAuth took 142.279509ms
I1212 15:10:33.133776 3520 buildroot.go:189] setting minikube options for container-runtime
I1212 15:10:33.133905 3520 config.go:182] Loaded profile config "multinode-449000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I1212 15:10:33.133918 3520 main.go:141] libmachine: (multinode-449000) Calling .DriverName
I1212 15:10:33.134046 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHHostname
I1212 15:10:33.134129 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHPort
I1212 15:10:33.134218 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:33.134301 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:33.134368 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHUsername
I1212 15:10:33.134486 3520 main.go:141] libmachine: Using SSH client type: native
I1212 15:10:33.134724 3520 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406180] 0x1408e60 <nil> [] 0s} 192.169.0.13 22 <nil> <nil>}
I1212 15:10:33.134733 3520 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I1212 15:10:33.198604 3520 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I1212 15:10:33.198622 3520 buildroot.go:70] root file system type: tmpfs
I1212 15:10:33.198695 3520 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I1212 15:10:33.198707 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHHostname
I1212 15:10:33.198846 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHPort
I1212 15:10:33.198940 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:33.199034 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:33.199124 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHUsername
I1212 15:10:33.199253 3520 main.go:141] libmachine: Using SSH client type: native
I1212 15:10:33.199500 3520 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406180] 0x1408e60 <nil> [] 0s} 192.169.0.13 22 <nil> <nil>}
I1212 15:10:33.199544 3520 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I1212 15:10:33.271466 3520 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I1212 15:10:33.271486 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHHostname
I1212 15:10:33.271618 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHPort
I1212 15:10:33.271707 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:33.271794 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:33.271888 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHUsername
I1212 15:10:33.272018 3520 main.go:141] libmachine: Using SSH client type: native
I1212 15:10:33.272264 3520 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406180] 0x1408e60 <nil> [] 0s} 192.169.0.13 22 <nil> <nil>}
I1212 15:10:33.272277 3520 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I1212 15:10:33.763707 3520 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I1212 15:10:33.763723 3520 main.go:141] libmachine: Checking connection to Docker...
I1212 15:10:33.763730 3520 main.go:141] libmachine: (multinode-449000) Calling .GetURL
I1212 15:10:33.763867 3520 main.go:141] libmachine: Docker is up and running!
I1212 15:10:33.763876 3520 main.go:141] libmachine: Reticulating splines...
I1212 15:10:33.763885 3520 client.go:171] LocalClient.Create took 11.846102764s
I1212 15:10:33.763901 3520 start.go:167] duration metric: libmachine.API.Create for "multinode-449000" took 11.846154994s
I1212 15:10:33.763909 3520 start.go:300] post-start starting for "multinode-449000" (driver="hyperkit")
I1212 15:10:33.763919 3520 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1212 15:10:33.763929 3520 main.go:141] libmachine: (multinode-449000) Calling .DriverName
I1212 15:10:33.764073 3520 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1212 15:10:33.764085 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHHostname
I1212 15:10:33.764170 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHPort
I1212 15:10:33.764253 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:33.764335 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHUsername
I1212 15:10:33.764417 3520 sshutil.go:53] new ssh client: &{IP:192.169.0.13 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/id_rsa Username:docker}
I1212 15:10:33.801129 3520 ssh_runner.go:195] Run: cat /etc/os-release
I1212 15:10:33.803879 3520 command_runner.go:130] > NAME=Buildroot
I1212 15:10:33.803887 3520 command_runner.go:130] > VERSION=2021.02.12-1-g0ec83c8-dirty
I1212 15:10:33.803891 3520 command_runner.go:130] > ID=buildroot
I1212 15:10:33.803895 3520 command_runner.go:130] > VERSION_ID=2021.02.12
I1212 15:10:33.803899 3520 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"
I1212 15:10:33.803984 3520 info.go:137] Remote host: Buildroot 2021.02.12
I1212 15:10:33.803997 3520 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17777-1259/.minikube/addons for local assets ...
I1212 15:10:33.804094 3520 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17777-1259/.minikube/files for local assets ...
I1212 15:10:33.804280 3520 filesync.go:149] local asset: /Users/jenkins/minikube-integration/17777-1259/.minikube/files/etc/ssl/certs/17202.pem -> 17202.pem in /etc/ssl/certs
I1212 15:10:33.804287 3520 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17777-1259/.minikube/files/etc/ssl/certs/17202.pem -> /etc/ssl/certs/17202.pem
I1212 15:10:33.804488 3520 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1212 15:10:33.810114 3520 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17777-1259/.minikube/files/etc/ssl/certs/17202.pem --> /etc/ssl/certs/17202.pem (1708 bytes)
I1212 15:10:33.826415 3520 start.go:303] post-start completed in 62.499244ms
I1212 15:10:33.826441 3520 main.go:141] libmachine: (multinode-449000) Calling .GetConfigRaw
I1212 15:10:33.827036 3520 main.go:141] libmachine: (multinode-449000) Calling .GetIP
I1212 15:10:33.827188 3520 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17777-1259/.minikube/profiles/multinode-449000/config.json ...
I1212 15:10:33.827523 3520 start.go:128] duration metric: createHost completed in 11.9624502s
I1212 15:10:33.827540 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHHostname
I1212 15:10:33.827658 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHPort
I1212 15:10:33.827755 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:33.827850 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:33.827928 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHUsername
I1212 15:10:33.828031 3520 main.go:141] libmachine: Using SSH client type: native
I1212 15:10:33.828266 3520 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406180] 0x1408e60 <nil> [] 0s} 192.169.0.13 22 <nil> <nil>}
I1212 15:10:33.828275 3520 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I1212 15:10:33.890954 3520 main.go:141] libmachine: SSH cmd err, output: <nil>: 1702422633.772668635
I1212 15:10:33.890968 3520 fix.go:206] guest clock: 1702422633.772668635
I1212 15:10:33.890973 3520 fix.go:219] Guest: 2023-12-12 15:10:33.772668635 -0800 PST Remote: 2023-12-12 15:10:33.827533 -0800 PST m=+12.400650783 (delta=-54.864365ms)
I1212 15:10:33.890995 3520 fix.go:190] guest clock delta is within tolerance: -54.864365ms
I1212 15:10:33.891000 3520 start.go:83] releasing machines lock for "multinode-449000", held for 12.026059761s
I1212 15:10:33.891031 3520 main.go:141] libmachine: (multinode-449000) Calling .DriverName
I1212 15:10:33.891161 3520 main.go:141] libmachine: (multinode-449000) Calling .GetIP
I1212 15:10:33.891260 3520 main.go:141] libmachine: (multinode-449000) Calling .DriverName
I1212 15:10:33.891541 3520 main.go:141] libmachine: (multinode-449000) Calling .DriverName
I1212 15:10:33.891651 3520 main.go:141] libmachine: (multinode-449000) Calling .DriverName
I1212 15:10:33.891737 3520 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1212 15:10:33.891771 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHHostname
I1212 15:10:33.891821 3520 ssh_runner.go:195] Run: cat /version.json
I1212 15:10:33.891834 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHHostname
I1212 15:10:33.891870 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHPort
I1212 15:10:33.891928 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHPort
I1212 15:10:33.891953 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:33.892036 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHUsername
I1212 15:10:33.892049 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHKeyPath
I1212 15:10:33.892125 3520 sshutil.go:53] new ssh client: &{IP:192.169.0.13 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/id_rsa Username:docker}
I1212 15:10:33.892142 3520 main.go:141] libmachine: (multinode-449000) Calling .GetSSHUsername
I1212 15:10:33.892232 3520 sshutil.go:53] new ssh client: &{IP:192.169.0.13 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17777-1259/.minikube/machines/multinode-449000/id_rsa Username:docker}
I1212 15:10:33.925494 3520 command_runner.go:130] > {"iso_version": "v1.32.1-1701996673-17738", "kicbase_version": "v0.0.42-1701974066-17719", "minikube_version": "v1.32.0", "commit": "2518fadffa02a308edcd7fa670f350a21819c5e4"}
I1212 15:10:33.925750 3520 ssh_runner.go:195] Run: systemctl --version
I1212 15:10:33.980304 3520 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.
I1212 15:10:33.981207 3520 command_runner.go:130] > systemd 247 (247)
I1212 15:10:33.981234 3520 command_runner.go:130] > -PAM -AUDIT -SELINUX -IMA -APPARMOR -SMACK -SYSVINIT -UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ +LZ4 -ZSTD +SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid
I1212 15:10:33.981429 3520 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1212 15:10:33.985385 3520 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory
W1212 15:10:33.985470 3520 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1212 15:10:33.985520 3520 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1212 15:10:33.995781 3520 command_runner.go:139] > /etc/cni/net.d/87-podman-bridge.conflist,
I1212 15:10:33.996008 3520 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1212 15:10:33.996025 3520 start.go:475] detecting cgroup driver to use...
I1212 15:10:33.996125 3520 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1212 15:10:34.008962 3520 command_runner.go:130] > runtime-endpoint: unix:///run/containerd/containerd.sock
I1212 15:10:34.009280 3520 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I1212 15:10:34.016301 3520 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1212 15:10:34.023324 3520 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I1212 15:10:34.023367 3520 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I1212 15:10:34.030325 3520 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1212 15:10:34.037329 3520 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1212 15:10:34.044233 3520 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1212 15:10:34.051364 3520 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1212 15:10:34.058569 3520 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1212 15:10:34.065719 3520 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1212 15:10:34.071832 3520 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1
I1212 15:10:34.072005 3520 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1212 15:10:34.078430 3520 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1212 15:10:34.168397 3520 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1212 15:10:34.181783 3520 start.go:475] detecting cgroup driver to use...
I1212 15:10:34.181861 3520 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I1212 15:10:34.193817 3520 command_runner.go:130] > # /usr/lib/systemd/system/docker.service
I1212 15:10:34.194043 3520 command_runner.go:130] > [Unit]
I1212 15:10:34.194053 3520 command_runner.go:130] > Description=Docker Application Container Engine
I1212 15:10:34.194058 3520 command_runner.go:130] > Documentation=https://docs.docker.com
I1212 15:10:34.194063 3520 command_runner.go:130] > After=network.target minikube-automount.service docker.socket
I1212 15:10:34.194067 3520 command_runner.go:130] > Requires= minikube-automount.service docker.socket
I1212 15:10:34.194072 3520 command_runner.go:130] > StartLimitBurst=3
I1212 15:10:34.194076 3520 command_runner.go:130] > StartLimitIntervalSec=60
I1212 15:10:34.194080 3520 command_runner.go:130] > [Service]
I1212 15:10:34.194083 3520 command_runner.go:130] > Type=notify
I1212 15:10:34.194087 3520 command_runner.go:130] > Restart=on-failure
I1212 15:10:34.194109 3520 command_runner.go:130] > # This file is a systemd drop-in unit that inherits from the base dockerd configuration.
I1212 15:10:34.194121 3520 command_runner.go:130] > # The base configuration already specifies an 'ExecStart=...' command. The first directive
I1212 15:10:34.194128 3520 command_runner.go:130] > # here is to clear out that command inherited from the base configuration. Without this,
I1212 15:10:34.194133 3520 command_runner.go:130] > # the command from the base configuration and the command specified here are treated as
I1212 15:10:34.194138 3520 command_runner.go:130] > # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
I1212 15:10:34.194144 3520 command_runner.go:130] > # will catch this invalid input and refuse to start the service with an error like:
I1212 15:10:34.194163 3520 command_runner.go:130] > # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
I1212 15:10:34.194172 3520 command_runner.go:130] > # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
I1212 15:10:34.194178 3520 command_runner.go:130] > # container runtimes. If left unlimited, it may result in OOM issues with MySQL.
I1212 15:10:34.194182 3520 command_runner.go:130] > ExecStart=
I1212 15:10:34.194193 3520 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
I1212 15:10:34.194198 3520 command_runner.go:130] > ExecReload=/bin/kill -s HUP $MAINPID
I1212 15:10:34.194205 3520 command_runner.go:130] > # Having non-zero Limit*s causes performance problems due to accounting overhead
I1212 15:10:34.194210 3520 command_runner.go:130] > # in the kernel. We recommend using cgroups to do container-local accounting.
I1212 15:10:34.194214 3520 command_runner.go:130] > LimitNOFILE=infinity
I1212 15:10:34.194218 3520 command_runner.go:130] > LimitNPROC=infinity
I1212 15:10:34.194221 3520 command_runner.go:130] > LimitCORE=infinity
I1212 15:10:34.194226 3520 command_runner.go:130] > # Uncomment TasksMax if your systemd version supports it.
I1212 15:10:34.194230 3520 command_runner.go:130] > # Only systemd 226 and above support this version.
I1212 15:10:34.194238 3520 command_runner.go:130] > TasksMax=infinity
I1212 15:10:34.194241 3520 command_runner.go:130] > TimeoutStartSec=0
I1212 15:10:34.194247 3520 command_runner.go:130] > # set delegate yes so that systemd does not reset the cgroups of docker containers
I1212 15:10:34.194250 3520 command_runner.go:130] > Delegate=yes
I1212 15:10:34.194258 3520 command_runner.go:130] > # kill only the docker process, not all processes in the cgroup
I1212 15:10:34.194263 3520 command_runner.go:130] > KillMode=process
I1212 15:10:34.194267 3520 command_runner.go:130] > [Install]
I1212 15:10:34.194276 3520 command_runner.go:130] > WantedBy=multi-user.target
I1212 15:10:34.194462 3520 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1212 15:10:34.210531 3520 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1212 15:10:34.226572 3520 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1212 15:10:34.235382 3520 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1212 15:10:34.243733 3520 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1212 15:10:34.262334 3520 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1212 15:10:34.271520 3520 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I1212 15:10:34.283199 3520 command_runner.go:130] > runtime-endpoint: unix:///var/run/cri-dockerd.sock
I1212 15:10:34.283546 3520 ssh_runner.go:195] Run: which cri-dockerd
I1212 15:10:34.285916 3520 command_runner.go:130] > /usr/bin/cri-dockerd
I1212 15:10:34.286131 3520 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I1212 15:10:34.292463 3520 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I1212 15:10:34.303332 3520 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I1212 15:10:34.388185 3520 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I1212 15:10:34.487306 3520 docker.go:560] configuring docker to use "cgroupfs" as cgroup driver...
I1212 15:10:34.487389 3520 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I1212 15:10:34.498805 3520 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1212 15:10:34.585007 3520 ssh_runner.go:195] Run: sudo systemctl restart docker
I1212 15:10:35.817139 3520 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.232121014s)
I1212 15:10:35.817200 3520 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I1212 15:10:35.900738 3520 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I1212 15:10:35.996010 3520 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I1212 15:10:36.086865 3520 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1212 15:10:36.174513 3520 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I1212 15:10:36.183908 3520 command_runner.go:130] ! Job failed. See "journalctl -xe" for details.
I1212 15:10:36.184023 3520 ssh_runner.go:195] Run: sudo journalctl --no-pager -u cri-docker.socket
I1212 15:10:36.190794 3520 command_runner.go:130] > -- Journal begins at Tue 2023-12-12 23:10:30 UTC, ends at Tue 2023-12-12 23:10:36 UTC. --
I1212 15:10:36.190804 3520 command_runner.go:130] > Dec 12 23:10:31 minikube systemd[1]: Starting CRI Docker Socket for the API.
I1212 15:10:36.190810 3520 command_runner.go:130] > Dec 12 23:10:31 minikube systemd[1]: Listening on CRI Docker Socket for the API.
I1212 15:10:36.190827 3520 command_runner.go:130] > Dec 12 23:10:33 multinode-449000 systemd[1]: cri-docker.socket: Succeeded.
I1212 15:10:36.190833 3520 command_runner.go:130] > Dec 12 23:10:33 multinode-449000 systemd[1]: Closed CRI Docker Socket for the API.
I1212 15:10:36.190839 3520 command_runner.go:130] > Dec 12 23:10:33 multinode-449000 systemd[1]: Stopping CRI Docker Socket for the API.
I1212 15:10:36.190850 3520 command_runner.go:130] > Dec 12 23:10:33 multinode-449000 systemd[1]: Starting CRI Docker Socket for the API.
I1212 15:10:36.190857 3520 command_runner.go:130] > Dec 12 23:10:33 multinode-449000 systemd[1]: Listening on CRI Docker Socket for the API.
I1212 15:10:36.190862 3520 command_runner.go:130] > Dec 12 23:10:36 multinode-449000 systemd[1]: cri-docker.socket: Succeeded.
I1212 15:10:36.190867 3520 command_runner.go:130] > Dec 12 23:10:36 multinode-449000 systemd[1]: Closed CRI Docker Socket for the API.
I1212 15:10:36.190873 3520 command_runner.go:130] > Dec 12 23:10:36 multinode-449000 systemd[1]: Stopping CRI Docker Socket for the API.
I1212 15:10:36.190883 3520 command_runner.go:130] > Dec 12 23:10:36 multinode-449000 systemd[1]: cri-docker.socket: Socket service cri-docker.service already active, refusing.
I1212 15:10:36.190892 3520 command_runner.go:130] > Dec 12 23:10:36 multinode-449000 systemd[1]: Failed to listen on CRI Docker Socket for the API.
I1212 15:10:36.213505 3520 out.go:177]
W1212 15:10:36.233430 3520 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart cri-docker.socket: Process exited with status 1
stdout:
stderr:
Job failed. See "journalctl -xe" for details.
sudo journalctl --no-pager -u cri-docker.socket:
-- stdout --
-- Journal begins at Tue 2023-12-12 23:10:30 UTC, ends at Tue 2023-12-12 23:10:36 UTC. --
Dec 12 23:10:31 minikube systemd[1]: Starting CRI Docker Socket for the API.
Dec 12 23:10:31 minikube systemd[1]: Listening on CRI Docker Socket for the API.
Dec 12 23:10:33 multinode-449000 systemd[1]: cri-docker.socket: Succeeded.
Dec 12 23:10:33 multinode-449000 systemd[1]: Closed CRI Docker Socket for the API.
Dec 12 23:10:33 multinode-449000 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 12 23:10:33 multinode-449000 systemd[1]: Starting CRI Docker Socket for the API.
Dec 12 23:10:33 multinode-449000 systemd[1]: Listening on CRI Docker Socket for the API.
Dec 12 23:10:36 multinode-449000 systemd[1]: cri-docker.socket: Succeeded.
Dec 12 23:10:36 multinode-449000 systemd[1]: Closed CRI Docker Socket for the API.
Dec 12 23:10:36 multinode-449000 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 12 23:10:36 multinode-449000 systemd[1]: cri-docker.socket: Socket service cri-docker.service already active, refusing.
Dec 12 23:10:36 multinode-449000 systemd[1]: Failed to listen on CRI Docker Socket for the API.
-- /stdout --
X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart cri-docker.socket: Process exited with status 1
stdout:
stderr:
Job failed. See "journalctl -xe" for details.
sudo journalctl --no-pager -u cri-docker.socket:
-- stdout --
-- Journal begins at Tue 2023-12-12 23:10:30 UTC, ends at Tue 2023-12-12 23:10:36 UTC. --
Dec 12 23:10:31 minikube systemd[1]: Starting CRI Docker Socket for the API.
Dec 12 23:10:31 minikube systemd[1]: Listening on CRI Docker Socket for the API.
Dec 12 23:10:33 multinode-449000 systemd[1]: cri-docker.socket: Succeeded.
Dec 12 23:10:33 multinode-449000 systemd[1]: Closed CRI Docker Socket for the API.
Dec 12 23:10:33 multinode-449000 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 12 23:10:33 multinode-449000 systemd[1]: Starting CRI Docker Socket for the API.
Dec 12 23:10:33 multinode-449000 systemd[1]: Listening on CRI Docker Socket for the API.
Dec 12 23:10:36 multinode-449000 systemd[1]: cri-docker.socket: Succeeded.
Dec 12 23:10:36 multinode-449000 systemd[1]: Closed CRI Docker Socket for the API.
Dec 12 23:10:36 multinode-449000 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 12 23:10:36 multinode-449000 systemd[1]: cri-docker.socket: Socket service cri-docker.service already active, refusing.
Dec 12 23:10:36 multinode-449000 systemd[1]: Failed to listen on CRI Docker Socket for the API.
-- /stdout --
W1212 15:10:36.233459 3520 out.go:239] *
*
W1212 15:10:36.235961 3520 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1212 15:10:36.298340 3520 out.go:177]
** /stderr **
multinode_test.go:88: failed to start cluster. args "out/minikube-darwin-amd64 start -p multinode-449000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit " : exit status 90
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-449000 -n multinode-449000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-449000 -n multinode-449000: exit status 6 (150.522465ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E1212 15:10:36.496680 3536 status.go:415] kubeconfig endpoint: extract IP: "multinode-449000" does not appear in /Users/jenkins/minikube-integration/17777-1259/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "multinode-449000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestMultiNode/serial/FreshStart2Nodes (15.09s)