=== RUN TestAddons/Setup
addons_test.go:109: (dbg) Run: out/minikube-darwin-amd64 start -p addons-249000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --driver=hyperkit --addons=ingress --addons=ingress-dns --addons=helm-tiller
addons_test.go:109: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p addons-249000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --driver=hyperkit --addons=ingress --addons=ingress-dns --addons=helm-tiller: exit status 90 (15.345483362s)
-- stdout --
* [addons-249000] minikube v1.32.0 on Darwin 14.1.2
- MINIKUBE_LOCATION=17738
- KUBECONFIG=/Users/jenkins/minikube-integration/17738-1113/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/17738-1113/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the hyperkit driver based on user configuration
* Starting control plane node addons-249000 in cluster addons-249000
* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
-- /stdout --
** stderr **
I1208 10:10:37.874769 1696 out.go:296] Setting OutFile to fd 1 ...
I1208 10:10:37.875059 1696 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1208 10:10:37.875065 1696 out.go:309] Setting ErrFile to fd 2...
I1208 10:10:37.875069 1696 out.go:343] TERM=,COLORTERM=, which probably does not support color
I1208 10:10:37.875251 1696 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17738-1113/.minikube/bin
I1208 10:10:37.876645 1696 out.go:303] Setting JSON to false
I1208 10:10:37.898690 1696 start.go:128] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":593,"bootTime":1702058444,"procs":423,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.2","kernelVersion":"23.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
W1208 10:10:37.898797 1696 start.go:136] gopshost.Virtualization returned error: not implemented yet
I1208 10:10:37.920109 1696 out.go:177] * [addons-249000] minikube v1.32.0 on Darwin 14.1.2
I1208 10:10:37.961971 1696 out.go:177] - MINIKUBE_LOCATION=17738
I1208 10:10:37.962022 1696 notify.go:220] Checking for updates...
I1208 10:10:37.983875 1696 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/17738-1113/kubeconfig
I1208 10:10:38.004619 1696 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-amd64
I1208 10:10:38.025840 1696 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1208 10:10:38.046796 1696 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17738-1113/.minikube
I1208 10:10:38.067777 1696 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1208 10:10:38.089285 1696 driver.go:392] Setting default libvirt URI to qemu:///system
I1208 10:10:38.118797 1696 out.go:177] * Using the hyperkit driver based on user configuration
I1208 10:10:38.160765 1696 start.go:298] selected driver: hyperkit
I1208 10:10:38.160793 1696 start.go:902] validating driver "hyperkit" against <nil>
I1208 10:10:38.160815 1696 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1208 10:10:38.165727 1696 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1208 10:10:38.165844 1696 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17738-1113/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
I1208 10:10:38.173733 1696 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
I1208 10:10:38.177581 1696 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1208 10:10:38.177607 1696 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
I1208 10:10:38.177644 1696 start_flags.go:309] no existing cluster config was found, will generate one from the flags
I1208 10:10:38.177839 1696 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1208 10:10:38.177906 1696 cni.go:84] Creating CNI manager for ""
I1208 10:10:38.177921 1696 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I1208 10:10:38.177929 1696 start_flags.go:318] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I1208 10:10:38.177937 1696 start_flags.go:323] config:
{Name:addons-249000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1701996201-17738@sha256:762cf4043ae4a952648fa2b64c30a2e88a4a1a052facb1120d8e17b35444edf0 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-249000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker
CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}
I1208 10:10:38.178075 1696 iso.go:125] acquiring lock: {Name:mk933f5286cca8a935e46c54218c5cced15285e9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1208 10:10:38.219790 1696 out.go:177] * Starting control plane node addons-249000 in cluster addons-249000
I1208 10:10:38.240791 1696 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
I1208 10:10:38.240865 1696 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17738-1113/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
I1208 10:10:38.240892 1696 cache.go:56] Caching tarball of preloaded images
I1208 10:10:38.241085 1696 preload.go:174] Found /Users/jenkins/minikube-integration/17738-1113/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I1208 10:10:38.241106 1696 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
I1208 10:10:38.241615 1696 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17738-1113/.minikube/profiles/addons-249000/config.json ...
I1208 10:10:38.241657 1696 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17738-1113/.minikube/profiles/addons-249000/config.json: {Name:mk94b249887c0e61b540d7f365726e31ac6f4bf3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1208 10:10:38.242316 1696 start.go:365] acquiring machines lock for addons-249000: {Name:mkf6539d901e554b062746e761b420c8557e3211 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1208 10:10:38.242540 1696 start.go:369] acquired machines lock for "addons-249000" in 200.861µs
I1208 10:10:38.242583 1696 start.go:93] Provisioning new machine with config: &{Name:addons-249000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17738/minikube-v1.32.1-1701996673-17738-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1701996201-17738@sha256:762cf4043ae4a952648fa2b64c30a2e88a4a1a052facb1120d8e17b35444edf0 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.28.4 ClusterName:addons-249000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 Mount
Options:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
I1208 10:10:38.242673 1696 start.go:125] createHost starting for "" (driver="hyperkit")
I1208 10:10:38.284751 1696 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
I1208 10:10:38.285116 1696 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I1208 10:10:38.285171 1696 main.go:141] libmachine: Launching plugin server for driver hyperkit
I1208 10:10:38.293604 1696 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49360
I1208 10:10:38.293984 1696 main.go:141] libmachine: () Calling .GetVersion
I1208 10:10:38.294393 1696 main.go:141] libmachine: Using API Version 1
I1208 10:10:38.294403 1696 main.go:141] libmachine: () Calling .SetConfigRaw
I1208 10:10:38.294616 1696 main.go:141] libmachine: () Calling .GetMachineName
I1208 10:10:38.294727 1696 main.go:141] libmachine: (addons-249000) Calling .GetMachineName
I1208 10:10:38.294815 1696 main.go:141] libmachine: (addons-249000) Calling .DriverName
I1208 10:10:38.294917 1696 start.go:159] libmachine.API.Create for "addons-249000" (driver="hyperkit")
I1208 10:10:38.294944 1696 client.go:168] LocalClient.Create starting
I1208 10:10:38.294981 1696 main.go:141] libmachine: Creating CA: /Users/jenkins/minikube-integration/17738-1113/.minikube/certs/ca.pem
I1208 10:10:38.453255 1696 main.go:141] libmachine: Creating client certificate: /Users/jenkins/minikube-integration/17738-1113/.minikube/certs/cert.pem
I1208 10:10:38.513672 1696 main.go:141] libmachine: Running pre-create checks...
I1208 10:10:38.513683 1696 main.go:141] libmachine: (addons-249000) Calling .PreCreateCheck
I1208 10:10:38.513829 1696 main.go:141] libmachine: (addons-249000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1208 10:10:38.514027 1696 main.go:141] libmachine: (addons-249000) Calling .GetConfigRaw
I1208 10:10:38.514430 1696 main.go:141] libmachine: Creating machine...
I1208 10:10:38.514443 1696 main.go:141] libmachine: (addons-249000) Calling .Create
I1208 10:10:38.514530 1696 main.go:141] libmachine: (addons-249000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1208 10:10:38.514690 1696 main.go:141] libmachine: (addons-249000) DBG | I1208 10:10:38.514519 1706 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17738-1113/.minikube
I1208 10:10:38.514766 1696 main.go:141] libmachine: (addons-249000) Downloading /Users/jenkins/minikube-integration/17738-1113/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17738-1113/.minikube/cache/iso/amd64/minikube-v1.32.1-1701996673-17738-amd64.iso...
I1208 10:10:38.719686 1696 main.go:141] libmachine: (addons-249000) DBG | I1208 10:10:38.719602 1706 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/id_rsa...
I1208 10:10:38.929828 1696 main.go:141] libmachine: (addons-249000) DBG | I1208 10:10:38.929743 1706 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/addons-249000.rawdisk...
I1208 10:10:38.929841 1696 main.go:141] libmachine: (addons-249000) DBG | Writing magic tar header
I1208 10:10:38.929850 1696 main.go:141] libmachine: (addons-249000) DBG | Writing SSH key tar header
I1208 10:10:38.930527 1696 main.go:141] libmachine: (addons-249000) DBG | I1208 10:10:38.930486 1706 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000 ...
I1208 10:10:39.256830 1696 main.go:141] libmachine: (addons-249000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1208 10:10:39.256846 1696 main.go:141] libmachine: (addons-249000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/hyperkit.pid
I1208 10:10:39.256884 1696 main.go:141] libmachine: (addons-249000) DBG | Using UUID 172457d8-95f5-11ee-9ca2-f01898ef957c
I1208 10:10:39.491441 1696 main.go:141] libmachine: (addons-249000) DBG | Generated MAC 46:9f:cb:fd:ea:4f
I1208 10:10:39.491466 1696 main.go:141] libmachine: (addons-249000) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=addons-249000
I1208 10:10:39.491502 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:39 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"172457d8-95f5-11ee-9ca2-f01898ef957c", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0001e4210)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/bzimage", Initrd:"/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/initrd", Bootrom:"", CPUs:2, Memory:4000, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Process)(nil)}
I1208 10:10:39.491559 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:39 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"172457d8-95f5-11ee-9ca2-f01898ef957c", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0001e4210)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/bzimage", Initrd:"/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/initrd", Bootrom:"", CPUs:2, Memory:4000, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Process)(nil)}
I1208 10:10:39.491620 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:39 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/hyperkit.pid", "-c", "2", "-m", "4000M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "172457d8-95f5-11ee-9ca2-f01898ef957c", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/addons-249000.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/tty,log=/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/bzimage,/Users/jenkins/minikube-integration/17738-1113/.minikube/machine
s/addons-249000/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=addons-249000"}
I1208 10:10:39.491663 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:39 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/hyperkit.pid -c 2 -m 4000M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U 172457d8-95f5-11ee-9ca2-f01898ef957c -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/addons-249000.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/tty,log=/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/console-ring -f kexec,/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/bzimage,/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/initrd,earlyprintk=serial loglevel=3 console=t
tyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=addons-249000"
I1208 10:10:39.491686 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:39 DEBUG: hyperkit: Redirecting stdout/stderr to logger
I1208 10:10:39.494802 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:39 DEBUG: hyperkit: Pid is 1711
I1208 10:10:39.495236 1696 main.go:141] libmachine: (addons-249000) DBG | Attempt 0
I1208 10:10:39.495253 1696 main.go:141] libmachine: (addons-249000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1208 10:10:39.495358 1696 main.go:141] libmachine: (addons-249000) DBG | hyperkit pid from json: 1711
I1208 10:10:39.496341 1696 main.go:141] libmachine: (addons-249000) DBG | Searching for 46:9f:cb:fd:ea:4f in /var/db/dhcpd_leases ...
I1208 10:10:39.496391 1696 main.go:141] libmachine: (addons-249000) DBG | Found 1 entries in /var/db/dhcpd_leases!
I1208 10:10:39.496408 1696 main.go:141] libmachine: (addons-249000) DBG | dhcp entry: {Name: IPAddress:192.169.0.2 HWAddress:82:2b:f6:5b:7f:bf ID:1,82:2b:f6:5b:7f:bf Lease:0x6574ad53}
I1208 10:10:39.515838 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:39 INFO : hyperkit: stderr: Using fd 5 for I/O notifications
I1208 10:10:39.607676 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:39 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD
I1208 10:10:39.608511 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:39 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I1208 10:10:39.608533 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:39 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I1208 10:10:39.608544 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:39 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I1208 10:10:39.608552 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:39 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I1208 10:10:40.117673 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:40 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0
I1208 10:10:40.117691 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:40 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0
I1208 10:10:40.222702 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:40 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0
I1208 10:10:40.222720 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:40 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0
I1208 10:10:40.222739 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:40 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0
I1208 10:10:40.222750 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:40 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0
I1208 10:10:40.223630 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:40 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1
I1208 10:10:40.223649 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:40 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1
I1208 10:10:41.498973 1696 main.go:141] libmachine: (addons-249000) DBG | Attempt 1
I1208 10:10:41.498990 1696 main.go:141] libmachine: (addons-249000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1208 10:10:41.499047 1696 main.go:141] libmachine: (addons-249000) DBG | hyperkit pid from json: 1711
I1208 10:10:41.499836 1696 main.go:141] libmachine: (addons-249000) DBG | Searching for 46:9f:cb:fd:ea:4f in /var/db/dhcpd_leases ...
I1208 10:10:41.499871 1696 main.go:141] libmachine: (addons-249000) DBG | Found 1 entries in /var/db/dhcpd_leases!
I1208 10:10:41.499882 1696 main.go:141] libmachine: (addons-249000) DBG | dhcp entry: {Name: IPAddress:192.169.0.2 HWAddress:82:2b:f6:5b:7f:bf ID:1,82:2b:f6:5b:7f:bf Lease:0x6574ad53}
I1208 10:10:43.500965 1696 main.go:141] libmachine: (addons-249000) DBG | Attempt 2
I1208 10:10:43.500984 1696 main.go:141] libmachine: (addons-249000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1208 10:10:43.501107 1696 main.go:141] libmachine: (addons-249000) DBG | hyperkit pid from json: 1711
I1208 10:10:43.501895 1696 main.go:141] libmachine: (addons-249000) DBG | Searching for 46:9f:cb:fd:ea:4f in /var/db/dhcpd_leases ...
I1208 10:10:43.501931 1696 main.go:141] libmachine: (addons-249000) DBG | Found 1 entries in /var/db/dhcpd_leases!
I1208 10:10:43.501946 1696 main.go:141] libmachine: (addons-249000) DBG | dhcp entry: {Name: IPAddress:192.169.0.2 HWAddress:82:2b:f6:5b:7f:bf ID:1,82:2b:f6:5b:7f:bf Lease:0x6574ad53}
I1208 10:10:45.177643 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:45 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1
I1208 10:10:45.177673 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:45 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1
I1208 10:10:45.177681 1696 main.go:141] libmachine: (addons-249000) DBG | 2023/12/08 10:10:45 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1
I1208 10:10:45.503733 1696 main.go:141] libmachine: (addons-249000) DBG | Attempt 3
I1208 10:10:45.503755 1696 main.go:141] libmachine: (addons-249000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1208 10:10:45.503844 1696 main.go:141] libmachine: (addons-249000) DBG | hyperkit pid from json: 1711
I1208 10:10:45.504901 1696 main.go:141] libmachine: (addons-249000) DBG | Searching for 46:9f:cb:fd:ea:4f in /var/db/dhcpd_leases ...
I1208 10:10:45.504926 1696 main.go:141] libmachine: (addons-249000) DBG | Found 1 entries in /var/db/dhcpd_leases!
I1208 10:10:45.504944 1696 main.go:141] libmachine: (addons-249000) DBG | dhcp entry: {Name: IPAddress:192.169.0.2 HWAddress:82:2b:f6:5b:7f:bf ID:1,82:2b:f6:5b:7f:bf Lease:0x6574ad53}
I1208 10:10:47.505974 1696 main.go:141] libmachine: (addons-249000) DBG | Attempt 4
I1208 10:10:47.505992 1696 main.go:141] libmachine: (addons-249000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1208 10:10:47.506058 1696 main.go:141] libmachine: (addons-249000) DBG | hyperkit pid from json: 1711
I1208 10:10:47.506827 1696 main.go:141] libmachine: (addons-249000) DBG | Searching for 46:9f:cb:fd:ea:4f in /var/db/dhcpd_leases ...
I1208 10:10:47.506840 1696 main.go:141] libmachine: (addons-249000) DBG | Found 1 entries in /var/db/dhcpd_leases!
I1208 10:10:47.506868 1696 main.go:141] libmachine: (addons-249000) DBG | dhcp entry: {Name: IPAddress:192.169.0.2 HWAddress:82:2b:f6:5b:7f:bf ID:1,82:2b:f6:5b:7f:bf Lease:0x6574ad53}
I1208 10:10:49.508737 1696 main.go:141] libmachine: (addons-249000) DBG | Attempt 5
I1208 10:10:49.508767 1696 main.go:141] libmachine: (addons-249000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1208 10:10:49.508887 1696 main.go:141] libmachine: (addons-249000) DBG | hyperkit pid from json: 1711
I1208 10:10:49.510288 1696 main.go:141] libmachine: (addons-249000) DBG | Searching for 46:9f:cb:fd:ea:4f in /var/db/dhcpd_leases ...
I1208 10:10:49.510340 1696 main.go:141] libmachine: (addons-249000) DBG | Found 2 entries in /var/db/dhcpd_leases!
I1208 10:10:49.510379 1696 main.go:141] libmachine: (addons-249000) DBG | dhcp entry: {Name:minikube IPAddress:192.169.0.3 HWAddress:46:9f:cb:fd:ea:4f ID:1,46:9f:cb:fd:ea:4f Lease:0x6574ada8}
I1208 10:10:49.510421 1696 main.go:141] libmachine: (addons-249000) DBG | Found match: 46:9f:cb:fd:ea:4f
I1208 10:10:49.510447 1696 main.go:141] libmachine: (addons-249000) DBG | IP: 192.169.0.3
I1208 10:10:49.510452 1696 main.go:141] libmachine: (addons-249000) Calling .GetConfigRaw
I1208 10:10:49.511263 1696 main.go:141] libmachine: (addons-249000) Calling .DriverName
I1208 10:10:49.511414 1696 main.go:141] libmachine: (addons-249000) Calling .DriverName
I1208 10:10:49.511565 1696 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...
I1208 10:10:49.511579 1696 main.go:141] libmachine: (addons-249000) Calling .GetState
I1208 10:10:49.511707 1696 main.go:141] libmachine: (addons-249000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I1208 10:10:49.511782 1696 main.go:141] libmachine: (addons-249000) DBG | hyperkit pid from json: 1711
I1208 10:10:49.512805 1696 main.go:141] libmachine: Detecting operating system of created instance...
I1208 10:10:49.512823 1696 main.go:141] libmachine: Waiting for SSH to be available...
I1208 10:10:49.512831 1696 main.go:141] libmachine: Getting to WaitForSSH function...
I1208 10:10:49.512839 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHHostname
I1208 10:10:49.512968 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHPort
I1208 10:10:49.513068 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:49.513169 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:49.513274 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHUsername
I1208 10:10:49.513617 1696 main.go:141] libmachine: Using SSH client type: native
I1208 10:10:49.513889 1696 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406620] 0x1409300 <nil> [] 0s} 192.169.0.3 22 <nil> <nil>}
I1208 10:10:49.513897 1696 main.go:141] libmachine: About to run SSH command:
exit 0
I1208 10:10:49.583545 1696 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1208 10:10:49.583558 1696 main.go:141] libmachine: Detecting the provisioner...
I1208 10:10:49.583564 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHHostname
I1208 10:10:49.583697 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHPort
I1208 10:10:49.583793 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:49.583902 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:49.583997 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHUsername
I1208 10:10:49.584137 1696 main.go:141] libmachine: Using SSH client type: native
I1208 10:10:49.584393 1696 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406620] 0x1409300 <nil> [] 0s} 192.169.0.3 22 <nil> <nil>}
I1208 10:10:49.584401 1696 main.go:141] libmachine: About to run SSH command:
cat /etc/os-release
I1208 10:10:49.653822 1696 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot
VERSION=2021.02.12-1-g0ec83c8-dirty
ID=buildroot
VERSION_ID=2021.02.12
PRETTY_NAME="Buildroot 2021.02.12"
I1208 10:10:49.653878 1696 main.go:141] libmachine: found compatible host: buildroot
I1208 10:10:49.653885 1696 main.go:141] libmachine: Provisioning with buildroot...
I1208 10:10:49.653891 1696 main.go:141] libmachine: (addons-249000) Calling .GetMachineName
I1208 10:10:49.654025 1696 buildroot.go:166] provisioning hostname "addons-249000"
I1208 10:10:49.654036 1696 main.go:141] libmachine: (addons-249000) Calling .GetMachineName
I1208 10:10:49.654122 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHHostname
I1208 10:10:49.654202 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHPort
I1208 10:10:49.654302 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:49.654392 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:49.654476 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHUsername
I1208 10:10:49.654631 1696 main.go:141] libmachine: Using SSH client type: native
I1208 10:10:49.654871 1696 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406620] 0x1409300 <nil> [] 0s} 192.169.0.3 22 <nil> <nil>}
I1208 10:10:49.654881 1696 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-249000 && echo "addons-249000" | sudo tee /etc/hostname
I1208 10:10:49.733526 1696 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-249000
I1208 10:10:49.733551 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHHostname
I1208 10:10:49.733680 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHPort
I1208 10:10:49.733772 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:49.733859 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:49.733961 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHUsername
I1208 10:10:49.734079 1696 main.go:141] libmachine: Using SSH client type: native
I1208 10:10:49.734328 1696 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406620] 0x1409300 <nil> [] 0s} 192.169.0.3 22 <nil> <nil>}
I1208 10:10:49.734340 1696 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-249000' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-249000/g' /etc/hosts;
else
echo '127.0.1.1 addons-249000' | sudo tee -a /etc/hosts;
fi
fi
I1208 10:10:49.807589 1696 main.go:141] libmachine: SSH cmd err, output: <nil>:
I1208 10:10:49.807609 1696 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17738-1113/.minikube CaCertPath:/Users/jenkins/minikube-integration/17738-1113/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17738-1113/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17738-1113/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17738-1113/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17738-1113/.minikube}
I1208 10:10:49.807633 1696 buildroot.go:174] setting up certificates
I1208 10:10:49.807645 1696 provision.go:83] configureAuth start
I1208 10:10:49.807652 1696 main.go:141] libmachine: (addons-249000) Calling .GetMachineName
I1208 10:10:49.807789 1696 main.go:141] libmachine: (addons-249000) Calling .GetIP
I1208 10:10:49.807880 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHHostname
I1208 10:10:49.807969 1696 provision.go:138] copyHostCerts
I1208 10:10:49.808058 1696 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17738-1113/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17738-1113/.minikube/cert.pem (1123 bytes)
I1208 10:10:49.808328 1696 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17738-1113/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17738-1113/.minikube/key.pem (1679 bytes)
I1208 10:10:49.808530 1696 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17738-1113/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17738-1113/.minikube/ca.pem (1078 bytes)
I1208 10:10:49.808681 1696 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17738-1113/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17738-1113/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17738-1113/.minikube/certs/ca-key.pem org=jenkins.addons-249000 san=[192.169.0.3 192.169.0.3 localhost 127.0.0.1 minikube addons-249000]
I1208 10:10:49.902398 1696 provision.go:172] copyRemoteCerts
I1208 10:10:49.902465 1696 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1208 10:10:49.902481 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHHostname
I1208 10:10:49.902623 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHPort
I1208 10:10:49.902718 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:49.902836 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHUsername
I1208 10:10:49.902925 1696 sshutil.go:53] new ssh client: &{IP:192.169.0.3 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/id_rsa Username:docker}
I1208 10:10:49.943321 1696 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17738-1113/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1208 10:10:49.958999 1696 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17738-1113/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1208 10:10:49.974604 1696 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17738-1113/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
I1208 10:10:49.990091 1696 provision.go:86] duration metric: configureAuth took 182.387495ms
I1208 10:10:49.990104 1696 buildroot.go:189] setting minikube options for container-runtime
I1208 10:10:49.990239 1696 config.go:182] Loaded profile config "addons-249000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I1208 10:10:49.990252 1696 main.go:141] libmachine: (addons-249000) Calling .DriverName
I1208 10:10:49.990386 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHHostname
I1208 10:10:49.990477 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHPort
I1208 10:10:49.990562 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:49.990638 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:49.990727 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHUsername
I1208 10:10:49.990837 1696 main.go:141] libmachine: Using SSH client type: native
I1208 10:10:49.991072 1696 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406620] 0x1409300 <nil> [] 0s} 192.169.0.3 22 <nil> <nil>}
I1208 10:10:49.991082 1696 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I1208 10:10:50.061707 1696 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I1208 10:10:50.061719 1696 buildroot.go:70] root file system type: tmpfs
I1208 10:10:50.061798 1696 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I1208 10:10:50.061811 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHHostname
I1208 10:10:50.061950 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHPort
I1208 10:10:50.062046 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:50.062148 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:50.062243 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHUsername
I1208 10:10:50.062383 1696 main.go:141] libmachine: Using SSH client type: native
I1208 10:10:50.062635 1696 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406620] 0x1409300 <nil> [] 0s} 192.169.0.3 22 <nil> <nil>}
I1208 10:10:50.062682 1696 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I1208 10:10:50.142705 1696 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I1208 10:10:50.142725 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHHostname
I1208 10:10:50.142883 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHPort
I1208 10:10:50.142989 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:50.143098 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:50.143187 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHUsername
I1208 10:10:50.143318 1696 main.go:141] libmachine: Using SSH client type: native
I1208 10:10:50.143559 1696 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406620] 0x1409300 <nil> [] 0s} 192.169.0.3 22 <nil> <nil>}
I1208 10:10:50.143572 1696 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I1208 10:10:50.622884 1696 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I1208 10:10:50.622899 1696 main.go:141] libmachine: Checking connection to Docker...
I1208 10:10:50.622906 1696 main.go:141] libmachine: (addons-249000) Calling .GetURL
I1208 10:10:50.623049 1696 main.go:141] libmachine: Docker is up and running!
I1208 10:10:50.623062 1696 main.go:141] libmachine: Reticulating splines...
I1208 10:10:50.623066 1696 client.go:171] LocalClient.Create took 12.323605108s
I1208 10:10:50.623079 1696 start.go:167] duration metric: libmachine.API.Create for "addons-249000" took 12.323650103s
I1208 10:10:50.623088 1696 start.go:300] post-start starting for "addons-249000" (driver="hyperkit")
I1208 10:10:50.623098 1696 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1208 10:10:50.623108 1696 main.go:141] libmachine: (addons-249000) Calling .DriverName
I1208 10:10:50.623260 1696 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1208 10:10:50.623273 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHHostname
I1208 10:10:50.623357 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHPort
I1208 10:10:50.623446 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:50.623541 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHUsername
I1208 10:10:50.623625 1696 sshutil.go:53] new ssh client: &{IP:192.169.0.3 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/id_rsa Username:docker}
I1208 10:10:50.664246 1696 ssh_runner.go:195] Run: cat /etc/os-release
I1208 10:10:50.666931 1696 info.go:137] Remote host: Buildroot 2021.02.12
I1208 10:10:50.666945 1696 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17738-1113/.minikube/addons for local assets ...
I1208 10:10:50.667065 1696 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17738-1113/.minikube/files for local assets ...
I1208 10:10:50.667113 1696 start.go:303] post-start completed in 44.007889ms
I1208 10:10:50.667131 1696 main.go:141] libmachine: (addons-249000) Calling .GetConfigRaw
I1208 10:10:50.667679 1696 main.go:141] libmachine: (addons-249000) Calling .GetIP
I1208 10:10:50.667811 1696 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17738-1113/.minikube/profiles/addons-249000/config.json ...
I1208 10:10:50.668153 1696 start.go:128] duration metric: createHost completed in 12.42091574s
I1208 10:10:50.668168 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHHostname
I1208 10:10:50.668256 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHPort
I1208 10:10:50.668350 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:50.668425 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:50.668493 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHUsername
I1208 10:10:50.668587 1696 main.go:141] libmachine: Using SSH client type: native
I1208 10:10:50.668819 1696 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1406620] 0x1409300 <nil> [] 0s} 192.169.0.3 22 <nil> <nil>}
I1208 10:10:50.668826 1696 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I1208 10:10:50.737882 1696 main.go:141] libmachine: SSH cmd err, output: <nil>: 1702059050.627383625
I1208 10:10:50.737894 1696 fix.go:206] guest clock: 1702059050.627383625
I1208 10:10:50.737900 1696 fix.go:219] Guest: 2023-12-08 10:10:50.627383625 -0800 PST Remote: 2023-12-08 10:10:50.668163 -0800 PST m=+12.832628634 (delta=-40.779375ms)
I1208 10:10:50.737922 1696 fix.go:190] guest clock delta is within tolerance: -40.779375ms
I1208 10:10:50.737926 1696 start.go:83] releasing machines lock for "addons-249000", held for 12.490805354s
I1208 10:10:50.737944 1696 main.go:141] libmachine: (addons-249000) Calling .DriverName
I1208 10:10:50.738072 1696 main.go:141] libmachine: (addons-249000) Calling .GetIP
I1208 10:10:50.738152 1696 main.go:141] libmachine: (addons-249000) Calling .DriverName
I1208 10:10:50.738465 1696 main.go:141] libmachine: (addons-249000) Calling .DriverName
I1208 10:10:50.738574 1696 main.go:141] libmachine: (addons-249000) Calling .DriverName
I1208 10:10:50.738655 1696 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1208 10:10:50.738682 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHHostname
I1208 10:10:50.738711 1696 ssh_runner.go:195] Run: cat /version.json
I1208 10:10:50.738747 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHHostname
I1208 10:10:50.738793 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHPort
I1208 10:10:50.738857 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHPort
I1208 10:10:50.738884 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:50.738934 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHKeyPath
I1208 10:10:50.738993 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHUsername
I1208 10:10:50.739018 1696 main.go:141] libmachine: (addons-249000) Calling .GetSSHUsername
I1208 10:10:50.739070 1696 sshutil.go:53] new ssh client: &{IP:192.169.0.3 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/id_rsa Username:docker}
I1208 10:10:50.739095 1696 sshutil.go:53] new ssh client: &{IP:192.169.0.3 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17738-1113/.minikube/machines/addons-249000/id_rsa Username:docker}
I1208 10:10:50.844518 1696 ssh_runner.go:195] Run: systemctl --version
I1208 10:10:50.848730 1696 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1208 10:10:50.852258 1696 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1208 10:10:50.852298 1696 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1208 10:10:50.861977 1696 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I1208 10:10:50.861994 1696 start.go:475] detecting cgroup driver to use...
I1208 10:10:50.862086 1696 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1208 10:10:50.874776 1696 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I1208 10:10:50.881058 1696 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1208 10:10:50.887289 1696 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I1208 10:10:50.887331 1696 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I1208 10:10:50.893595 1696 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1208 10:10:50.900083 1696 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1208 10:10:50.906336 1696 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1208 10:10:50.912550 1696 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1208 10:10:50.918867 1696 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1208 10:10:50.925121 1696 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1208 10:10:50.930728 1696 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1208 10:10:50.936333 1696 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1208 10:10:51.018422 1696 ssh_runner.go:195] Run: sudo systemctl restart containerd
I1208 10:10:51.031211 1696 start.go:475] detecting cgroup driver to use...
I1208 10:10:51.031282 1696 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I1208 10:10:51.041977 1696 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1208 10:10:51.052848 1696 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1208 10:10:51.065216 1696 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1208 10:10:51.074166 1696 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1208 10:10:51.082968 1696 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I1208 10:10:51.103961 1696 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I1208 10:10:51.113536 1696 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I1208 10:10:51.126051 1696 ssh_runner.go:195] Run: which cri-dockerd
I1208 10:10:51.128469 1696 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I1208 10:10:51.133946 1696 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I1208 10:10:51.144941 1696 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I1208 10:10:51.227349 1696 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I1208 10:10:51.310253 1696 docker.go:560] configuring docker to use "cgroupfs" as cgroup driver...
I1208 10:10:51.310327 1696 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I1208 10:10:51.320685 1696 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1208 10:10:51.404868 1696 ssh_runner.go:195] Run: sudo systemctl restart docker
I1208 10:10:52.636470 1696 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.231310829s)
I1208 10:10:52.636552 1696 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I1208 10:10:52.717726 1696 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I1208 10:10:52.810158 1696 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I1208 10:10:52.903786 1696 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1208 10:10:52.999638 1696 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I1208 10:10:53.011002 1696 ssh_runner.go:195] Run: sudo journalctl --no-pager -u cri-docker.socket
I1208 10:10:53.039510 1696 out.go:177]
W1208 10:10:53.064311 1696 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart cri-docker.socket: Process exited with status 1
stdout:
stderr:
Job failed. See "journalctl -xe" for details.
sudo journalctl --no-pager -u cri-docker.socket:
-- stdout --
-- Journal begins at Fri 2023-12-08 18:10:47 UTC, ends at Fri 2023-12-08 18:10:52 UTC. --
Dec 08 18:10:48 minikube systemd[1]: Starting CRI Docker Socket for the API.
Dec 08 18:10:48 minikube systemd[1]: Listening on CRI Docker Socket for the API.
Dec 08 18:10:50 addons-249000 systemd[1]: cri-docker.socket: Succeeded.
Dec 08 18:10:50 addons-249000 systemd[1]: Closed CRI Docker Socket for the API.
Dec 08 18:10:50 addons-249000 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 08 18:10:50 addons-249000 systemd[1]: Starting CRI Docker Socket for the API.
Dec 08 18:10:50 addons-249000 systemd[1]: Listening on CRI Docker Socket for the API.
Dec 08 18:10:52 addons-249000 systemd[1]: cri-docker.socket: Succeeded.
Dec 08 18:10:52 addons-249000 systemd[1]: Closed CRI Docker Socket for the API.
Dec 08 18:10:52 addons-249000 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 08 18:10:52 addons-249000 systemd[1]: cri-docker.socket: Socket service cri-docker.service already active, refusing.
Dec 08 18:10:52 addons-249000 systemd[1]: Failed to listen on CRI Docker Socket for the API.
-- /stdout --
X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart cri-docker.socket: Process exited with status 1
stdout:
stderr:
Job failed. See "journalctl -xe" for details.
sudo journalctl --no-pager -u cri-docker.socket:
-- stdout --
-- Journal begins at Fri 2023-12-08 18:10:47 UTC, ends at Fri 2023-12-08 18:10:52 UTC. --
Dec 08 18:10:48 minikube systemd[1]: Starting CRI Docker Socket for the API.
Dec 08 18:10:48 minikube systemd[1]: Listening on CRI Docker Socket for the API.
Dec 08 18:10:50 addons-249000 systemd[1]: cri-docker.socket: Succeeded.
Dec 08 18:10:50 addons-249000 systemd[1]: Closed CRI Docker Socket for the API.
Dec 08 18:10:50 addons-249000 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 08 18:10:50 addons-249000 systemd[1]: Starting CRI Docker Socket for the API.
Dec 08 18:10:50 addons-249000 systemd[1]: Listening on CRI Docker Socket for the API.
Dec 08 18:10:52 addons-249000 systemd[1]: cri-docker.socket: Succeeded.
Dec 08 18:10:52 addons-249000 systemd[1]: Closed CRI Docker Socket for the API.
Dec 08 18:10:52 addons-249000 systemd[1]: Stopping CRI Docker Socket for the API.
Dec 08 18:10:52 addons-249000 systemd[1]: cri-docker.socket: Socket service cri-docker.service already active, refusing.
Dec 08 18:10:52 addons-249000 systemd[1]: Failed to listen on CRI Docker Socket for the API.
-- /stdout --
W1208 10:10:53.064347 1696 out.go:239] *
*
W1208 10:10:53.065545 1696 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I1208 10:10:53.128350 1696 out.go:177]
** /stderr **
addons_test.go:111: out/minikube-darwin-amd64 start -p addons-249000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --driver=hyperkit --addons=ingress --addons=ingress-dns --addons=helm-tiller failed: exit status 90
--- FAIL: TestAddons/Setup (15.35s)