=== RUN TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run: out/minikube-windows-amd64.exe start -p newest-cni-048300 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperv --kubernetes-version=v1.26.1
E0128 05:19:50.549322 4452 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube5\minikube-integration\.minikube\profiles\functional-857600\client.crt: The system cannot find the path specified.
=== CONT TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p newest-cni-048300 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperv --kubernetes-version=v1.26.1: exit status 90 (2m2.3769641s)
-- stdout --
* [newest-cni-048300] minikube v1.28.0 on Microsoft Windows 10 Enterprise N 10.0.19045.2486 Build 19045.2486
- KUBECONFIG=C:\Users\jenkins.minikube5\minikube-integration\kubeconfig
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=C:\Users\jenkins.minikube5\minikube-integration\.minikube
- MINIKUBE_LOCATION=15565
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
* Using the hyperv driver based on existing profile
* Starting control plane node newest-cni-048300 in cluster newest-cni-048300
* Restarting existing hyperv VM for "newest-cni-048300" ...
-- /stdout --
** stderr **
I0128 05:19:29.868390 9516 out.go:296] Setting OutFile to fd 1668 ...
I0128 05:19:29.911350 9516 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0128 05:19:29.911350 9516 out.go:309] Setting ErrFile to fd 1588...
I0128 05:19:29.911431 9516 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0128 05:19:29.926956 9516 out.go:303] Setting JSON to false
I0128 05:19:29.929764 9516 start.go:125] hostinfo: {"hostname":"minikube5","uptime":13307,"bootTime":1674869862,"procs":155,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19045.2486 Build 19045.2486","kernelVersion":"10.0.19045.2486 Build 19045.2486","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b047c2aa-b84e-4b82-894c-ed46f3580f4d"}
W0128 05:19:29.929764 9516 start.go:133] gopshost.Virtualization returned error: not implemented yet
I0128 05:19:29.986309 9516 out.go:177] * [newest-cni-048300] minikube v1.28.0 on Microsoft Windows 10 Enterprise N 10.0.19045.2486 Build 19045.2486
I0128 05:19:30.188982 9516 notify.go:220] Checking for updates...
I0128 05:19:30.200523 9516 out.go:177] - KUBECONFIG=C:\Users\jenkins.minikube5\minikube-integration\kubeconfig
I0128 05:19:30.393301 9516 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0128 05:19:30.542526 9516 out.go:177] - MINIKUBE_HOME=C:\Users\jenkins.minikube5\minikube-integration\.minikube
I0128 05:19:30.732634 9516 out.go:177] - MINIKUBE_LOCATION=15565
I0128 05:19:31.013989 9516 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0128 05:19:31.053123 9516 config.go:180] Loaded profile config "newest-cni-048300": Driver=hyperv, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0128 05:19:31.053715 9516 driver.go:365] Setting default libvirt URI to qemu:///system
I0128 05:19:32.786461 9516 out.go:177] * Using the hyperv driver based on existing profile
I0128 05:19:32.847074 9516 start.go:296] selected driver: hyperv
I0128 05:19:32.847074 9516 start.go:840] validating driver "hyperv" against &{Name:newest-cni-048300 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperv HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo
nfig:{KubernetesVersion:v1.26.1 ClusterName:newest-cni-048300 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:172.27.43.164 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false
system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube5:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}
I0128 05:19:32.847074 9516 start.go:851] status for hyperv: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0128 05:19:32.891616 9516 start_flags.go:936] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I0128 05:19:32.891616 9516 cni.go:84] Creating CNI manager for ""
I0128 05:19:32.891616 9516 cni.go:157] "hyperv" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0128 05:19:32.891616 9516 start_flags.go:319] config:
{Name:newest-cni-048300 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/15565/minikube-v1.29.0-1674856271-15565-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.36-1674164627-15541@sha256:0a2280301e955e0d3910d6e639e0b7341db1f4a25558521ac97b38c782c6189a Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperv HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.26.1 ClusterName:newest-cni-048300 Namespace:default
APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:172.27.43.164 Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] List
enAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube5:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP:}
I0128 05:19:32.891616 9516 iso.go:125] acquiring lock: {Name:mk0f37b195a216ba04643a1835cb6040e6739db2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0128 05:19:32.945606 9516 out.go:177] * Starting control plane node newest-cni-048300 in cluster newest-cni-048300
I0128 05:19:32.947598 9516 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0128 05:19:32.947598 9516 preload.go:148] Found local preload: C:\Users\jenkins.minikube5\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4
I0128 05:19:32.948599 9516 cache.go:57] Caching tarball of preloaded images
I0128 05:19:32.948599 9516 preload.go:174] Found C:\Users\jenkins.minikube5\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.26.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0128 05:19:32.948599 9516 cache.go:60] Finished verifying existence of preloaded tar for v1.26.1 on docker
I0128 05:19:32.948599 9516 profile.go:148] Saving config to C:\Users\jenkins.minikube5\minikube-integration\.minikube\profiles\newest-cni-048300\config.json ...
I0128 05:19:32.950604 9516 cache.go:193] Successfully downloaded all kic artifacts
I0128 05:19:32.950604 9516 start.go:364] acquiring machines lock for newest-cni-048300: {Name:mkcc4972200741852cdd82af2325146d8aedcde8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0128 05:19:32.950604 9516 start.go:368] acquired machines lock for "newest-cni-048300" in 0s
I0128 05:19:32.950604 9516 start.go:96] Skipping create...Using existing machine configuration
I0128 05:19:32.950604 9516 fix.go:55] fixHost starting:
I0128 05:19:32.950604 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:19:33.633505 9516 main.go:141] libmachine: [stdout =====>] : Off
I0128 05:19:33.633505 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:33.633505 9516 fix.go:103] recreateIfNeeded on newest-cni-048300: state=Stopped err=<nil>
W0128 05:19:33.634078 9516 fix.go:129] unexpected machine state, will restart: <nil>
I0128 05:19:33.649174 9516 out.go:177] * Restarting existing hyperv VM for "newest-cni-048300" ...
I0128 05:19:33.736167 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive Hyper-V\Start-VM newest-cni-048300
I0128 05:19:39.559707 9516 main.go:141] libmachine: [stdout =====>] :
I0128 05:19:39.559707 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:39.559707 9516 main.go:141] libmachine: Waiting for host to start...
I0128 05:19:39.559707 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:19:40.212301 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:19:40.212301 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:40.212690 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:19:41.142340 9516 main.go:141] libmachine: [stdout =====>] :
I0128 05:19:41.142435 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:42.144617 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:19:42.794235 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:19:42.794549 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:42.794549 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:19:43.713493 9516 main.go:141] libmachine: [stdout =====>] :
I0128 05:19:43.713538 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:44.728737 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:19:45.379789 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:19:45.379845 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:45.379915 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:19:46.268153 9516 main.go:141] libmachine: [stdout =====>] :
I0128 05:19:46.268153 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:47.278598 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:19:47.928323 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:19:47.928408 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:47.928515 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:19:48.836257 9516 main.go:141] libmachine: [stdout =====>] :
I0128 05:19:48.836437 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:49.848813 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:19:50.502251 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:19:50.502251 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:50.502251 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:19:51.421496 9516 main.go:141] libmachine: [stdout =====>] :
I0128 05:19:51.421535 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:52.432435 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:19:53.109230 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:19:53.109296 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:53.109296 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:19:54.043374 9516 main.go:141] libmachine: [stdout =====>] :
I0128 05:19:54.043531 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:55.058081 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:19:55.754860 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:19:55.754860 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:55.755184 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:19:56.739207 9516 main.go:141] libmachine: [stdout =====>] :
I0128 05:19:56.739207 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:57.750536 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:19:58.418228 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:19:58.418228 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:19:58.418228 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:19:59.378239 9516 main.go:141] libmachine: [stdout =====>] :
I0128 05:19:59.378239 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:00.389149 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:01.063627 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:01.063627 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:01.063627 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:02.072118 9516 main.go:141] libmachine: [stdout =====>] :
I0128 05:20:02.072118 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:03.080563 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:03.771085 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:03.771156 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:03.771370 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:04.898471 9516 main.go:141] libmachine: [stdout =====>] : 172.27.32.162
I0128 05:20:04.898570 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:04.900534 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:05.563294 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:05.563294 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:05.563294 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:06.482071 9516 main.go:141] libmachine: [stdout =====>] : 172.27.32.162
I0128 05:20:06.482071 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:06.482244 9516 profile.go:148] Saving config to C:\Users\jenkins.minikube5\minikube-integration\.minikube\profiles\newest-cni-048300\config.json ...
I0128 05:20:06.484458 9516 machine.go:88] provisioning docker machine ...
I0128 05:20:06.484500 9516 buildroot.go:166] provisioning hostname "newest-cni-048300"
I0128 05:20:06.484591 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:07.148157 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:07.148213 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:07.148213 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:08.047103 9516 main.go:141] libmachine: [stdout =====>] : 172.27.32.162
I0128 05:20:08.047103 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:08.050625 9516 main.go:141] libmachine: Using SSH client type: native
I0128 05:20:08.050897 9516 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x63fbc0] 0x642b40 <nil> [] 0s} 172.27.32.162 22 <nil> <nil>}
I0128 05:20:08.051126 9516 main.go:141] libmachine: About to run SSH command:
sudo hostname newest-cni-048300 && echo "newest-cni-048300" | sudo tee /etc/hostname
I0128 05:20:08.216731 9516 main.go:141] libmachine: SSH cmd err, output: <nil>: newest-cni-048300
I0128 05:20:08.216812 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:08.854612 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:08.854688 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:08.854804 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:09.765398 9516 main.go:141] libmachine: [stdout =====>] : 172.27.32.162
I0128 05:20:09.765398 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:09.768557 9516 main.go:141] libmachine: Using SSH client type: native
I0128 05:20:09.768929 9516 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x63fbc0] 0x642b40 <nil> [] 0s} 172.27.32.162 22 <nil> <nil>}
I0128 05:20:09.768929 9516 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\snewest-cni-048300' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 newest-cni-048300/g' /etc/hosts;
else
echo '127.0.1.1 newest-cni-048300' | sudo tee -a /etc/hosts;
fi
fi
I0128 05:20:09.925932 9516 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0128 05:20:09.925932 9516 buildroot.go:172] set auth options {CertDir:C:\Users\jenkins.minikube5\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube5\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube5\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube5\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube5\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube5\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube5\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube5\minikube-integration\.minikube}
I0128 05:20:09.925932 9516 buildroot.go:174] setting up certificates
I0128 05:20:09.925932 9516 provision.go:83] configureAuth start
I0128 05:20:09.925932 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:10.582632 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:10.582752 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:10.582752 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:11.529636 9516 main.go:141] libmachine: [stdout =====>] : 172.27.32.162
I0128 05:20:11.529636 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:11.529733 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:12.208804 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:12.208804 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:12.208804 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:13.176320 9516 main.go:141] libmachine: [stdout =====>] : 172.27.32.162
I0128 05:20:13.176320 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:13.176424 9516 provision.go:138] copyHostCerts
I0128 05:20:13.176727 9516 exec_runner.go:144] found C:\Users\jenkins.minikube5\minikube-integration\.minikube/ca.pem, removing ...
I0128 05:20:13.176818 9516 exec_runner.go:207] rm: C:\Users\jenkins.minikube5\minikube-integration\.minikube\ca.pem
I0128 05:20:13.177105 9516 exec_runner.go:151] cp: C:\Users\jenkins.minikube5\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube5\minikube-integration\.minikube/ca.pem (1082 bytes)
I0128 05:20:13.178616 9516 exec_runner.go:144] found C:\Users\jenkins.minikube5\minikube-integration\.minikube/cert.pem, removing ...
I0128 05:20:13.178698 9516 exec_runner.go:207] rm: C:\Users\jenkins.minikube5\minikube-integration\.minikube\cert.pem
I0128 05:20:13.178698 9516 exec_runner.go:151] cp: C:\Users\jenkins.minikube5\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube5\minikube-integration\.minikube/cert.pem (1123 bytes)
I0128 05:20:13.180106 9516 exec_runner.go:144] found C:\Users\jenkins.minikube5\minikube-integration\.minikube/key.pem, removing ...
I0128 05:20:13.180106 9516 exec_runner.go:207] rm: C:\Users\jenkins.minikube5\minikube-integration\.minikube\key.pem
I0128 05:20:13.180474 9516 exec_runner.go:151] cp: C:\Users\jenkins.minikube5\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube5\minikube-integration\.minikube/key.pem (1675 bytes)
I0128 05:20:13.181288 9516 provision.go:112] generating server cert: C:\Users\jenkins.minikube5\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube5\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube5\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.newest-cni-048300 san=[172.27.32.162 172.27.32.162 localhost 127.0.0.1 minikube newest-cni-048300]
I0128 05:20:13.520055 9516 provision.go:172] copyRemoteCerts
I0128 05:20:13.526809 9516 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0128 05:20:13.526809 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:14.229484 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:14.229584 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:14.229584 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:15.204832 9516 main.go:141] libmachine: [stdout =====>] : 172.27.32.162
I0128 05:20:15.205037 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:15.205503 9516 sshutil.go:53] new ssh client: &{IP:172.27.32.162 Port:22 SSHKeyPath:C:\Users\jenkins.minikube5\minikube-integration\.minikube\machines\newest-cni-048300\id_rsa Username:docker}
I0128 05:20:15.313189 9516 ssh_runner.go:235] Completed: sudo mkdir -p /etc/docker /etc/docker /etc/docker: (1.786284s)
I0128 05:20:15.313760 9516 ssh_runner.go:362] scp C:\Users\jenkins.minikube5\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0128 05:20:15.352264 9516 ssh_runner.go:362] scp C:\Users\jenkins.minikube5\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1229 bytes)
I0128 05:20:15.393795 9516 ssh_runner.go:362] scp C:\Users\jenkins.minikube5\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0128 05:20:15.437785 9516 provision.go:86] duration metric: configureAuth took 5.5115546s
I0128 05:20:15.438347 9516 buildroot.go:189] setting minikube options for container-runtime
I0128 05:20:15.438347 9516 config.go:180] Loaded profile config "newest-cni-048300": Driver=hyperv, ContainerRuntime=docker, KubernetesVersion=v1.26.1
I0128 05:20:15.439056 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:16.098998 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:16.099130 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:16.099130 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:17.026673 9516 main.go:141] libmachine: [stdout =====>] : 172.27.32.162
I0128 05:20:17.026673 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:17.030279 9516 main.go:141] libmachine: Using SSH client type: native
I0128 05:20:17.030999 9516 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x63fbc0] 0x642b40 <nil> [] 0s} 172.27.32.162 22 <nil> <nil>}
I0128 05:20:17.030999 9516 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0128 05:20:17.179433 9516 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I0128 05:20:17.179433 9516 buildroot.go:70] root file system type: tmpfs
I0128 05:20:17.180207 9516 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0128 05:20:17.180271 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:17.861874 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:17.862027 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:17.862027 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:18.795691 9516 main.go:141] libmachine: [stdout =====>] : 172.27.32.162
I0128 05:20:18.795691 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:18.798687 9516 main.go:141] libmachine: Using SSH client type: native
I0128 05:20:18.798985 9516 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x63fbc0] 0x642b40 <nil> [] 0s} 172.27.32.162 22 <nil> <nil>}
I0128 05:20:18.798985 9516 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperv --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0128 05:20:18.967420 9516 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperv --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0128 05:20:18.967420 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:19.648136 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:19.648366 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:19.648366 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:20.600487 9516 main.go:141] libmachine: [stdout =====>] : 172.27.32.162
I0128 05:20:20.600487 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:20.603830 9516 main.go:141] libmachine: Using SSH client type: native
I0128 05:20:20.604165 9516 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x63fbc0] 0x642b40 <nil> [] 0s} 172.27.32.162 22 <nil> <nil>}
I0128 05:20:20.604165 9516 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0128 05:20:22.059051 9516 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.
I0128 05:20:22.059051 9516 machine.go:91] provisioned docker machine in 15.573709s
I0128 05:20:22.059051 9516 start.go:300] post-start starting for "newest-cni-048300" (driver="hyperv")
I0128 05:20:22.059051 9516 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0128 05:20:22.067331 9516 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0128 05:20:22.067331 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:22.703695 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:22.703695 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:22.703695 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:23.731387 9516 main.go:141] libmachine: [stdout =====>] : 172.27.32.162
I0128 05:20:23.731415 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:23.731767 9516 sshutil.go:53] new ssh client: &{IP:172.27.32.162 Port:22 SSHKeyPath:C:\Users\jenkins.minikube5\minikube-integration\.minikube\machines\newest-cni-048300\id_rsa Username:docker}
I0128 05:20:23.868608 9516 ssh_runner.go:235] Completed: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs: (1.8011791s)
I0128 05:20:23.876435 9516 ssh_runner.go:195] Run: cat /etc/os-release
I0128 05:20:23.884535 9516 info.go:137] Remote host: Buildroot 2021.02.12
I0128 05:20:23.884600 9516 filesync.go:126] Scanning C:\Users\jenkins.minikube5\minikube-integration\.minikube\addons for local assets ...
I0128 05:20:23.884879 9516 filesync.go:126] Scanning C:\Users\jenkins.minikube5\minikube-integration\.minikube\files for local assets ...
I0128 05:20:23.885536 9516 filesync.go:149] local asset: C:\Users\jenkins.minikube5\minikube-integration\.minikube\files\etc\ssl\certs\44522.pem -> 44522.pem in /etc/ssl/certs
I0128 05:20:23.894607 9516 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0128 05:20:23.913678 9516 ssh_runner.go:362] scp C:\Users\jenkins.minikube5\minikube-integration\.minikube\files\etc\ssl\certs\44522.pem --> /etc/ssl/certs/44522.pem (1708 bytes)
I0128 05:20:23.956149 9516 start.go:303] post-start completed in 1.8969954s
I0128 05:20:23.956149 9516 fix.go:57] fixHost completed within 51.002789s
I0128 05:20:23.956149 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:24.616763 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:24.616763 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:24.616857 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:25.549133 9516 main.go:141] libmachine: [stdout =====>] : 172.27.32.162
I0128 05:20:25.549503 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:25.553633 9516 main.go:141] libmachine: Using SSH client type: native
I0128 05:20:25.554079 9516 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x63fbc0] 0x642b40 <nil> [] 0s} 172.27.32.162 22 <nil> <nil>}
I0128 05:20:25.554079 9516 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0128 05:20:25.699942 9516 main.go:141] libmachine: SSH cmd err, output: <nil>: 1674883225.829014753
I0128 05:20:25.699942 9516 fix.go:207] guest clock: 1674883225.829014753
I0128 05:20:25.699942 9516 fix.go:220] Guest: 2023-01-28 05:20:25.829014753 +0000 GMT Remote: 2023-01-28 05:20:23.9561493 +0000 GMT m=+54.307248801 (delta=1.872865453s)
I0128 05:20:25.699942 9516 fix.go:191] guest clock delta is within tolerance: 1.872865453s
I0128 05:20:25.699942 9516 start.go:83] releasing machines lock for "newest-cni-048300", held for 52.746488s
I0128 05:20:25.699942 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:26.383158 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:26.383158 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:26.383158 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:27.329452 9516 main.go:141] libmachine: [stdout =====>] : 172.27.32.162
I0128 05:20:27.329597 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:27.331283 9516 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0128 05:20:27.331283 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:27.337273 9516 ssh_runner.go:195] Run: cat /version.json
I0128 05:20:27.337273 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM newest-cni-048300 ).state
I0128 05:20:28.013303 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:28.013617 9516 main.go:141] libmachine: [stdout =====>] : Running
I0128 05:20:28.013617 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:28.013617 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:28.013617 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:28.013617 9516 main.go:141] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM newest-cni-048300 ).networkadapters[0]).ipaddresses[0]
I0128 05:20:29.061820 9516 main.go:141] libmachine: [stdout =====>] : 172.27.32.162
I0128 05:20:29.061869 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:29.062351 9516 sshutil.go:53] new ssh client: &{IP:172.27.32.162 Port:22 SSHKeyPath:C:\Users\jenkins.minikube5\minikube-integration\.minikube\machines\newest-cni-048300\id_rsa Username:docker}
I0128 05:20:29.083356 9516 main.go:141] libmachine: [stdout =====>] : 172.27.32.162
I0128 05:20:29.083356 9516 main.go:141] libmachine: [stderr =====>] :
I0128 05:20:29.083716 9516 sshutil.go:53] new ssh client: &{IP:172.27.32.162 Port:22 SSHKeyPath:C:\Users\jenkins.minikube5\minikube-integration\.minikube\machines\newest-cni-048300\id_rsa Username:docker}
I0128 05:20:29.239700 9516 ssh_runner.go:235] Completed: curl -sS -m 2 https://registry.k8s.io/: (1.908314s)
I0128 05:20:29.239700 9516 ssh_runner.go:235] Completed: cat /version.json: (1.9023243s)
W0128 05:20:29.239700 9516 out.go:239] ! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0-1674856271-15565 -> Actual minikube version: v1.28.0
! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.29.0-1674856271-15565 -> Actual minikube version: v1.28.0
I0128 05:20:29.248298 9516 ssh_runner.go:195] Run: systemctl --version
I0128 05:20:29.266375 9516 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W0128 05:20:29.274036 9516 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0128 05:20:29.282818 9516 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0128 05:20:29.296680 9516 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (135 bytes)
I0128 05:20:29.330900 9516 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0128 05:20:29.354777 9516 cni.go:261] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
I0128 05:20:29.354777 9516 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker
I0128 05:20:29.362234 9516 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0128 05:20:29.396717 9516 docker.go:630] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.26.1
registry.k8s.io/kube-scheduler:v1.26.1
registry.k8s.io/kube-controller-manager:v1.26.1
registry.k8s.io/kube-proxy:v1.26.1
registry.k8s.io/etcd:3.5.6-0
registry.k8s.io/pause:3.9
registry.k8s.io/coredns/coredns:v1.9.3
registry.k8s.io/pause:3.6
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0128 05:20:29.396717 9516 docker.go:560] Images already preloaded, skipping extraction
I0128 05:20:29.396717 9516 start.go:472] detecting cgroup driver to use...
I0128 05:20:29.396717 9516 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
image-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0128 05:20:29.435170 9516 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0128 05:20:29.460477 9516 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0128 05:20:29.477754 9516 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I0128 05:20:29.485008 9516 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0128 05:20:29.512282 9516 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0128 05:20:29.535830 9516 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0128 05:20:29.563518 9516 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0128 05:20:29.588692 9516 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0128 05:20:29.614694 9516 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0128 05:20:29.639314 9516 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0128 05:20:29.666840 9516 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0128 05:20:29.688853 9516 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0128 05:20:29.858789 9516 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0128 05:20:29.889976 9516 start.go:472] detecting cgroup driver to use...
I0128 05:20:29.896363 9516 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0128 05:20:29.928472 9516 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0128 05:20:30.120888 9516 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0128 05:20:30.157351 9516 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0128 05:20:30.186626 9516 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0128 05:20:30.214490 9516 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0128 05:20:30.266482 9516 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0128 05:20:30.286288 9516 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
image-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0128 05:20:30.323406 9516 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0128 05:20:30.504072 9516 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0128 05:20:30.668354 9516 docker.go:529] configuring docker to use "cgroupfs" as cgroup driver...
I0128 05:20:30.668354 9516 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
I0128 05:20:30.703325 9516 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0128 05:20:30.882186 9516 ssh_runner.go:195] Run: sudo systemctl restart docker
I0128 05:21:31.965260 9516 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1m1.0797696s)
I0128 05:21:31.968324 9516 out.go:177]
W0128 05:21:31.970710 9516 out.go:239] X Exiting due to RUNTIME_ENABLE: sudo systemctl restart docker: Process exited with status 1
stdout:
stderr:
Job for docker.service failed because the control process exited with error code.
See "systemctl status docker.service" and "journalctl -xe" for details.
X Exiting due to RUNTIME_ENABLE: sudo systemctl restart docker: Process exited with status 1
stdout:
stderr:
Job for docker.service failed because the control process exited with error code.
See "systemctl status docker.service" and "journalctl -xe" for details.
W0128 05:21:31.970710 9516 out.go:239] *
*
W0128 05:21:31.971973 9516 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0128 05:21:31.974977 9516 out.go:177]
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-windows-amd64.exe start -p newest-cni-048300 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperv --kubernetes-version=v1.26.1": exit status 90
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-windows-amd64.exe status --format={{.Host}} -p newest-cni-048300 -n newest-cni-048300
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.Host}} -p newest-cni-048300 -n newest-cni-048300: exit status 6 (5.0556557s)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0128 05:21:37.034893 8908 status.go:415] kubeconfig endpoint: extract IP: "newest-cni-048300" does not appear in C:\Users\jenkins.minikube5\minikube-integration\kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "newest-cni-048300" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestStartStop/group/newest-cni/serial/SecondStart (127.46s)