=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:155: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-env-992000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit 

docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p force-systemd-env-992000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit : exit status 90 (15.135769475s)

-- stdout --

	* [force-systemd-env-992000] minikube v1.31.2 on Darwin 13.6

	  - MINIKUBE_LOCATION=17297

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17297-1019/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17297-1019/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=true

	* Using the hyperkit driver based on user configuration

	* Starting control plane node force-systemd-env-992000 in cluster force-systemd-env-992000

	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

-- /stdout --

** stderr ** 

	I0925 04:02:44.418461    5073 out.go:296] Setting OutFile to fd 1 ...

	I0925 04:02:44.419003    5073 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0925 04:02:44.419014    5073 out.go:309] Setting ErrFile to fd 2...

	I0925 04:02:44.419021    5073 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0925 04:02:44.419622    5073 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17297-1019/.minikube/bin

	I0925 04:02:44.421227    5073 out.go:303] Setting JSON to false

	I0925 04:02:44.441626    5073 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":1938,"bootTime":1695637826,"procs":433,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.6","kernelVersion":"22.6.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}

	W0925 04:02:44.441743    5073 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I0925 04:02:44.481715    5073 out.go:177] * [force-systemd-env-992000] minikube v1.31.2 on Darwin 13.6

	I0925 04:02:44.539469    5073 notify.go:220] Checking for updates...

	I0925 04:02:44.561255    5073 out.go:177]   - MINIKUBE_LOCATION=17297

	I0925 04:02:44.603211    5073 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17297-1019/kubeconfig

	I0925 04:02:44.647089    5073 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0925 04:02:44.695040    5073 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0925 04:02:44.737190    5073 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17297-1019/.minikube

	I0925 04:02:44.779323    5073 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true

	I0925 04:02:44.801305    5073 config.go:182] Loaded profile config "offline-docker-993000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I0925 04:02:44.801474    5073 driver.go:373] Setting default libvirt URI to qemu:///system

	I0925 04:02:44.831186    5073 out.go:177] * Using the hyperkit driver based on user configuration

	I0925 04:02:44.888125    5073 start.go:298] selected driver: hyperkit

	I0925 04:02:44.888153    5073 start.go:902] validating driver "hyperkit" against <nil>

	I0925 04:02:44.888218    5073 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0925 04:02:44.892391    5073 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0925 04:02:44.892519    5073 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17297-1019/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin

	I0925 04:02:44.899425    5073 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.31.2

	I0925 04:02:44.903006    5073 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 04:02:44.903026    5073 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good

	I0925 04:02:44.903051    5073 start_flags.go:307] no existing cluster config was found, will generate one from the flags 

	I0925 04:02:44.903264    5073 start_flags.go:904] Wait components to verify : map[apiserver:true system_pods:true]

	I0925 04:02:44.903289    5073 cni.go:84] Creating CNI manager for ""

	I0925 04:02:44.903306    5073 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0925 04:02:44.903317    5073 start_flags.go:316] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0925 04:02:44.903323    5073 start_flags.go:321] config:

	{Name:force-systemd-env-992000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:force-systemd-env-992000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C

ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I0925 04:02:44.903469    5073 iso.go:125] acquiring lock: {Name:mk5685b8103aa0f952a2e44c47bdd1882fdd0bc3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0925 04:02:44.980925    5073 out.go:177] * Starting control plane node force-systemd-env-992000 in cluster force-systemd-env-992000

	I0925 04:02:45.002391    5073 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I0925 04:02:45.002481    5073 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17297-1019/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4

	I0925 04:02:45.002515    5073 cache.go:57] Caching tarball of preloaded images

	I0925 04:02:45.002741    5073 preload.go:174] Found /Users/jenkins/minikube-integration/17297-1019/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0925 04:02:45.002764    5073 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I0925 04:02:45.002928    5073 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/force-systemd-env-992000/config.json ...

	I0925 04:02:45.002980    5073 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/force-systemd-env-992000/config.json: {Name:mkca4eaef89c2aaded0c143c275cfdd38c807152 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0925 04:02:45.003610    5073 start.go:365] acquiring machines lock for force-systemd-env-992000: {Name:mkc5a9c335a363bfa8f942e55cb9e7e0d08ada9f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0925 04:02:45.003728    5073 start.go:369] acquired machines lock for "force-systemd-env-992000" in 87.656µs

	I0925 04:02:45.003778    5073 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-992000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 K

ubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:force-systemd-env-992000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker

BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0925 04:02:45.003876    5073 start.go:125] createHost starting for "" (driver="hyperkit")

	I0925 04:02:45.063097    5073 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...

	I0925 04:02:45.063544    5073 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 04:02:45.063619    5073 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 04:02:45.072242    5073 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52233

	I0925 04:02:45.072600    5073 main.go:141] libmachine: () Calling .GetVersion

	I0925 04:02:45.073027    5073 main.go:141] libmachine: Using API Version  1

	I0925 04:02:45.073040    5073 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 04:02:45.073288    5073 main.go:141] libmachine: () Calling .GetMachineName

	I0925 04:02:45.073395    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetMachineName

	I0925 04:02:45.073480    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .DriverName

	I0925 04:02:45.073589    5073 start.go:159] libmachine.API.Create for "force-systemd-env-992000" (driver="hyperkit")

	I0925 04:02:45.073618    5073 client.go:168] LocalClient.Create starting

	I0925 04:02:45.073658    5073 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem

	I0925 04:02:45.073708    5073 main.go:141] libmachine: Decoding PEM data...

	I0925 04:02:45.073747    5073 main.go:141] libmachine: Parsing certificate...

	I0925 04:02:45.073804    5073 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/cert.pem

	I0925 04:02:45.073835    5073 main.go:141] libmachine: Decoding PEM data...

	I0925 04:02:45.073844    5073 main.go:141] libmachine: Parsing certificate...

	I0925 04:02:45.073860    5073 main.go:141] libmachine: Running pre-create checks...

	I0925 04:02:45.073866    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .PreCreateCheck

	I0925 04:02:45.073945    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:02:45.074144    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetConfigRaw

	I0925 04:02:45.074536    5073 main.go:141] libmachine: Creating machine...

	I0925 04:02:45.074545    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .Create

	I0925 04:02:45.074615    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:02:45.074736    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | I0925 04:02:45.074603    5081 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17297-1019/.minikube

	I0925 04:02:45.074808    5073 main.go:141] libmachine: (force-systemd-env-992000) Downloading /Users/jenkins/minikube-integration/17297-1019/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17297-1019/.minikube/cache/iso/amd64/minikube-v1.31.0-1695060926-17240-amd64.iso...

	I0925 04:02:45.230088    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | I0925 04:02:45.230026    5081 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/id_rsa...

	I0925 04:02:45.434137    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | I0925 04:02:45.434037    5081 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/force-systemd-env-992000.rawdisk...

	I0925 04:02:45.434152    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Writing magic tar header

	I0925 04:02:45.434162    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Writing SSH key tar header

	I0925 04:02:45.434636    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | I0925 04:02:45.434602    5081 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000 ...

	I0925 04:02:45.762583    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:02:45.762668    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/hyperkit.pid

	I0925 04:02:45.762694    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Using UUID 0e241a66-5b93-11ee-bc5f-149d997fca88

	I0925 04:02:45.791789    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Generated MAC ee:42:fa:c9:ff:a3

	I0925 04:02:45.791817    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=force-systemd-env-992000

	I0925 04:02:45.791850    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:45 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"0e241a66-5b93-11ee-bc5f-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0000963c0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/bzimage", Initrd:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/initrd", Bootrom:"", CPUs:2, Memory:2048, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]str

ing(nil), CmdLine:"", process:(*os.Process)(nil)}

	I0925 04:02:45.791879    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:45 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"0e241a66-5b93-11ee-bc5f-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0000963c0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/bzimage", Initrd:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/initrd", Bootrom:"", CPUs:2, Memory:2048, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]str

ing(nil), CmdLine:"", process:(*os.Process)(nil)}

	I0925 04:02:45.791943    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:45 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/hyperkit.pid", "-c", "2", "-m", "2048M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "0e241a66-5b93-11ee-bc5f-149d997fca88", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/force-systemd-env-992000.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/tty,log=/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-sys

temd-env-992000/bzimage,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=force-systemd-env-992000"}

	I0925 04:02:45.791975    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:45 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/hyperkit.pid -c 2 -m 2048M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U 0e241a66-5b93-11ee-bc5f-149d997fca88 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/force-systemd-env-992000.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/tty,log=/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/console-ring -f kexec,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/bzimage,/Users/jenkins/minikube-integration/17

297-1019/.minikube/machines/force-systemd-env-992000/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=force-systemd-env-992000"

	I0925 04:02:45.791990    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:45 DEBUG: hyperkit: Redirecting stdout/stderr to logger

	I0925 04:02:45.794661    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:45 DEBUG: hyperkit: Pid is 5082

	I0925 04:02:45.795038    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Attempt 0

	I0925 04:02:45.795065    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:02:45.795124    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | hyperkit pid from json: 5082

	I0925 04:02:45.796029    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Searching for ee:42:fa:c9:ff:a3 in /var/db/dhcpd_leases ...

	I0925 04:02:45.796121    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Found 18 entries in /var/db/dhcpd_leases!

	I0925 04:02:45.796154    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.19 HWAddress:3e:6d:bb:ef:93:69 ID:1,3e:6d:bb:ef:93:69 Lease:0x6512ba49}

	I0925 04:02:45.796185    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.18 HWAddress:fe:b2:aa:f3:66:b3 ID:1,fe:b2:aa:f3:66:b3 Lease:0x6512b9dd}

	I0925 04:02:45.796211    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.17 HWAddress:a6:6a:27:28:f5:78 ID:1,a6:6a:27:28:f5:78 Lease:0x6512b973}

	I0925 04:02:45.796260    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.16 HWAddress:c6:6c:a1:83:fe:48 ID:1,c6:6c:a1:83:fe:48 Lease:0x6512b923}

	I0925 04:02:45.796276    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.15 HWAddress:96:fc:b9:cf:b2:a5 ID:1,96:fc:b9:cf:b2:a5 Lease:0x6511673b}

	I0925 04:02:45.796286    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.14 HWAddress:22:64:90:f4:c3:6a ID:1,22:64:90:f4:c3:6a Lease:0x651166b2}

	I0925 04:02:45.796293    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.13 HWAddress:32:8:c1:c2:f0:84 ID:1,32:8:c1:c2:f0:84 Lease:0x6512b881}

	I0925 04:02:45.796302    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.12 HWAddress:d2:8c:57:41:3a:9b ID:1,d2:8c:57:41:3a:9b Lease:0x6512b84d}

	I0925 04:02:45.796317    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.11 HWAddress:4a:e6:41:59:5a:b3 ID:1,4a:e6:41:59:5a:b3 Lease:0x65116582}

	I0925 04:02:45.796329    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.10 HWAddress:16:5c:94:4a:13:17 ID:1,16:5c:94:4a:13:17 Lease:0x6511656d}

	I0925 04:02:45.796337    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.9 HWAddress:2e:f:4b:9f:7c:82 ID:1,2e:f:4b:9f:7c:82 Lease:0x6512b6b6}

	I0925 04:02:45.796357    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.8 HWAddress:ba:aa:9:2:cb:33 ID:1,ba:aa:9:2:cb:33 Lease:0x6512b693}

	I0925 04:02:45.796371    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.7 HWAddress:e6:90:1:72:f5:16 ID:1,e6:90:1:72:f5:16 Lease:0x6512b64d}

	I0925 04:02:45.796380    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.6 HWAddress:5e:78:39:3d:9d:36 ID:1,5e:78:39:3d:9d:36 Lease:0x6512b5cb}

	I0925 04:02:45.796388    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.5 HWAddress:be:df:b7:7f:25:94 ID:1,be:df:b7:7f:25:94 Lease:0x6511643a}

	I0925 04:02:45.796409    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.4 HWAddress:ce:a6:ee:bb:f0:c0 ID:1,ce:a6:ee:bb:f0:c0 Lease:0x6512b4b0}

	I0925 04:02:45.796429    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.3 HWAddress:4e:b5:b0:41:db:a3 ID:1,4e:b5:b0:41:db:a3 Lease:0x65116325}

	I0925 04:02:45.796467    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.2 HWAddress:3a:9f:39:11:92:69 ID:1,3a:9f:39:11:92:69 Lease:0x6512b379}

	I0925 04:02:45.801224    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:45 INFO : hyperkit: stderr: Using fd 5 for I/O notifications

	I0925 04:02:45.808720    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:45 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD

	I0925 04:02:45.809580    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:45 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I0925 04:02:45.809619    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:45 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I0925 04:02:45.809638    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:45 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I0925 04:02:45.809653    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:45 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I0925 04:02:46.164905    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:46 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0

	I0925 04:02:46.164926    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:46 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0

	I0925 04:02:46.269057    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:46 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I0925 04:02:46.269086    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:46 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I0925 04:02:46.269115    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:46 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I0925 04:02:46.269136    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:46 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I0925 04:02:46.269937    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:46 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1

	I0925 04:02:46.269947    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:46 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1

	I0925 04:02:47.797898    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Attempt 1

	I0925 04:02:47.797916    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:02:47.797961    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | hyperkit pid from json: 5082

	I0925 04:02:47.798839    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Searching for ee:42:fa:c9:ff:a3 in /var/db/dhcpd_leases ...

	I0925 04:02:47.798911    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Found 18 entries in /var/db/dhcpd_leases!

	I0925 04:02:47.798924    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.19 HWAddress:3e:6d:bb:ef:93:69 ID:1,3e:6d:bb:ef:93:69 Lease:0x6512ba49}

	I0925 04:02:47.798934    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.18 HWAddress:fe:b2:aa:f3:66:b3 ID:1,fe:b2:aa:f3:66:b3 Lease:0x6512b9dd}

	I0925 04:02:47.798943    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.17 HWAddress:a6:6a:27:28:f5:78 ID:1,a6:6a:27:28:f5:78 Lease:0x6512b973}

	I0925 04:02:47.798956    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.16 HWAddress:c6:6c:a1:83:fe:48 ID:1,c6:6c:a1:83:fe:48 Lease:0x6512b923}

	I0925 04:02:47.798968    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.15 HWAddress:96:fc:b9:cf:b2:a5 ID:1,96:fc:b9:cf:b2:a5 Lease:0x6511673b}

	I0925 04:02:47.798978    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.14 HWAddress:22:64:90:f4:c3:6a ID:1,22:64:90:f4:c3:6a Lease:0x651166b2}

	I0925 04:02:47.798986    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.13 HWAddress:32:8:c1:c2:f0:84 ID:1,32:8:c1:c2:f0:84 Lease:0x6512b881}

	I0925 04:02:47.798997    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.12 HWAddress:d2:8c:57:41:3a:9b ID:1,d2:8c:57:41:3a:9b Lease:0x6512b84d}

	I0925 04:02:47.799021    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.11 HWAddress:4a:e6:41:59:5a:b3 ID:1,4a:e6:41:59:5a:b3 Lease:0x65116582}

	I0925 04:02:47.799034    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.10 HWAddress:16:5c:94:4a:13:17 ID:1,16:5c:94:4a:13:17 Lease:0x6511656d}

	I0925 04:02:47.799042    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.9 HWAddress:2e:f:4b:9f:7c:82 ID:1,2e:f:4b:9f:7c:82 Lease:0x6512b6b6}

	I0925 04:02:47.799053    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.8 HWAddress:ba:aa:9:2:cb:33 ID:1,ba:aa:9:2:cb:33 Lease:0x6512b693}

	I0925 04:02:47.799065    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.7 HWAddress:e6:90:1:72:f5:16 ID:1,e6:90:1:72:f5:16 Lease:0x6512b64d}

	I0925 04:02:47.799076    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.6 HWAddress:5e:78:39:3d:9d:36 ID:1,5e:78:39:3d:9d:36 Lease:0x6512b5cb}

	I0925 04:02:47.799090    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.5 HWAddress:be:df:b7:7f:25:94 ID:1,be:df:b7:7f:25:94 Lease:0x6511643a}

	I0925 04:02:47.799098    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.4 HWAddress:ce:a6:ee:bb:f0:c0 ID:1,ce:a6:ee:bb:f0:c0 Lease:0x6512b4b0}

	I0925 04:02:47.799107    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.3 HWAddress:4e:b5:b0:41:db:a3 ID:1,4e:b5:b0:41:db:a3 Lease:0x65116325}

	I0925 04:02:47.799117    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.2 HWAddress:3a:9f:39:11:92:69 ID:1,3a:9f:39:11:92:69 Lease:0x6512b379}

	I0925 04:02:49.799640    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Attempt 2

	I0925 04:02:49.799658    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:02:49.799771    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | hyperkit pid from json: 5082

	I0925 04:02:49.800586    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Searching for ee:42:fa:c9:ff:a3 in /var/db/dhcpd_leases ...

	I0925 04:02:49.800649    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Found 18 entries in /var/db/dhcpd_leases!

	I0925 04:02:49.800658    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.19 HWAddress:3e:6d:bb:ef:93:69 ID:1,3e:6d:bb:ef:93:69 Lease:0x6512ba49}

	I0925 04:02:49.800667    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.18 HWAddress:fe:b2:aa:f3:66:b3 ID:1,fe:b2:aa:f3:66:b3 Lease:0x6512b9dd}

	I0925 04:02:49.800674    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.17 HWAddress:a6:6a:27:28:f5:78 ID:1,a6:6a:27:28:f5:78 Lease:0x6512b973}

	I0925 04:02:49.800696    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.16 HWAddress:c6:6c:a1:83:fe:48 ID:1,c6:6c:a1:83:fe:48 Lease:0x6512b923}

	I0925 04:02:49.800714    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.15 HWAddress:96:fc:b9:cf:b2:a5 ID:1,96:fc:b9:cf:b2:a5 Lease:0x6511673b}

	I0925 04:02:49.800725    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.14 HWAddress:22:64:90:f4:c3:6a ID:1,22:64:90:f4:c3:6a Lease:0x651166b2}

	I0925 04:02:49.800734    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.13 HWAddress:32:8:c1:c2:f0:84 ID:1,32:8:c1:c2:f0:84 Lease:0x6512b881}

	I0925 04:02:49.800745    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.12 HWAddress:d2:8c:57:41:3a:9b ID:1,d2:8c:57:41:3a:9b Lease:0x6512b84d}

	I0925 04:02:49.800754    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.11 HWAddress:4a:e6:41:59:5a:b3 ID:1,4a:e6:41:59:5a:b3 Lease:0x65116582}

	I0925 04:02:49.800761    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.10 HWAddress:16:5c:94:4a:13:17 ID:1,16:5c:94:4a:13:17 Lease:0x6511656d}

	I0925 04:02:49.800776    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.9 HWAddress:2e:f:4b:9f:7c:82 ID:1,2e:f:4b:9f:7c:82 Lease:0x6512b6b6}

	I0925 04:02:49.800789    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.8 HWAddress:ba:aa:9:2:cb:33 ID:1,ba:aa:9:2:cb:33 Lease:0x6512b693}

	I0925 04:02:49.800800    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.7 HWAddress:e6:90:1:72:f5:16 ID:1,e6:90:1:72:f5:16 Lease:0x6512b64d}

	I0925 04:02:49.800815    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.6 HWAddress:5e:78:39:3d:9d:36 ID:1,5e:78:39:3d:9d:36 Lease:0x6512b5cb}

	I0925 04:02:49.800828    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.5 HWAddress:be:df:b7:7f:25:94 ID:1,be:df:b7:7f:25:94 Lease:0x6511643a}

	I0925 04:02:49.800837    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.4 HWAddress:ce:a6:ee:bb:f0:c0 ID:1,ce:a6:ee:bb:f0:c0 Lease:0x6512b4b0}

	I0925 04:02:49.800846    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.3 HWAddress:4e:b5:b0:41:db:a3 ID:1,4e:b5:b0:41:db:a3 Lease:0x65116325}

	I0925 04:02:49.800856    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.2 HWAddress:3a:9f:39:11:92:69 ID:1,3a:9f:39:11:92:69 Lease:0x6512b379}

	I0925 04:02:51.238980    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:51 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1

	I0925 04:02:51.239057    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:51 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1

	I0925 04:02:51.239069    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | 2023/09/25 04:02:51 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1

	I0925 04:02:51.802159    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Attempt 3

	I0925 04:02:51.802179    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:02:51.802236    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | hyperkit pid from json: 5082

	I0925 04:02:51.803211    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Searching for ee:42:fa:c9:ff:a3 in /var/db/dhcpd_leases ...

	I0925 04:02:51.803286    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Found 18 entries in /var/db/dhcpd_leases!

	I0925 04:02:51.803309    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.19 HWAddress:3e:6d:bb:ef:93:69 ID:1,3e:6d:bb:ef:93:69 Lease:0x6512ba49}

	I0925 04:02:51.803323    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.18 HWAddress:fe:b2:aa:f3:66:b3 ID:1,fe:b2:aa:f3:66:b3 Lease:0x6512b9dd}

	I0925 04:02:51.803362    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.17 HWAddress:a6:6a:27:28:f5:78 ID:1,a6:6a:27:28:f5:78 Lease:0x6512b973}

	I0925 04:02:51.803408    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.16 HWAddress:c6:6c:a1:83:fe:48 ID:1,c6:6c:a1:83:fe:48 Lease:0x6512b923}

	I0925 04:02:51.803424    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.15 HWAddress:96:fc:b9:cf:b2:a5 ID:1,96:fc:b9:cf:b2:a5 Lease:0x6511673b}

	I0925 04:02:51.803434    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.14 HWAddress:22:64:90:f4:c3:6a ID:1,22:64:90:f4:c3:6a Lease:0x651166b2}

	I0925 04:02:51.803448    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.13 HWAddress:32:8:c1:c2:f0:84 ID:1,32:8:c1:c2:f0:84 Lease:0x6512b881}

	I0925 04:02:51.803474    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.12 HWAddress:d2:8c:57:41:3a:9b ID:1,d2:8c:57:41:3a:9b Lease:0x6512b84d}

	I0925 04:02:51.803492    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.11 HWAddress:4a:e6:41:59:5a:b3 ID:1,4a:e6:41:59:5a:b3 Lease:0x65116582}

	I0925 04:02:51.803506    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.10 HWAddress:16:5c:94:4a:13:17 ID:1,16:5c:94:4a:13:17 Lease:0x6511656d}

	I0925 04:02:51.803520    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.9 HWAddress:2e:f:4b:9f:7c:82 ID:1,2e:f:4b:9f:7c:82 Lease:0x6512b6b6}

	I0925 04:02:51.803550    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.8 HWAddress:ba:aa:9:2:cb:33 ID:1,ba:aa:9:2:cb:33 Lease:0x6512b693}

	I0925 04:02:51.803566    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.7 HWAddress:e6:90:1:72:f5:16 ID:1,e6:90:1:72:f5:16 Lease:0x6512b64d}

	I0925 04:02:51.803579    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.6 HWAddress:5e:78:39:3d:9d:36 ID:1,5e:78:39:3d:9d:36 Lease:0x6512b5cb}

	I0925 04:02:51.803595    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.5 HWAddress:be:df:b7:7f:25:94 ID:1,be:df:b7:7f:25:94 Lease:0x6511643a}

	I0925 04:02:51.803609    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.4 HWAddress:ce:a6:ee:bb:f0:c0 ID:1,ce:a6:ee:bb:f0:c0 Lease:0x6512b4b0}

	I0925 04:02:51.803629    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.3 HWAddress:4e:b5:b0:41:db:a3 ID:1,4e:b5:b0:41:db:a3 Lease:0x65116325}

	I0925 04:02:51.803641    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.2 HWAddress:3a:9f:39:11:92:69 ID:1,3a:9f:39:11:92:69 Lease:0x6512b379}

	I0925 04:02:53.804673    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Attempt 4

	I0925 04:02:53.804696    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:02:53.804982    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | hyperkit pid from json: 5082

	I0925 04:02:53.806038    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Searching for ee:42:fa:c9:ff:a3 in /var/db/dhcpd_leases ...

	I0925 04:02:53.806108    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Found 18 entries in /var/db/dhcpd_leases!

	I0925 04:02:53.806167    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.19 HWAddress:3e:6d:bb:ef:93:69 ID:1,3e:6d:bb:ef:93:69 Lease:0x6512ba49}

	I0925 04:02:53.806188    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.18 HWAddress:fe:b2:aa:f3:66:b3 ID:1,fe:b2:aa:f3:66:b3 Lease:0x6512b9dd}

	I0925 04:02:53.806208    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.17 HWAddress:a6:6a:27:28:f5:78 ID:1,a6:6a:27:28:f5:78 Lease:0x6512b973}

	I0925 04:02:53.806227    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.16 HWAddress:c6:6c:a1:83:fe:48 ID:1,c6:6c:a1:83:fe:48 Lease:0x6512b923}

	I0925 04:02:53.806242    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.15 HWAddress:96:fc:b9:cf:b2:a5 ID:1,96:fc:b9:cf:b2:a5 Lease:0x6511673b}

	I0925 04:02:53.806256    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.14 HWAddress:22:64:90:f4:c3:6a ID:1,22:64:90:f4:c3:6a Lease:0x651166b2}

	I0925 04:02:53.806276    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.13 HWAddress:32:8:c1:c2:f0:84 ID:1,32:8:c1:c2:f0:84 Lease:0x6512b881}

	I0925 04:02:53.806292    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.12 HWAddress:d2:8c:57:41:3a:9b ID:1,d2:8c:57:41:3a:9b Lease:0x6512b84d}

	I0925 04:02:53.806306    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.11 HWAddress:4a:e6:41:59:5a:b3 ID:1,4a:e6:41:59:5a:b3 Lease:0x65116582}

	I0925 04:02:53.806319    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.10 HWAddress:16:5c:94:4a:13:17 ID:1,16:5c:94:4a:13:17 Lease:0x6511656d}

	I0925 04:02:53.806332    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.9 HWAddress:2e:f:4b:9f:7c:82 ID:1,2e:f:4b:9f:7c:82 Lease:0x6512b6b6}

	I0925 04:02:53.806355    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.8 HWAddress:ba:aa:9:2:cb:33 ID:1,ba:aa:9:2:cb:33 Lease:0x6512b693}

	I0925 04:02:53.806378    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.7 HWAddress:e6:90:1:72:f5:16 ID:1,e6:90:1:72:f5:16 Lease:0x6512b64d}

	I0925 04:02:53.806395    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.6 HWAddress:5e:78:39:3d:9d:36 ID:1,5e:78:39:3d:9d:36 Lease:0x6512b5cb}

	I0925 04:02:53.806410    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.5 HWAddress:be:df:b7:7f:25:94 ID:1,be:df:b7:7f:25:94 Lease:0x6511643a}

	I0925 04:02:53.806423    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.4 HWAddress:ce:a6:ee:bb:f0:c0 ID:1,ce:a6:ee:bb:f0:c0 Lease:0x6512b4b0}

	I0925 04:02:53.806436    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.3 HWAddress:4e:b5:b0:41:db:a3 ID:1,4e:b5:b0:41:db:a3 Lease:0x65116325}

	I0925 04:02:53.806452    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.2 HWAddress:3a:9f:39:11:92:69 ID:1,3a:9f:39:11:92:69 Lease:0x6512b379}

	I0925 04:02:55.806854    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Attempt 5

	I0925 04:02:55.806874    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:02:55.806973    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | hyperkit pid from json: 5082

	I0925 04:02:55.807946    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Searching for ee:42:fa:c9:ff:a3 in /var/db/dhcpd_leases ...

	I0925 04:02:55.808019    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Found 19 entries in /var/db/dhcpd_leases!

	I0925 04:02:55.808030    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.20 HWAddress:ee:42:fa:c9:ff:a3 ID:1,ee:42:fa:c9:ff:a3 Lease:0x6512ba5e}

	I0925 04:02:55.808039    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | Found match: ee:42:fa:c9:ff:a3

	I0925 04:02:55.808049    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | IP: 192.168.64.20

	I0925 04:02:55.808114    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetConfigRaw

	I0925 04:02:55.808616    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .DriverName

	I0925 04:02:55.808705    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .DriverName

	I0925 04:02:55.808781    5073 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0925 04:02:55.808789    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetState

	I0925 04:02:55.808869    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:02:55.808921    5073 main.go:141] libmachine: (force-systemd-env-992000) DBG | hyperkit pid from json: 5082

	I0925 04:02:55.809680    5073 main.go:141] libmachine: Detecting operating system of created instance...

	I0925 04:02:55.809693    5073 main.go:141] libmachine: Waiting for SSH to be available...

	I0925 04:02:55.809698    5073 main.go:141] libmachine: Getting to WaitForSSH function...

	I0925 04:02:55.809706    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHHostname

	I0925 04:02:55.809796    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHPort

	I0925 04:02:55.809884    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:55.809960    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:55.810035    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHUsername

	I0925 04:02:55.810151    5073 main.go:141] libmachine: Using SSH client type: native

	I0925 04:02:55.810464    5073 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.20 22 <nil> <nil>}

	I0925 04:02:55.810473    5073 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0925 04:02:55.865795    5073 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0925 04:02:55.865807    5073 main.go:141] libmachine: Detecting the provisioner...

	I0925 04:02:55.865813    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHHostname

	I0925 04:02:55.865950    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHPort

	I0925 04:02:55.866061    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:55.866160    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:55.866251    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHUsername

	I0925 04:02:55.866398    5073 main.go:141] libmachine: Using SSH client type: native

	I0925 04:02:55.866663    5073 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.20 22 <nil> <nil>}

	I0925 04:02:55.866672    5073 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0925 04:02:55.922121    5073 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2021.02.12-1-gb090841-dirty

	ID=buildroot

	VERSION_ID=2021.02.12

	PRETTY_NAME="Buildroot 2021.02.12"

	I0925 04:02:55.922191    5073 main.go:141] libmachine: found compatible host: buildroot

	I0925 04:02:55.922198    5073 main.go:141] libmachine: Provisioning with buildroot...

	I0925 04:02:55.922205    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetMachineName

	I0925 04:02:55.922359    5073 buildroot.go:166] provisioning hostname "force-systemd-env-992000"

	I0925 04:02:55.922373    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetMachineName

	I0925 04:02:55.922465    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHHostname

	I0925 04:02:55.922555    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHPort

	I0925 04:02:55.922647    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:55.922718    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:55.922803    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHUsername

	I0925 04:02:55.922932    5073 main.go:141] libmachine: Using SSH client type: native

	I0925 04:02:55.923183    5073 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.20 22 <nil> <nil>}

	I0925 04:02:55.923193    5073 main.go:141] libmachine: About to run SSH command:

	sudo hostname force-systemd-env-992000 && echo "force-systemd-env-992000" | sudo tee /etc/hostname

	I0925 04:02:55.987414    5073 main.go:141] libmachine: SSH cmd err, output: <nil>: force-systemd-env-992000

	I0925 04:02:55.987436    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHHostname

	I0925 04:02:55.987595    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHPort

	I0925 04:02:55.987684    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:55.987755    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:55.987834    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHUsername

	I0925 04:02:55.987986    5073 main.go:141] libmachine: Using SSH client type: native

	I0925 04:02:55.988236    5073 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.20 22 <nil> <nil>}

	I0925 04:02:55.988249    5073 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sforce-systemd-env-992000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 force-systemd-env-992000/g' /etc/hosts;

				else 

					echo '127.0.1.1 force-systemd-env-992000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0925 04:02:56.050038    5073 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0925 04:02:56.050057    5073 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17297-1019/.minikube CaCertPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17297-1019/.minikube}

	I0925 04:02:56.050072    5073 buildroot.go:174] setting up certificates

	I0925 04:02:56.050083    5073 provision.go:83] configureAuth start

	I0925 04:02:56.050091    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetMachineName

	I0925 04:02:56.050214    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetIP

	I0925 04:02:56.050323    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHHostname

	I0925 04:02:56.050418    5073 provision.go:138] copyHostCerts

	I0925 04:02:56.050453    5073 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/17297-1019/.minikube/ca.pem

	I0925 04:02:56.050504    5073 exec_runner.go:144] found /Users/jenkins/minikube-integration/17297-1019/.minikube/ca.pem, removing ...

	I0925 04:02:56.050515    5073 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17297-1019/.minikube/ca.pem

	I0925 04:02:56.050646    5073 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17297-1019/.minikube/ca.pem (1078 bytes)

	I0925 04:02:56.050842    5073 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/17297-1019/.minikube/cert.pem

	I0925 04:02:56.050875    5073 exec_runner.go:144] found /Users/jenkins/minikube-integration/17297-1019/.minikube/cert.pem, removing ...

	I0925 04:02:56.050880    5073 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17297-1019/.minikube/cert.pem

	I0925 04:02:56.050954    5073 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17297-1019/.minikube/cert.pem (1123 bytes)

	I0925 04:02:56.051074    5073 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/17297-1019/.minikube/key.pem

	I0925 04:02:56.051104    5073 exec_runner.go:144] found /Users/jenkins/minikube-integration/17297-1019/.minikube/key.pem, removing ...

	I0925 04:02:56.051109    5073 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17297-1019/.minikube/key.pem

	I0925 04:02:56.051180    5073 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17297-1019/.minikube/key.pem (1675 bytes)

	I0925 04:02:56.051300    5073 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca-key.pem org=jenkins.force-systemd-env-992000 san=[192.168.64.20 192.168.64.20 localhost 127.0.0.1 minikube force-systemd-env-992000]

	I0925 04:02:56.202499    5073 provision.go:172] copyRemoteCerts

	I0925 04:02:56.202561    5073 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0925 04:02:56.202579    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHHostname

	I0925 04:02:56.202756    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHPort

	I0925 04:02:56.202863    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:56.202968    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHUsername

	I0925 04:02:56.203059    5073 sshutil.go:53] new ssh client: &{IP:192.168.64.20 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/id_rsa Username:docker}

	I0925 04:02:56.236610    5073 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0925 04:02:56.236697    5073 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0925 04:02:56.252750    5073 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0925 04:02:56.252814    5073 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server.pem --> /etc/docker/server.pem (1245 bytes)

	I0925 04:02:56.269078    5073 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0925 04:02:56.269147    5073 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0925 04:02:56.285980    5073 provision.go:86] duration metric: configureAuth took 235.882142ms

	I0925 04:02:56.285993    5073 buildroot.go:189] setting minikube options for container-runtime

	I0925 04:02:56.286133    5073 config.go:182] Loaded profile config "force-systemd-env-992000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I0925 04:02:56.286151    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .DriverName

	I0925 04:02:56.286279    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHHostname

	I0925 04:02:56.286366    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHPort

	I0925 04:02:56.286460    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:56.286555    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:56.286635    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHUsername

	I0925 04:02:56.286755    5073 main.go:141] libmachine: Using SSH client type: native

	I0925 04:02:56.286992    5073 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.20 22 <nil> <nil>}

	I0925 04:02:56.287000    5073 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0925 04:02:56.343048    5073 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0925 04:02:56.343061    5073 buildroot.go:70] root file system type: tmpfs

	I0925 04:02:56.343148    5073 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0925 04:02:56.343164    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHHostname

	I0925 04:02:56.343298    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHPort

	I0925 04:02:56.343399    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:56.343487    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:56.343577    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHUsername

	I0925 04:02:56.343700    5073 main.go:141] libmachine: Using SSH client type: native

	I0925 04:02:56.343977    5073 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.20 22 <nil> <nil>}

	I0925 04:02:56.344037    5073 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0925 04:02:56.409199    5073 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0925 04:02:56.409224    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHHostname

	I0925 04:02:56.409362    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHPort

	I0925 04:02:56.409463    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:56.409568    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:56.409671    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHUsername

	I0925 04:02:56.409815    5073 main.go:141] libmachine: Using SSH client type: native

	I0925 04:02:56.410081    5073 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.20 22 <nil> <nil>}

	I0925 04:02:56.410094    5073 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0925 04:02:56.925700    5073 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0925 04:02:56.925727    5073 main.go:141] libmachine: Checking connection to Docker...

	I0925 04:02:56.925734    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetURL

	I0925 04:02:56.925880    5073 main.go:141] libmachine: Docker is up and running!

	I0925 04:02:56.925887    5073 main.go:141] libmachine: Reticulating splines...

	I0925 04:02:56.925906    5073 client.go:171] LocalClient.Create took 11.852230342s

	I0925 04:02:56.925918    5073 start.go:167] duration metric: libmachine.API.Create for "force-systemd-env-992000" took 11.852292569s

	I0925 04:02:56.925927    5073 start.go:300] post-start starting for "force-systemd-env-992000" (driver="hyperkit")

	I0925 04:02:56.925936    5073 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0925 04:02:56.925947    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .DriverName

	I0925 04:02:56.926089    5073 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0925 04:02:56.926102    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHHostname

	I0925 04:02:56.926193    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHPort

	I0925 04:02:56.926290    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:56.926377    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHUsername

	I0925 04:02:56.926499    5073 sshutil.go:53] new ssh client: &{IP:192.168.64.20 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/id_rsa Username:docker}

	I0925 04:02:56.959828    5073 ssh_runner.go:195] Run: cat /etc/os-release

	I0925 04:02:56.962626    5073 info.go:137] Remote host: Buildroot 2021.02.12

	I0925 04:02:56.962642    5073 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17297-1019/.minikube/addons for local assets ...

	I0925 04:02:56.962738    5073 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17297-1019/.minikube/files for local assets ...

	I0925 04:02:56.962904    5073 filesync.go:149] local asset: /Users/jenkins/minikube-integration/17297-1019/.minikube/files/etc/ssl/certs/14872.pem -> 14872.pem in /etc/ssl/certs

	I0925 04:02:56.962911    5073 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17297-1019/.minikube/files/etc/ssl/certs/14872.pem -> /etc/ssl/certs/14872.pem

	I0925 04:02:56.963105    5073 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0925 04:02:56.969079    5073 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/files/etc/ssl/certs/14872.pem --> /etc/ssl/certs/14872.pem (1708 bytes)

	I0925 04:02:56.986706    5073 start.go:303] post-start completed in 60.768026ms

	I0925 04:02:56.986746    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetConfigRaw

	I0925 04:02:56.987404    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetIP

	I0925 04:02:56.987580    5073 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/force-systemd-env-992000/config.json ...

	I0925 04:02:56.987897    5073 start.go:128] duration metric: createHost completed in 11.983969248s

	I0925 04:02:56.987914    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHHostname

	I0925 04:02:56.988022    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHPort

	I0925 04:02:56.988109    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:56.988196    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:56.988279    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHUsername

	I0925 04:02:56.988387    5073 main.go:141] libmachine: Using SSH client type: native

	I0925 04:02:56.988636    5073 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.20 22 <nil> <nil>}

	I0925 04:02:56.988646    5073 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0925 04:02:57.045470    5073 main.go:141] libmachine: SSH cmd err, output: <nil>: 1695639776.921420990

	I0925 04:02:57.045482    5073 fix.go:206] guest clock: 1695639776.921420990

	I0925 04:02:57.045488    5073 fix.go:219] Guest: 2023-09-25 04:02:56.92142099 -0700 PDT Remote: 2023-09-25 04:02:56.987907 -0700 PDT m=+12.599334362 (delta=-66.48601ms)

	I0925 04:02:57.045504    5073 fix.go:190] guest clock delta is within tolerance: -66.48601ms

	I0925 04:02:57.045508    5073 start.go:83] releasing machines lock for "force-systemd-env-992000", held for 12.041729584s

	I0925 04:02:57.045527    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .DriverName

	I0925 04:02:57.045679    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetIP

	I0925 04:02:57.045780    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .DriverName

	I0925 04:02:57.046123    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .DriverName

	I0925 04:02:57.046246    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .DriverName

	I0925 04:02:57.046356    5073 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0925 04:02:57.046392    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHHostname

	I0925 04:02:57.046414    5073 ssh_runner.go:195] Run: cat /version.json

	I0925 04:02:57.046425    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHHostname

	I0925 04:02:57.046515    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHPort

	I0925 04:02:57.046535    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHPort

	I0925 04:02:57.046607    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:57.046630    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHKeyPath

	I0925 04:02:57.046727    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHUsername

	I0925 04:02:57.046761    5073 main.go:141] libmachine: (force-systemd-env-992000) Calling .GetSSHUsername

	I0925 04:02:57.046829    5073 sshutil.go:53] new ssh client: &{IP:192.168.64.20 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/id_rsa Username:docker}

	I0925 04:02:57.046878    5073 sshutil.go:53] new ssh client: &{IP:192.168.64.20 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/force-systemd-env-992000/id_rsa Username:docker}

	I0925 04:02:57.119220    5073 ssh_runner.go:195] Run: systemctl --version

	I0925 04:02:57.123307    5073 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0925 04:02:57.127129    5073 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0925 04:02:57.127211    5073 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0925 04:02:57.139173    5073 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0925 04:02:57.139189    5073 start.go:469] detecting cgroup driver to use...

	I0925 04:02:57.139201    5073 start.go:473] using "systemd" cgroup driver as enforced via flags

	I0925 04:02:57.139312    5073 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0925 04:02:57.153911    5073 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0925 04:02:57.161206    5073 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0925 04:02:57.168371    5073 containerd.go:145] configuring containerd to use "systemd" as cgroup driver...

	I0925 04:02:57.168417    5073 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = true|g' /etc/containerd/config.toml"

	I0925 04:02:57.175782    5073 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0925 04:02:57.183517    5073 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0925 04:02:57.191300    5073 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0925 04:02:57.198881    5073 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0925 04:02:57.206804    5073 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0925 04:02:57.214540    5073 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0925 04:02:57.221464    5073 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0925 04:02:57.228624    5073 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0925 04:02:57.319372    5073 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0925 04:02:57.332381    5073 start.go:469] detecting cgroup driver to use...

	I0925 04:02:57.332405    5073 start.go:473] using "systemd" cgroup driver as enforced via flags

	I0925 04:02:57.332503    5073 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0925 04:02:57.347258    5073 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0925 04:02:57.362479    5073 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0925 04:02:57.382463    5073 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0925 04:02:57.391096    5073 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0925 04:02:57.399651    5073 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0925 04:02:57.429019    5073 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0925 04:02:57.438386    5073 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0925 04:02:57.451003    5073 ssh_runner.go:195] Run: which cri-dockerd

	I0925 04:02:57.453681    5073 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0925 04:02:57.459854    5073 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0925 04:02:57.471139    5073 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0925 04:02:57.558145    5073 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0925 04:02:57.648041    5073 docker.go:554] configuring docker to use "systemd" as cgroup driver...

	I0925 04:02:57.648139    5073 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (129 bytes)

	I0925 04:02:57.659202    5073 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0925 04:02:57.745289    5073 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0925 04:02:58.978378    5073 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.23306488s)

	I0925 04:02:58.978447    5073 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0925 04:02:59.068913    5073 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0925 04:02:59.162017    5073 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0925 04:02:59.259928    5073 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0925 04:02:59.357712    5073 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0925 04:02:59.406861    5073 out.go:177] 

	W0925 04:02:59.427898    5073 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart cri-docker.socket: Process exited with status 1

	stdout:

	stderr:

	Job failed. See "journalctl -xe" for details.

	X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart cri-docker.socket: Process exited with status 1

	stdout:

	stderr:

	Job failed. See "journalctl -xe" for details.

	W0925 04:02:59.427926    5073 out.go:239] * 

	* 

	W0925 04:02:59.429175    5073 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0925 04:02:59.490918    5073 out.go:177] 

** /stderr **

docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-amd64 start -p force-systemd-env-992000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit " : exit status 90

docker_test.go:110: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-env-992000 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:166: *** TestForceSystemdEnv FAILED at 2023-09-25 04:02:59.673409 -0700 PDT m=+1802.131389625

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-992000 -n force-systemd-env-992000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-992000 -n force-systemd-env-992000: exit status 6 (122.598911ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0925 04:02:59.786722    5091 status.go:415] kubeconfig endpoint: extract IP: "force-systemd-env-992000" does not appear in /Users/jenkins/minikube-integration/17297-1019/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "force-systemd-env-992000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

helpers_test.go:175: Cleaning up "force-systemd-env-992000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-env-992000

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p force-systemd-env-992000: (5.265553067s)

--- FAIL: TestForceSystemdEnv (20.68s)

=== RUN   TestMinikubeProfile

minikube_profile_test.go:44: (dbg) Run:  out/minikube-darwin-amd64 start -p first-782000 --driver=hyperkit 

E0925 03:46:40.479915    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/functional-220000/client.crt: no such file or directory

minikube_profile_test.go:44: (dbg) Done: out/minikube-darwin-amd64 start -p first-782000 --driver=hyperkit : (35.357074078s)

minikube_profile_test.go:44: (dbg) Run:  out/minikube-darwin-amd64 start -p second-784000 --driver=hyperkit 

E0925 03:47:21.441947    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/functional-220000/client.crt: no such file or directory

minikube_profile_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p second-784000 --driver=hyperkit : exit status 90 (18.064634732s)

-- stdout --

	* [second-784000] minikube v1.31.2 on Darwin 13.6

	  - MINIKUBE_LOCATION=17297

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17297-1019/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17297-1019/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the hyperkit driver based on user configuration

	* Starting control plane node second-784000 in cluster second-784000

	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...

-- /stdout --

** stderr ** 

	X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart cri-docker.socket: Process exited with status 1

	stdout:

	stderr:

	Job failed. See "journalctl -xe" for details.

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

minikube_profile_test.go:46: test pre-condition failed. args "out/minikube-darwin-amd64 start -p second-784000 --driver=hyperkit ": exit status 90

panic.go:523: *** TestMinikubeProfile FAILED at 2023-09-25 03:47:25.922528 -0700 PDT m=+868.341147985

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p second-784000 -n second-784000

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p second-784000 -n second-784000: exit status 6 (126.305997ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0925 03:47:26.039666    3530 status.go:415] kubeconfig endpoint: extract IP: "second-784000" does not appear in /Users/jenkins/minikube-integration/17297-1019/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "second-784000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

helpers_test.go:175: Cleaning up "second-784000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p second-784000

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p second-784000: (5.267702553s)

panic.go:523: *** TestMinikubeProfile FAILED at 2023-09-25 03:47:31.316918 -0700 PDT m=+873.735448563

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p first-782000 -n first-782000

helpers_test.go:244: <<< TestMinikubeProfile FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMinikubeProfile]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-amd64 -p first-782000 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-darwin-amd64 -p first-782000 logs -n 25: (1.911862466s)

helpers_test.go:252: TestMinikubeProfile logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|------------------------------------------|-----------------------------|----------|---------|---------------------|---------------------|

	| Command |                   Args                   |           Profile           |   User   | Version |     Start Time      |      End Time       |

	|---------|------------------------------------------|-----------------------------|----------|---------|---------------------|---------------------|

	| delete  | -p functional-220000                     | functional-220000           | jenkins  | v1.31.2 | 25 Sep 23 03:42 PDT | 25 Sep 23 03:42 PDT |

	| start   | -p image-287000                          | image-287000                | jenkins  | v1.31.2 | 25 Sep 23 03:42 PDT | 25 Sep 23 03:43 PDT |

	|         | --driver=hyperkit                        |                             |          |         |                     |                     |

	| image   | build -t aaa:latest                      | image-287000                | jenkins  | v1.31.2 | 25 Sep 23 03:43 PDT | 25 Sep 23 03:43 PDT |

	|         | ./testdata/image-build/test-normal       |                             |          |         |                     |                     |

	|         | -p image-287000                          |                             |          |         |                     |                     |

	| image   | build -t aaa:latest                      | image-287000                | jenkins  | v1.31.2 | 25 Sep 23 03:43 PDT | 25 Sep 23 03:43 PDT |

	|         | --build-opt=build-arg=ENV_A=test_env_str |                             |          |         |                     |                     |

	|         | --build-opt=no-cache                     |                             |          |         |                     |                     |

	|         | ./testdata/image-build/test-arg -p       |                             |          |         |                     |                     |

	|         | image-287000                             |                             |          |         |                     |                     |

	| image   | build -t aaa:latest                      | image-287000                | jenkins  | v1.31.2 | 25 Sep 23 03:43 PDT | 25 Sep 23 03:43 PDT |

	|         | ./testdata/image-build/test-normal       |                             |          |         |                     |                     |

	|         | --build-opt=no-cache -p                  |                             |          |         |                     |                     |

	|         | image-287000                             |                             |          |         |                     |                     |

	| image   | build -t aaa:latest                      | image-287000                | jenkins  | v1.31.2 | 25 Sep 23 03:43 PDT | 25 Sep 23 03:43 PDT |

	|         | -f inner/Dockerfile                      |                             |          |         |                     |                     |

	|         | ./testdata/image-build/test-f            |                             |          |         |                     |                     |

	|         | -p image-287000                          |                             |          |         |                     |                     |

	| delete  | -p image-287000                          | image-287000                | jenkins  | v1.31.2 | 25 Sep 23 03:43 PDT | 25 Sep 23 03:43 PDT |

	| start   | -p ingress-addon-legacy-797000           | ingress-addon-legacy-797000 | jenkins  | v1.31.2 | 25 Sep 23 03:43 PDT | 25 Sep 23 03:44 PDT |

	|         | --kubernetes-version=v1.18.20            |                             |          |         |                     |                     |

	|         | --memory=4096 --wait=true                |                             |          |         |                     |                     |

	|         | --alsologtostderr -v=5                   |                             |          |         |                     |                     |

	|         | --driver=hyperkit                        |                             |          |         |                     |                     |

	| addons  | ingress-addon-legacy-797000              | ingress-addon-legacy-797000 | jenkins  | v1.31.2 | 25 Sep 23 03:44 PDT | 25 Sep 23 03:44 PDT |

	|         | addons enable ingress                    |                             |          |         |                     |                     |

	|         | --alsologtostderr -v=5                   |                             |          |         |                     |                     |

	| addons  | ingress-addon-legacy-797000              | ingress-addon-legacy-797000 | jenkins  | v1.31.2 | 25 Sep 23 03:44 PDT | 25 Sep 23 03:44 PDT |

	|         | addons enable ingress-dns                |                             |          |         |                     |                     |

	|         | --alsologtostderr -v=5                   |                             |          |         |                     |                     |

	| ssh     | ingress-addon-legacy-797000              | ingress-addon-legacy-797000 | jenkins  | v1.31.2 | 25 Sep 23 03:45 PDT | 25 Sep 23 03:45 PDT |

	|         | ssh curl -s http://127.0.0.1/            |                             |          |         |                     |                     |

	|         | -H 'Host: nginx.example.com'             |                             |          |         |                     |                     |

	| ip      | ingress-addon-legacy-797000 ip           | ingress-addon-legacy-797000 | jenkins  | v1.31.2 | 25 Sep 23 03:45 PDT | 25 Sep 23 03:45 PDT |

	| addons  | ingress-addon-legacy-797000              | ingress-addon-legacy-797000 | jenkins  | v1.31.2 | 25 Sep 23 03:45 PDT | 25 Sep 23 03:45 PDT |

	|         | addons disable ingress-dns               |                             |          |         |                     |                     |

	|         | --alsologtostderr -v=1                   |                             |          |         |                     |                     |

	| addons  | ingress-addon-legacy-797000              | ingress-addon-legacy-797000 | jenkins  | v1.31.2 | 25 Sep 23 03:45 PDT | 25 Sep 23 03:45 PDT |

	|         | addons disable ingress                   |                             |          |         |                     |                     |

	|         | --alsologtostderr -v=1                   |                             |          |         |                     |                     |

	| delete  | -p ingress-addon-legacy-797000           | ingress-addon-legacy-797000 | jenkins  | v1.31.2 | 25 Sep 23 03:45 PDT | 25 Sep 23 03:45 PDT |

	| start   | -p json-output-886000                    | json-output-886000          | testUser | v1.31.2 | 25 Sep 23 03:45 PDT | 25 Sep 23 03:46 PDT |

	|         | --output=json --user=testUser            |                             |          |         |                     |                     |

	|         | --memory=2200 --wait=true                |                             |          |         |                     |                     |

	|         | --driver=hyperkit                        |                             |          |         |                     |                     |

	| pause   | -p json-output-886000                    | json-output-886000          | testUser | v1.31.2 | 25 Sep 23 03:46 PDT | 25 Sep 23 03:46 PDT |

	|         | --output=json --user=testUser            |                             |          |         |                     |                     |

	| unpause | -p json-output-886000                    | json-output-886000          | testUser | v1.31.2 | 25 Sep 23 03:46 PDT | 25 Sep 23 03:46 PDT |

	|         | --output=json --user=testUser            |                             |          |         |                     |                     |

	| stop    | -p json-output-886000                    | json-output-886000          | testUser | v1.31.2 | 25 Sep 23 03:46 PDT | 25 Sep 23 03:46 PDT |

	|         | --output=json --user=testUser            |                             |          |         |                     |                     |

	| delete  | -p json-output-886000                    | json-output-886000          | jenkins  | v1.31.2 | 25 Sep 23 03:46 PDT | 25 Sep 23 03:46 PDT |

	| start   | -p json-output-error-698000              | json-output-error-698000    | jenkins  | v1.31.2 | 25 Sep 23 03:46 PDT |                     |

	|         | --memory=2200 --output=json              |                             |          |         |                     |                     |

	|         | --wait=true --driver=fail                |                             |          |         |                     |                     |

	| delete  | -p json-output-error-698000              | json-output-error-698000    | jenkins  | v1.31.2 | 25 Sep 23 03:46 PDT | 25 Sep 23 03:46 PDT |

	| start   | -p first-782000                          | first-782000                | jenkins  | v1.31.2 | 25 Sep 23 03:46 PDT | 25 Sep 23 03:47 PDT |

	|         | --driver=hyperkit                        |                             |          |         |                     |                     |

	| start   | -p second-784000                         | second-784000               | jenkins  | v1.31.2 | 25 Sep 23 03:47 PDT |                     |

	|         | --driver=hyperkit                        |                             |          |         |                     |                     |

	| delete  | -p second-784000                         | second-784000               | jenkins  | v1.31.2 | 25 Sep 23 03:47 PDT | 25 Sep 23 03:47 PDT |

	|---------|------------------------------------------|-----------------------------|----------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/09/25 03:47:07

	Running on machine: MacOS-Agent-4

	Binary: Built with gc go1.21.1 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0925 03:47:07.894533    3510 out.go:296] Setting OutFile to fd 1 ...

	I0925 03:47:07.895108    3510 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0925 03:47:07.895112    3510 out.go:309] Setting ErrFile to fd 2...

	I0925 03:47:07.895115    3510 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0925 03:47:07.895466    3510 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17297-1019/.minikube/bin

	I0925 03:47:07.897126    3510 out.go:303] Setting JSON to false

	I0925 03:47:07.917660    3510 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":1001,"bootTime":1695637826,"procs":446,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.6","kernelVersion":"22.6.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}

	W0925 03:47:07.917767    3510 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I0925 03:47:07.954886    3510 out.go:177] * [second-784000] minikube v1.31.2 on Darwin 13.6

	I0925 03:47:08.066971    3510 out.go:177]   - MINIKUBE_LOCATION=17297

	I0925 03:47:08.029276    3510 notify.go:220] Checking for updates...

	I0925 03:47:08.140772    3510 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17297-1019/kubeconfig

	I0925 03:47:08.161864    3510 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0925 03:47:08.182894    3510 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0925 03:47:08.203977    3510 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17297-1019/.minikube

	I0925 03:47:08.224847    3510 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0925 03:47:08.246439    3510 config.go:182] Loaded profile config "first-782000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I0925 03:47:08.246553    3510 driver.go:373] Setting default libvirt URI to qemu:///system

	I0925 03:47:08.273799    3510 out.go:177] * Using the hyperkit driver based on user configuration

	I0925 03:47:08.315981    3510 start.go:298] selected driver: hyperkit

	I0925 03:47:08.315999    3510 start.go:902] validating driver "hyperkit" against <nil>

	I0925 03:47:08.316016    3510 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0925 03:47:08.316239    3510 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0925 03:47:08.316395    3510 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17297-1019/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin

	I0925 03:47:08.324126    3510 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.31.2

	I0925 03:47:08.327579    3510 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 03:47:08.327594    3510 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good

	I0925 03:47:08.327623    3510 start_flags.go:307] no existing cluster config was found, will generate one from the flags 

	I0925 03:47:08.329945    3510 start_flags.go:384] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB

	I0925 03:47:08.330090    3510 start_flags.go:904] Wait components to verify : map[apiserver:true system_pods:true]

	I0925 03:47:08.330113    3510 cni.go:84] Creating CNI manager for ""

	I0925 03:47:08.330126    3510 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0925 03:47:08.330139    3510 start_flags.go:316] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0925 03:47:08.330145    3510 start_flags.go:321] config:

	{Name:second-784000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:second-784000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker

CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I0925 03:47:08.330304    3510 iso.go:125] acquiring lock: {Name:mk5685b8103aa0f952a2e44c47bdd1882fdd0bc3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0925 03:47:08.372850    3510 out.go:177] * Starting control plane node second-784000 in cluster second-784000

	I0925 03:47:08.393921    3510 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I0925 03:47:08.393981    3510 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17297-1019/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4

	I0925 03:47:08.393997    3510 cache.go:57] Caching tarball of preloaded images

	I0925 03:47:08.394138    3510 preload.go:174] Found /Users/jenkins/minikube-integration/17297-1019/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0925 03:47:08.394149    3510 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I0925 03:47:08.394306    3510 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/second-784000/config.json ...

	I0925 03:47:08.394338    3510 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/second-784000/config.json: {Name:mkc718cd656203e1cb0443a3a948ec90d2e64efb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0925 03:47:08.394883    3510 start.go:365] acquiring machines lock for second-784000: {Name:mkc5a9c335a363bfa8f942e55cb9e7e0d08ada9f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0925 03:47:08.394957    3510 start.go:369] acquired machines lock for "second-784000" in 62.395µs

	I0925 03:47:08.394992    3510 start.go:93] Provisioning new machine with config: &{Name:second-784000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCo

nfig:{KubernetesVersion:v1.28.2 ClusterName:second-784000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableO

ptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0925 03:47:08.395069    3510 start.go:125] createHost starting for "" (driver="hyperkit")

	I0925 03:47:08.437833    3510 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...

	I0925 03:47:08.438193    3510 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 03:47:08.438254    3510 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 03:47:08.446502    3510 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50858

	I0925 03:47:08.446843    3510 main.go:141] libmachine: () Calling .GetVersion

	I0925 03:47:08.447281    3510 main.go:141] libmachine: Using API Version  1

	I0925 03:47:08.447293    3510 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 03:47:08.447510    3510 main.go:141] libmachine: () Calling .GetMachineName

	I0925 03:47:08.447665    3510 main.go:141] libmachine: (second-784000) Calling .GetMachineName

	I0925 03:47:08.447775    3510 main.go:141] libmachine: (second-784000) Calling .DriverName

	I0925 03:47:08.447873    3510 start.go:159] libmachine.API.Create for "second-784000" (driver="hyperkit")

	I0925 03:47:08.447896    3510 client.go:168] LocalClient.Create starting

	I0925 03:47:08.447929    3510 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem

	I0925 03:47:08.447965    3510 main.go:141] libmachine: Decoding PEM data...

	I0925 03:47:08.447979    3510 main.go:141] libmachine: Parsing certificate...

	I0925 03:47:08.448039    3510 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/cert.pem

	I0925 03:47:08.448061    3510 main.go:141] libmachine: Decoding PEM data...

	I0925 03:47:08.448070    3510 main.go:141] libmachine: Parsing certificate...

	I0925 03:47:08.448082    3510 main.go:141] libmachine: Running pre-create checks...

	I0925 03:47:08.448090    3510 main.go:141] libmachine: (second-784000) Calling .PreCreateCheck

	I0925 03:47:08.448167    3510 main.go:141] libmachine: (second-784000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 03:47:08.448372    3510 main.go:141] libmachine: (second-784000) Calling .GetConfigRaw

	I0925 03:47:08.448867    3510 main.go:141] libmachine: Creating machine...

	I0925 03:47:08.448872    3510 main.go:141] libmachine: (second-784000) Calling .Create

	I0925 03:47:08.448943    3510 main.go:141] libmachine: (second-784000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 03:47:08.449070    3510 main.go:141] libmachine: (second-784000) DBG | I0925 03:47:08.448940    3518 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17297-1019/.minikube

	I0925 03:47:08.449120    3510 main.go:141] libmachine: (second-784000) Downloading /Users/jenkins/minikube-integration/17297-1019/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17297-1019/.minikube/cache/iso/amd64/minikube-v1.31.0-1695060926-17240-amd64.iso...

	I0925 03:47:08.643065    3510 main.go:141] libmachine: (second-784000) DBG | I0925 03:47:08.643004    3518 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/id_rsa...

	I0925 03:47:08.794380    3510 main.go:141] libmachine: (second-784000) DBG | I0925 03:47:08.794321    3518 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/second-784000.rawdisk...

	I0925 03:47:08.794392    3510 main.go:141] libmachine: (second-784000) DBG | Writing magic tar header

	I0925 03:47:08.794401    3510 main.go:141] libmachine: (second-784000) DBG | Writing SSH key tar header

	I0925 03:47:08.794896    3510 main.go:141] libmachine: (second-784000) DBG | I0925 03:47:08.794854    3518 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000 ...

	I0925 03:47:09.120195    3510 main.go:141] libmachine: (second-784000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 03:47:09.120240    3510 main.go:141] libmachine: (second-784000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/hyperkit.pid

	I0925 03:47:09.120290    3510 main.go:141] libmachine: (second-784000) DBG | Using UUID dfde6d8e-5b90-11ee-b7ab-149d997fca88

	I0925 03:47:09.146994    3510 main.go:141] libmachine: (second-784000) DBG | Generated MAC 2e:f:4b:9f:7c:82

	I0925 03:47:09.147009    3510 main.go:141] libmachine: (second-784000) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=second-784000

	I0925 03:47:09.147043    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"dfde6d8e-5b90-11ee-b7ab-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0000963f0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/bzimage", Initrd:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/initrd", Bootrom:"", CPUs:2, Memory:6000, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Process)(nil)}

	I0925 03:47:09.147074    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"dfde6d8e-5b90-11ee-b7ab-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc0000963f0)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/bzimage", Initrd:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/initrd", Bootrom:"", CPUs:2, Memory:6000, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:(*os.Process)(nil)}

	I0925 03:47:09.147132    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/hyperkit.pid", "-c", "2", "-m", "6000M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "dfde6d8e-5b90-11ee-b7ab-149d997fca88", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/second-784000.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/tty,log=/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/bzimage,/Users/jenkins/minikube-integration/17297-1019/.minikube/machine

s/second-784000/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=second-784000"}

	I0925 03:47:09.147161    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/hyperkit.pid -c 2 -m 6000M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U dfde6d8e-5b90-11ee-b7ab-149d997fca88 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/second-784000.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/tty,log=/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/console-ring -f kexec,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/bzimage,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/initrd,earlyprintk=serial loglevel=3 console=t

tyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=second-784000"

	I0925 03:47:09.147175    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 DEBUG: hyperkit: Redirecting stdout/stderr to logger

	I0925 03:47:09.149697    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 DEBUG: hyperkit: Pid is 3519

	I0925 03:47:09.150085    3510 main.go:141] libmachine: (second-784000) DBG | Attempt 0

	I0925 03:47:09.150092    3510 main.go:141] libmachine: (second-784000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 03:47:09.150146    3510 main.go:141] libmachine: (second-784000) DBG | hyperkit pid from json: 3519

	I0925 03:47:09.151100    3510 main.go:141] libmachine: (second-784000) DBG | Searching for 2e:f:4b:9f:7c:82 in /var/db/dhcpd_leases ...

	I0925 03:47:09.151158    3510 main.go:141] libmachine: (second-784000) DBG | Found 7 entries in /var/db/dhcpd_leases!

	I0925 03:47:09.151176    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.8 HWAddress:ba:aa:9:2:cb:33 ID:1,ba:aa:9:2:cb:33 Lease:0x6512b693}

	I0925 03:47:09.151197    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.7 HWAddress:e6:90:1:72:f5:16 ID:1,e6:90:1:72:f5:16 Lease:0x6512b64d}

	I0925 03:47:09.151208    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.6 HWAddress:5e:78:39:3d:9d:36 ID:1,5e:78:39:3d:9d:36 Lease:0x6512b5cb}

	I0925 03:47:09.151215    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.5 HWAddress:be:df:b7:7f:25:94 ID:1,be:df:b7:7f:25:94 Lease:0x6511643a}

	I0925 03:47:09.151224    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.4 HWAddress:ce:a6:ee:bb:f0:c0 ID:1,ce:a6:ee:bb:f0:c0 Lease:0x6512b4b0}

	I0925 03:47:09.151241    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.3 HWAddress:4e:b5:b0:41:db:a3 ID:1,4e:b5:b0:41:db:a3 Lease:0x65116325}

	I0925 03:47:09.151250    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.2 HWAddress:3a:9f:39:11:92:69 ID:1,3a:9f:39:11:92:69 Lease:0x6512b379}

	I0925 03:47:09.156416    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 INFO : hyperkit: stderr: Using fd 5 for I/O notifications

	I0925 03:47:09.165212    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD

	I0925 03:47:09.165982    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I0925 03:47:09.166005    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I0925 03:47:09.166019    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I0925 03:47:09.166030    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I0925 03:47:09.734180    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0

	I0925 03:47:09.734189    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0

	I0925 03:47:09.839184    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I0925 03:47:09.839195    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I0925 03:47:09.839203    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I0925 03:47:09.839213    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I0925 03:47:09.840094    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1

	I0925 03:47:09.840101    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:09 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1

	I0925 03:47:11.153207    3510 main.go:141] libmachine: (second-784000) DBG | Attempt 1

	I0925 03:47:11.153215    3510 main.go:141] libmachine: (second-784000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 03:47:11.153294    3510 main.go:141] libmachine: (second-784000) DBG | hyperkit pid from json: 3519

	I0925 03:47:11.154141    3510 main.go:141] libmachine: (second-784000) DBG | Searching for 2e:f:4b:9f:7c:82 in /var/db/dhcpd_leases ...

	I0925 03:47:11.154198    3510 main.go:141] libmachine: (second-784000) DBG | Found 7 entries in /var/db/dhcpd_leases!

	I0925 03:47:11.154208    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.8 HWAddress:ba:aa:9:2:cb:33 ID:1,ba:aa:9:2:cb:33 Lease:0x6512b693}

	I0925 03:47:11.154219    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.7 HWAddress:e6:90:1:72:f5:16 ID:1,e6:90:1:72:f5:16 Lease:0x6512b64d}

	I0925 03:47:11.154227    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.6 HWAddress:5e:78:39:3d:9d:36 ID:1,5e:78:39:3d:9d:36 Lease:0x6512b5cb}

	I0925 03:47:11.154233    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.5 HWAddress:be:df:b7:7f:25:94 ID:1,be:df:b7:7f:25:94 Lease:0x6511643a}

	I0925 03:47:11.154240    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.4 HWAddress:ce:a6:ee:bb:f0:c0 ID:1,ce:a6:ee:bb:f0:c0 Lease:0x6512b4b0}

	I0925 03:47:11.154247    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.3 HWAddress:4e:b5:b0:41:db:a3 ID:1,4e:b5:b0:41:db:a3 Lease:0x65116325}

	I0925 03:47:11.154254    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.2 HWAddress:3a:9f:39:11:92:69 ID:1,3a:9f:39:11:92:69 Lease:0x6512b379}

	I0925 03:47:13.155123    3510 main.go:141] libmachine: (second-784000) DBG | Attempt 2

	I0925 03:47:13.155135    3510 main.go:141] libmachine: (second-784000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 03:47:13.155147    3510 main.go:141] libmachine: (second-784000) DBG | hyperkit pid from json: 3519

	I0925 03:47:13.155993    3510 main.go:141] libmachine: (second-784000) DBG | Searching for 2e:f:4b:9f:7c:82 in /var/db/dhcpd_leases ...

	I0925 03:47:13.156033    3510 main.go:141] libmachine: (second-784000) DBG | Found 7 entries in /var/db/dhcpd_leases!

	I0925 03:47:13.156039    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.8 HWAddress:ba:aa:9:2:cb:33 ID:1,ba:aa:9:2:cb:33 Lease:0x6512b693}

	I0925 03:47:13.156047    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.7 HWAddress:e6:90:1:72:f5:16 ID:1,e6:90:1:72:f5:16 Lease:0x6512b64d}

	I0925 03:47:13.156061    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.6 HWAddress:5e:78:39:3d:9d:36 ID:1,5e:78:39:3d:9d:36 Lease:0x6512b5cb}

	I0925 03:47:13.156068    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.5 HWAddress:be:df:b7:7f:25:94 ID:1,be:df:b7:7f:25:94 Lease:0x6511643a}

	I0925 03:47:13.156073    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.4 HWAddress:ce:a6:ee:bb:f0:c0 ID:1,ce:a6:ee:bb:f0:c0 Lease:0x6512b4b0}

	I0925 03:47:13.156087    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.3 HWAddress:4e:b5:b0:41:db:a3 ID:1,4e:b5:b0:41:db:a3 Lease:0x65116325}

	I0925 03:47:13.156103    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.2 HWAddress:3a:9f:39:11:92:69 ID:1,3a:9f:39:11:92:69 Lease:0x6512b379}

	I0925 03:47:14.760256    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:14 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1

	I0925 03:47:14.760339    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:14 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1

	I0925 03:47:14.760348    3510 main.go:141] libmachine: (second-784000) DBG | 2023/09/25 03:47:14 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1

	I0925 03:47:15.157120    3510 main.go:141] libmachine: (second-784000) DBG | Attempt 3

	I0925 03:47:15.157131    3510 main.go:141] libmachine: (second-784000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 03:47:15.157225    3510 main.go:141] libmachine: (second-784000) DBG | hyperkit pid from json: 3519

	I0925 03:47:15.158074    3510 main.go:141] libmachine: (second-784000) DBG | Searching for 2e:f:4b:9f:7c:82 in /var/db/dhcpd_leases ...

	I0925 03:47:15.158111    3510 main.go:141] libmachine: (second-784000) DBG | Found 7 entries in /var/db/dhcpd_leases!

	I0925 03:47:15.158124    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.8 HWAddress:ba:aa:9:2:cb:33 ID:1,ba:aa:9:2:cb:33 Lease:0x6512b693}

	I0925 03:47:15.158140    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.7 HWAddress:e6:90:1:72:f5:16 ID:1,e6:90:1:72:f5:16 Lease:0x6512b64d}

	I0925 03:47:15.158148    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.6 HWAddress:5e:78:39:3d:9d:36 ID:1,5e:78:39:3d:9d:36 Lease:0x6512b5cb}

	I0925 03:47:15.158154    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.5 HWAddress:be:df:b7:7f:25:94 ID:1,be:df:b7:7f:25:94 Lease:0x6511643a}

	I0925 03:47:15.158160    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.4 HWAddress:ce:a6:ee:bb:f0:c0 ID:1,ce:a6:ee:bb:f0:c0 Lease:0x6512b4b0}

	I0925 03:47:15.158166    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.3 HWAddress:4e:b5:b0:41:db:a3 ID:1,4e:b5:b0:41:db:a3 Lease:0x65116325}

	I0925 03:47:15.158173    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.2 HWAddress:3a:9f:39:11:92:69 ID:1,3a:9f:39:11:92:69 Lease:0x6512b379}

	I0925 03:47:17.158413    3510 main.go:141] libmachine: (second-784000) DBG | Attempt 4

	I0925 03:47:17.158426    3510 main.go:141] libmachine: (second-784000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 03:47:17.158501    3510 main.go:141] libmachine: (second-784000) DBG | hyperkit pid from json: 3519

	I0925 03:47:17.159323    3510 main.go:141] libmachine: (second-784000) DBG | Searching for 2e:f:4b:9f:7c:82 in /var/db/dhcpd_leases ...

	I0925 03:47:17.159373    3510 main.go:141] libmachine: (second-784000) DBG | Found 7 entries in /var/db/dhcpd_leases!

	I0925 03:47:17.159384    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.8 HWAddress:ba:aa:9:2:cb:33 ID:1,ba:aa:9:2:cb:33 Lease:0x6512b693}

	I0925 03:47:17.159394    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.7 HWAddress:e6:90:1:72:f5:16 ID:1,e6:90:1:72:f5:16 Lease:0x6512b64d}

	I0925 03:47:17.159399    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.6 HWAddress:5e:78:39:3d:9d:36 ID:1,5e:78:39:3d:9d:36 Lease:0x6512b5cb}

	I0925 03:47:17.159405    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.5 HWAddress:be:df:b7:7f:25:94 ID:1,be:df:b7:7f:25:94 Lease:0x6511643a}

	I0925 03:47:17.159410    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.4 HWAddress:ce:a6:ee:bb:f0:c0 ID:1,ce:a6:ee:bb:f0:c0 Lease:0x6512b4b0}

	I0925 03:47:17.159416    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.3 HWAddress:4e:b5:b0:41:db:a3 ID:1,4e:b5:b0:41:db:a3 Lease:0x65116325}

	I0925 03:47:17.159421    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.2 HWAddress:3a:9f:39:11:92:69 ID:1,3a:9f:39:11:92:69 Lease:0x6512b379}

	I0925 03:47:19.159632    3510 main.go:141] libmachine: (second-784000) DBG | Attempt 5

	I0925 03:47:19.159659    3510 main.go:141] libmachine: (second-784000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 03:47:19.159728    3510 main.go:141] libmachine: (second-784000) DBG | hyperkit pid from json: 3519

	I0925 03:47:19.160592    3510 main.go:141] libmachine: (second-784000) DBG | Searching for 2e:f:4b:9f:7c:82 in /var/db/dhcpd_leases ...

	I0925 03:47:19.160636    3510 main.go:141] libmachine: (second-784000) DBG | Found 8 entries in /var/db/dhcpd_leases!

	I0925 03:47:19.160647    3510 main.go:141] libmachine: (second-784000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.9 HWAddress:2e:f:4b:9f:7c:82 ID:1,2e:f:4b:9f:7c:82 Lease:0x6512b6b6}

	I0925 03:47:19.160654    3510 main.go:141] libmachine: (second-784000) DBG | Found match: 2e:f:4b:9f:7c:82

	I0925 03:47:19.160667    3510 main.go:141] libmachine: (second-784000) DBG | IP: 192.168.64.9

	I0925 03:47:19.160713    3510 main.go:141] libmachine: (second-784000) Calling .GetConfigRaw

	I0925 03:47:19.161199    3510 main.go:141] libmachine: (second-784000) Calling .DriverName

	I0925 03:47:19.161295    3510 main.go:141] libmachine: (second-784000) Calling .DriverName

	I0925 03:47:19.161386    3510 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0925 03:47:19.161391    3510 main.go:141] libmachine: (second-784000) Calling .GetState

	I0925 03:47:19.161466    3510 main.go:141] libmachine: (second-784000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 03:47:19.161525    3510 main.go:141] libmachine: (second-784000) DBG | hyperkit pid from json: 3519

	I0925 03:47:19.162360    3510 main.go:141] libmachine: Detecting operating system of created instance...

	I0925 03:47:19.162368    3510 main.go:141] libmachine: Waiting for SSH to be available...

	I0925 03:47:19.162371    3510 main.go:141] libmachine: Getting to WaitForSSH function...

	I0925 03:47:19.162377    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHHostname

	I0925 03:47:19.162457    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHPort

	I0925 03:47:19.162530    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:19.162607    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:19.162681    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHUsername

	I0925 03:47:19.162784    3510 main.go:141] libmachine: Using SSH client type: native

	I0925 03:47:19.163066    3510 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.9 22 <nil> <nil>}

	I0925 03:47:19.163071    3510 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0925 03:47:19.185017    3510 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain

	I0925 03:47:22.242296    3510 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0925 03:47:22.242303    3510 main.go:141] libmachine: Detecting the provisioner...

	I0925 03:47:22.242314    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHHostname

	I0925 03:47:22.242439    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHPort

	I0925 03:47:22.242523    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:22.242607    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:22.242686    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHUsername

	I0925 03:47:22.242843    3510 main.go:141] libmachine: Using SSH client type: native

	I0925 03:47:22.243095    3510 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.9 22 <nil> <nil>}

	I0925 03:47:22.243099    3510 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0925 03:47:22.302711    3510 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2021.02.12-1-gb090841-dirty

	ID=buildroot

	VERSION_ID=2021.02.12

	PRETTY_NAME="Buildroot 2021.02.12"

	I0925 03:47:22.302772    3510 main.go:141] libmachine: found compatible host: buildroot

	I0925 03:47:22.302776    3510 main.go:141] libmachine: Provisioning with buildroot...

	I0925 03:47:22.302780    3510 main.go:141] libmachine: (second-784000) Calling .GetMachineName

	I0925 03:47:22.302909    3510 buildroot.go:166] provisioning hostname "second-784000"

	I0925 03:47:22.302916    3510 main.go:141] libmachine: (second-784000) Calling .GetMachineName

	I0925 03:47:22.302994    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHHostname

	I0925 03:47:22.303058    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHPort

	I0925 03:47:22.303139    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:22.303215    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:22.303292    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHUsername

	I0925 03:47:22.303430    3510 main.go:141] libmachine: Using SSH client type: native

	I0925 03:47:22.303669    3510 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.9 22 <nil> <nil>}

	I0925 03:47:22.303675    3510 main.go:141] libmachine: About to run SSH command:

	sudo hostname second-784000 && echo "second-784000" | sudo tee /etc/hostname

	I0925 03:47:22.369439    3510 main.go:141] libmachine: SSH cmd err, output: <nil>: second-784000

	I0925 03:47:22.369456    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHHostname

	I0925 03:47:22.369582    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHPort

	I0925 03:47:22.369664    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:22.369740    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:22.369822    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHUsername

	I0925 03:47:22.369949    3510 main.go:141] libmachine: Using SSH client type: native

	I0925 03:47:22.370199    3510 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.9 22 <nil> <nil>}

	I0925 03:47:22.370208    3510 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\ssecond-784000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 second-784000/g' /etc/hosts;

				else 

					echo '127.0.1.1 second-784000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0925 03:47:22.435625    3510 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0925 03:47:22.435646    3510 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17297-1019/.minikube CaCertPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17297-1019/.minikube}

	I0925 03:47:22.435663    3510 buildroot.go:174] setting up certificates

	I0925 03:47:22.435672    3510 provision.go:83] configureAuth start

	I0925 03:47:22.435680    3510 main.go:141] libmachine: (second-784000) Calling .GetMachineName

	I0925 03:47:22.435817    3510 main.go:141] libmachine: (second-784000) Calling .GetIP

	I0925 03:47:22.435904    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHHostname

	I0925 03:47:22.435991    3510 provision.go:138] copyHostCerts

	I0925 03:47:22.436063    3510 exec_runner.go:144] found /Users/jenkins/minikube-integration/17297-1019/.minikube/ca.pem, removing ...

	I0925 03:47:22.436070    3510 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17297-1019/.minikube/ca.pem

	I0925 03:47:22.436187    3510 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17297-1019/.minikube/ca.pem (1078 bytes)

	I0925 03:47:22.436392    3510 exec_runner.go:144] found /Users/jenkins/minikube-integration/17297-1019/.minikube/cert.pem, removing ...

	I0925 03:47:22.436395    3510 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17297-1019/.minikube/cert.pem

	I0925 03:47:22.436455    3510 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17297-1019/.minikube/cert.pem (1123 bytes)

	I0925 03:47:22.436642    3510 exec_runner.go:144] found /Users/jenkins/minikube-integration/17297-1019/.minikube/key.pem, removing ...

	I0925 03:47:22.436645    3510 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17297-1019/.minikube/key.pem

	I0925 03:47:22.436707    3510 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17297-1019/.minikube/key.pem (1675 bytes)

	I0925 03:47:22.436838    3510 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca-key.pem org=jenkins.second-784000 san=[192.168.64.9 192.168.64.9 localhost 127.0.0.1 minikube second-784000]

	I0925 03:47:22.565157    3510 provision.go:172] copyRemoteCerts

	I0925 03:47:22.565207    3510 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0925 03:47:22.565224    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHHostname

	I0925 03:47:22.565363    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHPort

	I0925 03:47:22.565520    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:22.565619    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHUsername

	I0925 03:47:22.565713    3510 sshutil.go:53] new ssh client: &{IP:192.168.64.9 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/id_rsa Username:docker}

	I0925 03:47:22.601401    3510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0925 03:47:22.617475    3510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)

	I0925 03:47:22.633671    3510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0925 03:47:22.649427    3510 provision.go:86] duration metric: configureAuth took 213.740303ms

	I0925 03:47:22.649435    3510 buildroot.go:189] setting minikube options for container-runtime

	I0925 03:47:22.649561    3510 config.go:182] Loaded profile config "second-784000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I0925 03:47:22.649571    3510 main.go:141] libmachine: (second-784000) Calling .DriverName

	I0925 03:47:22.649701    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHHostname

	I0925 03:47:22.649788    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHPort

	I0925 03:47:22.649871    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:22.649967    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:22.650037    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHUsername

	I0925 03:47:22.650131    3510 main.go:141] libmachine: Using SSH client type: native

	I0925 03:47:22.650375    3510 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.9 22 <nil> <nil>}

	I0925 03:47:22.650380    3510 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0925 03:47:22.710983    3510 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0925 03:47:22.710989    3510 buildroot.go:70] root file system type: tmpfs

	I0925 03:47:22.711075    3510 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0925 03:47:22.711090    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHHostname

	I0925 03:47:22.711213    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHPort

	I0925 03:47:22.711286    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:22.711369    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:22.711452    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHUsername

	I0925 03:47:22.711574    3510 main.go:141] libmachine: Using SSH client type: native

	I0925 03:47:22.711819    3510 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.9 22 <nil> <nil>}

	I0925 03:47:22.711865    3510 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0925 03:47:22.779930    3510 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0925 03:47:22.779949    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHHostname

	I0925 03:47:22.780090    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHPort

	I0925 03:47:22.780186    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:22.780275    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:22.780363    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHUsername

	I0925 03:47:22.780489    3510 main.go:141] libmachine: Using SSH client type: native

	I0925 03:47:22.780736    3510 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.9 22 <nil> <nil>}

	I0925 03:47:22.780746    3510 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0925 03:47:23.253941    3510 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0925 03:47:23.253952    3510 main.go:141] libmachine: Checking connection to Docker...

	I0925 03:47:23.253957    3510 main.go:141] libmachine: (second-784000) Calling .GetURL

	I0925 03:47:23.254095    3510 main.go:141] libmachine: Docker is up and running!

	I0925 03:47:23.254106    3510 main.go:141] libmachine: Reticulating splines...

	I0925 03:47:23.254113    3510 client.go:171] LocalClient.Create took 14.805894224s

	I0925 03:47:23.254123    3510 start.go:167] duration metric: libmachine.API.Create for "second-784000" took 14.805934764s

	I0925 03:47:23.254129    3510 start.go:300] post-start starting for "second-784000" (driver="hyperkit")

	I0925 03:47:23.254135    3510 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0925 03:47:23.254143    3510 main.go:141] libmachine: (second-784000) Calling .DriverName

	I0925 03:47:23.254278    3510 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0925 03:47:23.254289    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHHostname

	I0925 03:47:23.254393    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHPort

	I0925 03:47:23.254473    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:23.254553    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHUsername

	I0925 03:47:23.254648    3510 sshutil.go:53] new ssh client: &{IP:192.168.64.9 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/id_rsa Username:docker}

	I0925 03:47:23.289692    3510 ssh_runner.go:195] Run: cat /etc/os-release

	I0925 03:47:23.292350    3510 info.go:137] Remote host: Buildroot 2021.02.12

	I0925 03:47:23.292360    3510 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17297-1019/.minikube/addons for local assets ...

	I0925 03:47:23.292439    3510 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17297-1019/.minikube/files for local assets ...

	I0925 03:47:23.292583    3510 filesync.go:149] local asset: /Users/jenkins/minikube-integration/17297-1019/.minikube/files/etc/ssl/certs/14872.pem -> 14872.pem in /etc/ssl/certs

	I0925 03:47:23.292739    3510 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0925 03:47:23.298379    3510 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/files/etc/ssl/certs/14872.pem --> /etc/ssl/certs/14872.pem (1708 bytes)

	I0925 03:47:23.314465    3510 start.go:303] post-start completed in 60.321374ms

	I0925 03:47:23.314487    3510 main.go:141] libmachine: (second-784000) Calling .GetConfigRaw

	I0925 03:47:23.315070    3510 main.go:141] libmachine: (second-784000) Calling .GetIP

	I0925 03:47:23.315199    3510 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/second-784000/config.json ...

	I0925 03:47:23.315486    3510 start.go:128] duration metric: createHost completed in 14.920089845s

	I0925 03:47:23.315499    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHHostname

	I0925 03:47:23.315587    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHPort

	I0925 03:47:23.315663    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:23.315742    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:23.315814    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHUsername

	I0925 03:47:23.315914    3510 main.go:141] libmachine: Using SSH client type: native

	I0925 03:47:23.316148    3510 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.9 22 <nil> <nil>}

	I0925 03:47:23.316156    3510 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0925 03:47:23.376320    3510 main.go:141] libmachine: SSH cmd err, output: <nil>: 1695638843.434872596

	I0925 03:47:23.376326    3510 fix.go:206] guest clock: 1695638843.434872596

	I0925 03:47:23.376330    3510 fix.go:219] Guest: 2023-09-25 03:47:23.434872596 -0700 PDT Remote: 2023-09-25 03:47:23.315492 -0700 PDT m=+15.450360512 (delta=119.380596ms)

	I0925 03:47:23.376345    3510 fix.go:190] guest clock delta is within tolerance: 119.380596ms

	I0925 03:47:23.376347    3510 start.go:83] releasing machines lock for "second-784000", held for 14.981065179s

	I0925 03:47:23.376364    3510 main.go:141] libmachine: (second-784000) Calling .DriverName

	I0925 03:47:23.376491    3510 main.go:141] libmachine: (second-784000) Calling .GetIP

	I0925 03:47:23.376582    3510 main.go:141] libmachine: (second-784000) Calling .DriverName

	I0925 03:47:23.376840    3510 main.go:141] libmachine: (second-784000) Calling .DriverName

	I0925 03:47:23.376935    3510 main.go:141] libmachine: (second-784000) Calling .DriverName

	I0925 03:47:23.377025    3510 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0925 03:47:23.377045    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHHostname

	I0925 03:47:23.377096    3510 ssh_runner.go:195] Run: cat /version.json

	I0925 03:47:23.377103    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHHostname

	I0925 03:47:23.377135    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHPort

	I0925 03:47:23.377198    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:23.377201    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHPort

	I0925 03:47:23.377305    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHUsername

	I0925 03:47:23.377320    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHKeyPath

	I0925 03:47:23.377413    3510 sshutil.go:53] new ssh client: &{IP:192.168.64.9 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/id_rsa Username:docker}

	I0925 03:47:23.377427    3510 main.go:141] libmachine: (second-784000) Calling .GetSSHUsername

	I0925 03:47:23.377496    3510 sshutil.go:53] new ssh client: &{IP:192.168.64.9 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/second-784000/id_rsa Username:docker}

	I0925 03:47:23.409848    3510 ssh_runner.go:195] Run: systemctl --version

	I0925 03:47:23.454524    3510 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0925 03:47:23.458791    3510 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0925 03:47:23.458840    3510 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0925 03:47:23.469857    3510 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0925 03:47:23.469867    3510 start.go:469] detecting cgroup driver to use...

	I0925 03:47:23.469967    3510 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0925 03:47:23.481590    3510 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0925 03:47:23.488724    3510 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0925 03:47:23.495646    3510 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I0925 03:47:23.495684    3510 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0925 03:47:23.502647    3510 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0925 03:47:23.509525    3510 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0925 03:47:23.516476    3510 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0925 03:47:23.523472    3510 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0925 03:47:23.530676    3510 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0925 03:47:23.537711    3510 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0925 03:47:23.544030    3510 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0925 03:47:23.550843    3510 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0925 03:47:23.633100    3510 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0925 03:47:23.645224    3510 start.go:469] detecting cgroup driver to use...

	I0925 03:47:23.645292    3510 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0925 03:47:23.655867    3510 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0925 03:47:23.665834    3510 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0925 03:47:23.681018    3510 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0925 03:47:23.689754    3510 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0925 03:47:23.698610    3510 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0925 03:47:23.725942    3510 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0925 03:47:23.735194    3510 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0925 03:47:23.746890    3510 ssh_runner.go:195] Run: which cri-dockerd

	I0925 03:47:23.749345    3510 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0925 03:47:23.755434    3510 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0925 03:47:23.766322    3510 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0925 03:47:23.853763    3510 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0925 03:47:23.936937    3510 docker.go:554] configuring docker to use "cgroupfs" as cgroup driver...

	I0925 03:47:23.936999    3510 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0925 03:47:23.948209    3510 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0925 03:47:24.034878    3510 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0925 03:47:25.386028    3510 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.351113319s)

	I0925 03:47:25.386088    3510 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0925 03:47:25.470347    3510 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0925 03:47:25.553898    3510 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0925 03:47:25.652575    3510 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0925 03:47:25.741278    3510 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0925 03:47:25.774416    3510 out.go:177] 

	W0925 03:47:25.794388    3510 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart cri-docker.socket: Process exited with status 1

	stdout:

	stderr:

	Job failed. See "journalctl -xe" for details.

	W0925 03:47:25.794402    3510 out.go:239] * 

	W0925 03:47:25.794997    3510 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0925 03:47:25.860089    3510 out.go:177] 

	* 

	* ==> Docker <==

	* -- Journal begins at Mon 2023-09-25 10:46:42 UTC, ends at Mon 2023-09-25 10:47:32 UTC. --

	Sep 25 10:47:19 first-782000 dockerd[1176]: time="2023-09-25T10:47:19.174459093Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 25 10:47:19 first-782000 cri-dockerd[1060]: time="2023-09-25T10:47:19Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/0f2b921d312b5ff2d452cb5d0af821ccb49f9b5b21779b0539b6408b2834e438/resolv.conf as [nameserver 192.168.64.1]"

	Sep 25 10:47:19 first-782000 dockerd[1176]: time="2023-09-25T10:47:19.262669571Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 25 10:47:19 first-782000 dockerd[1176]: time="2023-09-25T10:47:19.262760674Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 25 10:47:19 first-782000 dockerd[1176]: time="2023-09-25T10:47:19.262783936Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Sep 25 10:47:19 first-782000 dockerd[1176]: time="2023-09-25T10:47:19.262802705Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 25 10:47:19 first-782000 dockerd[1176]: time="2023-09-25T10:47:19.550499489Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 25 10:47:19 first-782000 dockerd[1176]: time="2023-09-25T10:47:19.550553137Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 25 10:47:19 first-782000 dockerd[1176]: time="2023-09-25T10:47:19.550570835Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Sep 25 10:47:19 first-782000 dockerd[1176]: time="2023-09-25T10:47:19.550579053Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 25 10:47:19 first-782000 cri-dockerd[1060]: time="2023-09-25T10:47:19Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/808c456d58aaa0f63e985b645a4dea7eeb2ac4d4d0ec17369db9cfc0be239fe2/resolv.conf as [nameserver 192.168.64.1]"

	Sep 25 10:47:19 first-782000 dockerd[1176]: time="2023-09-25T10:47:19.845795003Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 25 10:47:19 first-782000 dockerd[1176]: time="2023-09-25T10:47:19.845859427Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 25 10:47:19 first-782000 dockerd[1176]: time="2023-09-25T10:47:19.845876665Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Sep 25 10:47:19 first-782000 dockerd[1176]: time="2023-09-25T10:47:19.845886145Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 25 10:47:20 first-782000 dockerd[1176]: time="2023-09-25T10:47:20.533212246Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 25 10:47:20 first-782000 dockerd[1176]: time="2023-09-25T10:47:20.533313090Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 25 10:47:20 first-782000 dockerd[1176]: time="2023-09-25T10:47:20.533325290Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Sep 25 10:47:20 first-782000 dockerd[1176]: time="2023-09-25T10:47:20.533332553Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 25 10:47:20 first-782000 cri-dockerd[1060]: time="2023-09-25T10:47:20Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/9db29fb3bfb4d194b009e04aa43aab3a7935aad3d2b78e2ec22fbf983c958ad5/resolv.conf as [nameserver 192.168.64.1]"

	Sep 25 10:47:20 first-782000 dockerd[1176]: time="2023-09-25T10:47:20.949773595Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 25 10:47:20 first-782000 dockerd[1176]: time="2023-09-25T10:47:20.949864062Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 25 10:47:20 first-782000 dockerd[1176]: time="2023-09-25T10:47:20.949899359Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Sep 25 10:47:20 first-782000 dockerd[1176]: time="2023-09-25T10:47:20.949920113Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 25 10:47:26 first-782000 cri-dockerd[1060]: time="2023-09-25T10:47:26Z" level=info msg="Docker cri received runtime config &RuntimeConfig{NetworkConfig:&NetworkConfig{PodCidr:10.244.0.0/24,},}"

	* 

	* ==> container status <==

	* CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	1a16824f4be85       ead0a4a53df89       12 seconds ago      Running             coredns                   0                   9db29fb3bfb4d       coredns-5dd5756b68-9dds8

	9da198c76a1cc       6e38f40d628db       13 seconds ago      Running             storage-provisioner       0                   808c456d58aaa       storage-provisioner

	7fcc0be93c5f3       c120fed2beb84       13 seconds ago      Running             kube-proxy                0                   0f2b921d312b5       kube-proxy-fsftk

	e26c076596053       7a5d9d67a13f6       32 seconds ago      Running             kube-scheduler            0                   aad23754491f0       kube-scheduler-first-782000

	7d346f1ae1bdb       73deb9a3f7025       32 seconds ago      Running             etcd                      0                   b618b77a733f6       etcd-first-782000

	6a1349a0cc400       55f13c92defb1       32 seconds ago      Running             kube-controller-manager   0                   6748a480a33de       kube-controller-manager-first-782000

	e0d638d581337       cdcab12b2dd16       32 seconds ago      Running             kube-apiserver            0                   855bb75ab564c       kube-apiserver-first-782000

	* 

	* ==> coredns [1a16824f4be8] <==

	* .:53

	[INFO] plugin/reload: Running configuration SHA512 = 82b95b61957b89eeea31bdaf6987f010031330ef97d5f8469dbdaa80b119a5b0c9955b961009dd5b77ee3ada002b456836be781510516cbd9d015b1a704a24ea

	CoreDNS-1.10.1

	linux/amd64, go1.20, 055b2c3

	[INFO] 127.0.0.1:50633 - 22957 "HINFO IN 8782597761479240492.1029431988610163596. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.004314682s

	* 

	* ==> describe nodes <==

	* Name:               first-782000

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=first-782000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=1bf6c3d5317028f348e55ea19d261973a6487d3c

	                    minikube.k8s.io/name=first-782000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_09_25T03_47_06_0700

	                    minikube.k8s.io/version=v1.31.2

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 25 Sep 2023 10:47:03 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  first-782000

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 25 Sep 2023 10:47:26 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 25 Sep 2023 10:47:26 +0000   Mon, 25 Sep 2023 10:47:01 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 25 Sep 2023 10:47:26 +0000   Mon, 25 Sep 2023 10:47:01 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 25 Sep 2023 10:47:26 +0000   Mon, 25 Sep 2023 10:47:01 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 25 Sep 2023 10:47:26 +0000   Mon, 25 Sep 2023 10:47:08 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.64.8

	  Hostname:    first-782000

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             5925796Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17784752Ki

	  hugepages-2Mi:      0

	  memory:             5925796Ki

	  pods:               110

	System Info:

	  Machine ID:                 b7b2a65d44714b1391309173fe84010f

	  System UUID:                cab711ee-0000-0000-b59c-149d997fca88

	  Boot ID:                    ef7bbc64-67bc-4c0d-9b26-c9a7e8899a9b

	  Kernel Version:             5.10.57

	  OS Image:                   Buildroot 2021.02.12

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://24.0.6

	  Kubelet Version:            v1.28.2

	  Kube-Proxy Version:         v1.28.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (7 in total)

	  Namespace                   Name                                    CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                    ------------  ----------  ---------------  -------------  ---

	  kube-system                 coredns-5dd5756b68-9dds8                100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (1%!)(MISSING)        170Mi (2%!)(MISSING)     14s

	  kube-system                 etcd-first-782000                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         28s

	  kube-system                 kube-apiserver-first-782000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         28s

	  kube-system                 kube-controller-manager-first-782000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         26s

	  kube-system                 kube-proxy-fsftk                        0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         14s

	  kube-system                 kube-scheduler-first-782000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         28s

	  kube-system                 storage-provisioner                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         25s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)

	  memory             170Mi (2%!)(MISSING)  170Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age   From             Message

	  ----    ------                   ----  ----             -------

	  Normal  Starting                 13s   kube-proxy       

	  Normal  Starting                 26s   kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  26s   kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  26s   kubelet          Node first-782000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    26s   kubelet          Node first-782000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     26s   kubelet          Node first-782000 status is now: NodeHasSufficientPID

	  Normal  NodeReady                24s   kubelet          Node first-782000 status is now: NodeReady

	  Normal  RegisteredNode           14s   node-controller  Node first-782000 event: Registered Node first-782000 in Controller

	* 

	* ==> dmesg <==

	* [  +5.033311] ACPI Error: Could not enable RealTimeClock event (20200925/evxfevnt-182)

	[  +0.000002] ACPI Warning: Could not enable fixed event - RealTimeClock (4) (20200925/evxface-618)

	[  +0.009113] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +2.987427] systemd-fstab-generator[125]: Ignoring "noauto" for root device

	[  +0.037669] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +1.856047] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000007] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)

	[  +0.208999] systemd-fstab-generator[538]: Ignoring "noauto" for root device

	[  +0.089769] systemd-fstab-generator[549]: Ignoring "noauto" for root device

	[  +0.651344] systemd-fstab-generator[726]: Ignoring "noauto" for root device

	[  +0.299123] systemd-fstab-generator[793]: Ignoring "noauto" for root device

	[  +0.086247] systemd-fstab-generator[804]: Ignoring "noauto" for root device

	[  +0.101310] systemd-fstab-generator[817]: Ignoring "noauto" for root device

	[  +1.536305] systemd-fstab-generator[975]: Ignoring "noauto" for root device

	[  +0.083905] systemd-fstab-generator[986]: Ignoring "noauto" for root device

	[  +0.085181] systemd-fstab-generator[997]: Ignoring "noauto" for root device

	[  +0.095917] systemd-fstab-generator[1008]: Ignoring "noauto" for root device

	[  +0.111999] systemd-fstab-generator[1027]: Ignoring "noauto" for root device

	[  +5.482207] systemd-fstab-generator[1161]: Ignoring "noauto" for root device

	[  +1.779904] kauditd_printk_skb: 55 callbacks suppressed

	[  +4.112616] systemd-fstab-generator[1543]: Ignoring "noauto" for root device

	[Sep25 10:47] systemd-fstab-generator[2427]: Ignoring "noauto" for root device

	[ +13.405489] kauditd_printk_skb: 39 callbacks suppressed

	* 

	* ==> etcd [7d346f1ae1bd] <==

	* {"level":"info","ts":"2023-09-25T10:47:01.243993Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}

	{"level":"info","ts":"2023-09-25T10:47:01.244283Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"e3e68400a5fb1db5 switched to configuration voters=(16421958229572656565)"}

	{"level":"info","ts":"2023-09-25T10:47:01.244438Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"833f6edb69fdc0db","local-member-id":"e3e68400a5fb1db5","added-peer-id":"e3e68400a5fb1db5","added-peer-peer-urls":["https://192.168.64.8:2380"]}

	{"level":"info","ts":"2023-09-25T10:47:01.806034Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"e3e68400a5fb1db5 is starting a new election at term 1"}

	{"level":"info","ts":"2023-09-25T10:47:01.806108Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"e3e68400a5fb1db5 became pre-candidate at term 1"}

	{"level":"info","ts":"2023-09-25T10:47:01.806238Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"e3e68400a5fb1db5 received MsgPreVoteResp from e3e68400a5fb1db5 at term 1"}

	{"level":"info","ts":"2023-09-25T10:47:01.806299Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"e3e68400a5fb1db5 became candidate at term 2"}

	{"level":"info","ts":"2023-09-25T10:47:01.806404Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"e3e68400a5fb1db5 received MsgVoteResp from e3e68400a5fb1db5 at term 2"}

	{"level":"info","ts":"2023-09-25T10:47:01.806451Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"e3e68400a5fb1db5 became leader at term 2"}

	{"level":"info","ts":"2023-09-25T10:47:01.806468Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: e3e68400a5fb1db5 elected leader e3e68400a5fb1db5 at term 2"}

	{"level":"info","ts":"2023-09-25T10:47:01.810997Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"e3e68400a5fb1db5","local-member-attributes":"{Name:first-782000 ClientURLs:[https://192.168.64.8:2379]}","request-path":"/0/members/e3e68400a5fb1db5/attributes","cluster-id":"833f6edb69fdc0db","publish-timeout":"7s"}

	{"level":"info","ts":"2023-09-25T10:47:01.810908Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2023-09-25T10:47:01.811381Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-09-25T10:47:01.812383Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-09-25T10:47:01.812507Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-09-25T10:47:01.81254Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-09-25T10:47:01.811523Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"833f6edb69fdc0db","local-member-id":"e3e68400a5fb1db5","cluster-version":"3.5"}

	{"level":"info","ts":"2023-09-25T10:47:01.812845Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-09-25T10:47:01.812935Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2023-09-25T10:47:01.811542Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-09-25T10:47:01.824975Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.64.8:2379"}

	{"level":"info","ts":"2023-09-25T10:47:08.139134Z","caller":"traceutil/trace.go:171","msg":"trace[2035897247] linearizableReadLoop","detail":"{readStateIndex:294; appliedIndex:293; }","duration":"112.820359ms","start":"2023-09-25T10:47:08.026298Z","end":"2023-09-25T10:47:08.139118Z","steps":["trace[2035897247] 'read index received'  (duration: 75.423152ms)","trace[2035897247] 'applied index is now lower than readState.Index'  (duration: 37.396091ms)"],"step_count":2}

	{"level":"info","ts":"2023-09-25T10:47:08.139511Z","caller":"traceutil/trace.go:171","msg":"trace[350997527] transaction","detail":"{read_only:false; response_revision:283; number_of_response:1; }","duration":"113.972981ms","start":"2023-09-25T10:47:08.025521Z","end":"2023-09-25T10:47:08.139494Z","steps":["trace[350997527] 'process raft request'  (duration: 113.483689ms)"],"step_count":1}

	{"level":"warn","ts":"2023-09-25T10:47:08.139483Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"113.075715ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/kube-system\" ","response":"range_response_count:1 size:351"}

	{"level":"info","ts":"2023-09-25T10:47:08.140025Z","caller":"traceutil/trace.go:171","msg":"trace[1005540572] range","detail":"{range_begin:/registry/namespaces/kube-system; range_end:; response_count:1; response_revision:283; }","duration":"113.770413ms","start":"2023-09-25T10:47:08.026244Z","end":"2023-09-25T10:47:08.140014Z","steps":["trace[1005540572] 'agreement among raft nodes before linearized reading'  (duration: 112.976281ms)"],"step_count":1}

	* 

	* ==> kernel <==

	*  10:47:32 up 0 min,  0 users,  load average: 0.60, 0.19, 0.07

	Linux first-782000 5.10.57 #1 SMP Mon Sep 18 23:12:38 UTC 2023 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [e0d638d58133] <==

	* I0925 10:47:03.099843       1 cache.go:39] Caches are synced for AvailableConditionController controller

	I0925 10:47:03.099878       1 shared_informer.go:318] Caches are synced for crd-autoregister

	I0925 10:47:03.099888       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller

	I0925 10:47:03.099980       1 aggregator.go:166] initial CRD sync complete...

	I0925 10:47:03.100009       1 autoregister_controller.go:141] Starting autoregister controller

	I0925 10:47:03.100013       1 cache.go:32] Waiting for caches to sync for autoregister controller

	I0925 10:47:03.100017       1 cache.go:39] Caches are synced for autoregister controller

	I0925 10:47:03.100622       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I0925 10:47:03.102050       1 controller.go:624] quota admission added evaluator for: namespaces

	I0925 10:47:03.122189       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io

	I0925 10:47:04.005146       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000

	I0925 10:47:04.008578       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000

	I0925 10:47:04.008607       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	I0925 10:47:04.325420       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0925 10:47:04.347896       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0925 10:47:04.398171       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}

	W0925 10:47:04.402113       1 lease.go:263] Resetting endpoints for master service "kubernetes" to [192.168.64.8]

	I0925 10:47:04.402953       1 controller.go:624] quota admission added evaluator for: endpoints

	I0925 10:47:04.405488       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0925 10:47:05.080315       1 controller.go:624] quota admission added evaluator for: serviceaccounts

	I0925 10:47:06.125254       1 controller.go:624] quota admission added evaluator for: deployments.apps

	I0925 10:47:06.134798       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}

	I0925 10:47:06.141203       1 controller.go:624] quota admission added evaluator for: daemonsets.apps

	I0925 10:47:18.355112       1 controller.go:624] quota admission added evaluator for: replicasets.apps

	I0925 10:47:18.822239       1 controller.go:624] quota admission added evaluator for: controllerrevisions.apps

	* 

	* ==> kube-controller-manager [6a1349a0cc40] <==

	* I0925 10:47:18.379585       1 shared_informer.go:318] Caches are synced for TTL

	I0925 10:47:18.379628       1 shared_informer.go:318] Caches are synced for TTL after finished

	I0925 10:47:18.381648       1 shared_informer.go:318] Caches are synced for ReplicationController

	I0925 10:47:18.384945       1 shared_informer.go:318] Caches are synced for endpoint

	I0925 10:47:18.385127       1 shared_informer.go:318] Caches are synced for HPA

	I0925 10:47:18.385206       1 shared_informer.go:318] Caches are synced for PV protection

	I0925 10:47:18.386086       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="28.444556ms"

	I0925 10:47:18.389072       1 shared_informer.go:318] Caches are synced for stateful set

	I0925 10:47:18.404871       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="17.958955ms"

	I0925 10:47:18.413899       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="8.800144ms"

	I0925 10:47:18.414017       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="31.028µs"

	I0925 10:47:18.428404       1 shared_informer.go:318] Caches are synced for crt configmap

	I0925 10:47:18.440239       1 shared_informer.go:318] Caches are synced for resource quota

	I0925 10:47:18.459504       1 shared_informer.go:318] Caches are synced for bootstrap_signer

	I0925 10:47:18.474589       1 shared_informer.go:318] Caches are synced for resource quota

	I0925 10:47:18.564976       1 shared_informer.go:318] Caches are synced for attach detach

	I0925 10:47:18.828554       1 event.go:307] "Event occurred" object="kube-system/kube-proxy" fieldPath="" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-fsftk"

	I0925 10:47:18.890177       1 shared_informer.go:318] Caches are synced for garbage collector

	I0925 10:47:18.931844       1 shared_informer.go:318] Caches are synced for garbage collector

	I0925 10:47:18.932077       1 garbagecollector.go:166] "All resource monitors have synced. Proceeding to collect garbage"

	I0925 10:47:20.188070       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="110.25µs"

	I0925 10:47:20.197892       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="48.281µs"

	I0925 10:47:21.414413       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="53.085µs"

	I0925 10:47:21.433679       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="9.037624ms"

	I0925 10:47:21.434093       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="44.431µs"

	* 

	* ==> kube-proxy [7fcc0be93c5f] <==

	* I0925 10:47:19.337437       1 server_others.go:69] "Using iptables proxy"

	I0925 10:47:19.343214       1 node.go:141] Successfully retrieved node IP: 192.168.64.8

	I0925 10:47:19.364883       1 server_others.go:121] "No iptables support for family" ipFamily="IPv6"

	I0925 10:47:19.364918       1 server.go:634] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0925 10:47:19.367182       1 server_others.go:152] "Using iptables Proxier"

	I0925 10:47:19.367222       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0925 10:47:19.367448       1 server.go:846] "Version info" version="v1.28.2"

	I0925 10:47:19.367479       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0925 10:47:19.368066       1 config.go:188] "Starting service config controller"

	I0925 10:47:19.368099       1 shared_informer.go:311] Waiting for caches to sync for service config

	I0925 10:47:19.368112       1 config.go:97] "Starting endpoint slice config controller"

	I0925 10:47:19.368115       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I0925 10:47:19.368173       1 config.go:315] "Starting node config controller"

	I0925 10:47:19.368217       1 shared_informer.go:311] Waiting for caches to sync for node config

	I0925 10:47:19.472087       1 shared_informer.go:318] Caches are synced for node config

	I0925 10:47:19.472529       1 shared_informer.go:318] Caches are synced for endpoint slice config

	I0925 10:47:19.472576       1 shared_informer.go:318] Caches are synced for service config

	* 

	* ==> kube-scheduler [e26c07659605] <==

	* W0925 10:47:03.081524       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0925 10:47:03.081558       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W0925 10:47:03.081668       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0925 10:47:03.081737       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	W0925 10:47:03.081685       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0925 10:47:03.082054       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W0925 10:47:03.081858       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0925 10:47:03.082337       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	W0925 10:47:03.900127       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0925 10:47:03.900165       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0925 10:47:03.929317       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0925 10:47:03.929404       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	W0925 10:47:04.026518       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0925 10:47:04.026556       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0925 10:47:04.026645       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0925 10:47:04.026653       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0925 10:47:04.140739       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0925 10:47:04.140758       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0925 10:47:04.175213       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0925 10:47:04.175294       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W0925 10:47:04.200260       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0925 10:47:04.200559       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0925 10:47:04.204708       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0925 10:47:04.204777       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	I0925 10:47:04.573757       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kubelet <==

	* -- Journal begins at Mon 2023-09-25 10:46:42 UTC, ends at Mon 2023-09-25 10:47:33 UTC. --

	Sep 25 10:47:07 first-782000 kubelet[2446]: I0925 10:47:07.240405    2446 desired_state_of_world_populator.go:159] "Finished populating initial desired state of world"

	Sep 25 10:47:07 first-782000 kubelet[2446]: I0925 10:47:07.367736    2446 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/etcd-first-782000" podStartSLOduration=3.367683048 podCreationTimestamp="2023-09-25 10:47:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-09-25 10:47:07.361341184 +0000 UTC m=+1.252337182" watchObservedRunningTime="2023-09-25 10:47:07.367683048 +0000 UTC m=+1.258679039"

	Sep 25 10:47:07 first-782000 kubelet[2446]: I0925 10:47:07.374294    2446 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-apiserver-first-782000" podStartSLOduration=3.374268376 podCreationTimestamp="2023-09-25 10:47:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-09-25 10:47:07.368069059 +0000 UTC m=+1.259065050" watchObservedRunningTime="2023-09-25 10:47:07.374268376 +0000 UTC m=+1.265264368"

	Sep 25 10:47:07 first-782000 kubelet[2446]: I0925 10:47:07.383479    2446 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-scheduler-first-782000" podStartSLOduration=3.383453212 podCreationTimestamp="2023-09-25 10:47:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-09-25 10:47:07.374746965 +0000 UTC m=+1.265742962" watchObservedRunningTime="2023-09-25 10:47:07.383453212 +0000 UTC m=+1.274449209"

	Sep 25 10:47:07 first-782000 kubelet[2446]: I0925 10:47:07.393396    2446 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-controller-manager-first-782000" podStartSLOduration=1.3933691879999999 podCreationTimestamp="2023-09-25 10:47:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-09-25 10:47:07.384404569 +0000 UTC m=+1.275400565" watchObservedRunningTime="2023-09-25 10:47:07.393369188 +0000 UTC m=+1.284365177"

	Sep 25 10:47:08 first-782000 kubelet[2446]: I0925 10:47:08.021208    2446 kubelet_node_status.go:493] "Fast updating node status as it just became ready"

	Sep 25 10:47:18 first-782000 kubelet[2446]: I0925 10:47:18.553787    2446 topology_manager.go:215] "Topology Admit Handler" podUID="c36d9e5b-55b7-403f-a8ce-0b027507d239" podNamespace="kube-system" podName="storage-provisioner"

	Sep 25 10:47:18 first-782000 kubelet[2446]: I0925 10:47:18.633786    2446 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/c36d9e5b-55b7-403f-a8ce-0b027507d239-tmp\") pod \"storage-provisioner\" (UID: \"c36d9e5b-55b7-403f-a8ce-0b027507d239\") " pod="kube-system/storage-provisioner"

	Sep 25 10:47:18 first-782000 kubelet[2446]: I0925 10:47:18.633959    2446 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt9tj\" (UniqueName: \"kubernetes.io/projected/c36d9e5b-55b7-403f-a8ce-0b027507d239-kube-api-access-bt9tj\") pod \"storage-provisioner\" (UID: \"c36d9e5b-55b7-403f-a8ce-0b027507d239\") " pod="kube-system/storage-provisioner"

	Sep 25 10:47:18 first-782000 kubelet[2446]: E0925 10:47:18.738939    2446 projected.go:292] Couldn't get configMap kube-system/kube-root-ca.crt: configmap "kube-root-ca.crt" not found

	Sep 25 10:47:18 first-782000 kubelet[2446]: E0925 10:47:18.739048    2446 projected.go:198] Error preparing data for projected volume kube-api-access-bt9tj for pod kube-system/storage-provisioner: configmap "kube-root-ca.crt" not found

	Sep 25 10:47:18 first-782000 kubelet[2446]: E0925 10:47:18.739127    2446 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c36d9e5b-55b7-403f-a8ce-0b027507d239-kube-api-access-bt9tj podName:c36d9e5b-55b7-403f-a8ce-0b027507d239 nodeName:}" failed. No retries permitted until 2023-09-25 10:47:19.239112495 +0000 UTC m=+13.130108484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bt9tj" (UniqueName: "kubernetes.io/projected/c36d9e5b-55b7-403f-a8ce-0b027507d239-kube-api-access-bt9tj") pod "storage-provisioner" (UID: "c36d9e5b-55b7-403f-a8ce-0b027507d239") : configmap "kube-root-ca.crt" not found

	Sep 25 10:47:18 first-782000 kubelet[2446]: I0925 10:47:18.831829    2446 topology_manager.go:215] "Topology Admit Handler" podUID="33f325ea-75ae-41f4-ae95-4b92497c9038" podNamespace="kube-system" podName="kube-proxy-fsftk"

	Sep 25 10:47:18 first-782000 kubelet[2446]: I0925 10:47:18.935554    2446 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33f325ea-75ae-41f4-ae95-4b92497c9038-lib-modules\") pod \"kube-proxy-fsftk\" (UID: \"33f325ea-75ae-41f4-ae95-4b92497c9038\") " pod="kube-system/kube-proxy-fsftk"

	Sep 25 10:47:18 first-782000 kubelet[2446]: I0925 10:47:18.935612    2446 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/33f325ea-75ae-41f4-ae95-4b92497c9038-xtables-lock\") pod \"kube-proxy-fsftk\" (UID: \"33f325ea-75ae-41f4-ae95-4b92497c9038\") " pod="kube-system/kube-proxy-fsftk"

	Sep 25 10:47:18 first-782000 kubelet[2446]: I0925 10:47:18.935635    2446 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcj27\" (UniqueName: \"kubernetes.io/projected/33f325ea-75ae-41f4-ae95-4b92497c9038-kube-api-access-jcj27\") pod \"kube-proxy-fsftk\" (UID: \"33f325ea-75ae-41f4-ae95-4b92497c9038\") " pod="kube-system/kube-proxy-fsftk"

	Sep 25 10:47:18 first-782000 kubelet[2446]: I0925 10:47:18.935655    2446 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/33f325ea-75ae-41f4-ae95-4b92497c9038-kube-proxy\") pod \"kube-proxy-fsftk\" (UID: \"33f325ea-75ae-41f4-ae95-4b92497c9038\") " pod="kube-system/kube-proxy-fsftk"

	Sep 25 10:47:20 first-782000 kubelet[2446]: I0925 10:47:20.187615    2446 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-proxy-fsftk" podStartSLOduration=2.187540486 podCreationTimestamp="2023-09-25 10:47:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-09-25 10:47:19.392316938 +0000 UTC m=+13.283312929" watchObservedRunningTime="2023-09-25 10:47:20.187540486 +0000 UTC m=+14.078536476"

	Sep 25 10:47:20 first-782000 kubelet[2446]: I0925 10:47:20.188024    2446 topology_manager.go:215] "Topology Admit Handler" podUID="20a762f9-8804-410a-b8c2-d6340f031479" podNamespace="kube-system" podName="coredns-5dd5756b68-9dds8"

	Sep 25 10:47:20 first-782000 kubelet[2446]: I0925 10:47:20.246600    2446 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/20a762f9-8804-410a-b8c2-d6340f031479-config-volume\") pod \"coredns-5dd5756b68-9dds8\" (UID: \"20a762f9-8804-410a-b8c2-d6340f031479\") " pod="kube-system/coredns-5dd5756b68-9dds8"

	Sep 25 10:47:20 first-782000 kubelet[2446]: I0925 10:47:20.246819    2446 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc9nl\" (UniqueName: \"kubernetes.io/projected/20a762f9-8804-410a-b8c2-d6340f031479-kube-api-access-dc9nl\") pod \"coredns-5dd5756b68-9dds8\" (UID: \"20a762f9-8804-410a-b8c2-d6340f031479\") " pod="kube-system/coredns-5dd5756b68-9dds8"

	Sep 25 10:47:20 first-782000 kubelet[2446]: I0925 10:47:20.819576    2446 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/storage-provisioner" podStartSLOduration=13.819550562 podCreationTimestamp="2023-09-25 10:47:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-09-25 10:47:20.402071167 +0000 UTC m=+14.293067163" watchObservedRunningTime="2023-09-25 10:47:20.819550562 +0000 UTC m=+14.710546553"

	Sep 25 10:47:21 first-782000 kubelet[2446]: I0925 10:47:21.415918    2446 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/coredns-5dd5756b68-9dds8" podStartSLOduration=3.415854151 podCreationTimestamp="2023-09-25 10:47:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-09-25 10:47:21.415546708 +0000 UTC m=+15.306542705" watchObservedRunningTime="2023-09-25 10:47:21.415854151 +0000 UTC m=+15.306850142"

	Sep 25 10:47:26 first-782000 kubelet[2446]: I0925 10:47:26.981225    2446 kuberuntime_manager.go:1523] "Updating runtime config through cri with podcidr" CIDR="10.244.0.0/24"

	Sep 25 10:47:26 first-782000 kubelet[2446]: I0925 10:47:26.982608    2446 kubelet_network.go:61] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.244.0.0/24"

	* 

	* ==> storage-provisioner [9da198c76a1c] <==

	* I0925 10:47:19.907243       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0925 10:47:19.912876       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0925 10:47:19.913576       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0925 10:47:19.918474       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0925 10:47:19.918638       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_first-782000_405272d0-8122-479f-97b5-09c0b46aeeb3!

	I0925 10:47:19.920092       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"94bda7ba-dd1c-4fc6-a006-0186c60c2d0c", APIVersion:"v1", ResourceVersion:"354", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' first-782000_405272d0-8122-479f-97b5-09c0b46aeeb3 became leader

	I0925 10:47:20.019963       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_first-782000_405272d0-8122-479f-97b5-09c0b46aeeb3!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.APIServer}} -p first-782000 -n first-782000

helpers_test.go:261: (dbg) Run:  kubectl --context first-782000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMinikubeProfile FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

helpers_test.go:175: Cleaning up "first-782000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p first-782000

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p first-782000: (5.245470878s)

--- FAIL: TestMinikubeProfile (66.42s)

=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages

start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 ssh -p old-k8s-version-596000 "sudo crictl images -o json"

start_stop_delete_test.go:304: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p old-k8s-version-596000 "sudo crictl images -o json": exit status 1 (143.719586ms)

-- stdout --

	FATA[0000] validate service connection: validate CRI v1 image API for endpoint "unix:///var/run/dockershim.sock": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService 

-- /stdout --

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

start_stop_delete_test.go:304: failed to get images inside minikube. args "out/minikube-darwin-amd64 ssh -p old-k8s-version-596000 \"sudo crictl images -o json\"": exit status 1

start_stop_delete_test.go:304: failed to decode images json invalid character '\x1b' looking for beginning of value. output:

FATA[0000] validate service connection: validate CRI v1 image API for endpoint "unix:///var/run/dockershim.sock": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService 

start_stop_delete_test.go:304: v1.16.0 images missing (-want +got):

  []string{

- 	"k8s.gcr.io/coredns:1.6.2",

- 	"k8s.gcr.io/etcd:3.3.15-0",

- 	"k8s.gcr.io/k8s-minikube/storage-provisioner:v5",

- 	"k8s.gcr.io/kube-apiserver:v1.16.0",

- 	"k8s.gcr.io/kube-controller-manager:v1.16.0",

- 	"k8s.gcr.io/kube-proxy:v1.16.0",

- 	"k8s.gcr.io/kube-scheduler:v1.16.0",

- 	"k8s.gcr.io/pause:3.1",

  }

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-596000 -n old-k8s-version-596000

helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-darwin-amd64 -p old-k8s-version-596000 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-darwin-amd64 -p old-k8s-version-596000 logs -n 25: (2.078200561s)

helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|--------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|

	| Command |                          Args                          |        Profile         |  User   | Version |     Start Time      |      End Time       |

	|---------|--------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|

	| ssh     | -p false-803000 sudo systemctl                         | false-803000           | jenkins | v1.31.2 | 25 Sep 23 04:19 PDT |                     |

	|         | status crio --all --full                               |                        |         |         |                     |                     |

	|         | --no-pager                                             |                        |         |         |                     |                     |

	| ssh     | -p false-803000 sudo systemctl                         | false-803000           | jenkins | v1.31.2 | 25 Sep 23 04:19 PDT | 25 Sep 23 04:19 PDT |

	|         | cat crio --no-pager                                    |                        |         |         |                     |                     |

	| ssh     | -p false-803000 sudo find                              | false-803000           | jenkins | v1.31.2 | 25 Sep 23 04:19 PDT | 25 Sep 23 04:19 PDT |

	|         | /etc/crio -type f -exec sh -c                          |                        |         |         |                     |                     |

	|         | 'echo {}; cat {}' \;                                   |                        |         |         |                     |                     |

	| ssh     | -p false-803000 sudo crio                              | false-803000           | jenkins | v1.31.2 | 25 Sep 23 04:19 PDT | 25 Sep 23 04:19 PDT |

	|         | config                                                 |                        |         |         |                     |                     |

	| delete  | -p false-803000                                        | false-803000           | jenkins | v1.31.2 | 25 Sep 23 04:19 PDT | 25 Sep 23 04:19 PDT |

	| start   | -p no-preload-821000                                   | no-preload-821000      | jenkins | v1.31.2 | 25 Sep 23 04:19 PDT | 25 Sep 23 04:20 PDT |

	|         | --memory=2200                                          |                        |         |         |                     |                     |

	|         | --alsologtostderr                                      |                        |         |         |                     |                     |

	|         | --wait=true --preload=false                            |                        |         |         |                     |                     |

	|         | --driver=hyperkit                                      |                        |         |         |                     |                     |

	|         | --kubernetes-version=v1.28.2                           |                        |         |         |                     |                     |

	| addons  | enable metrics-server -p old-k8s-version-596000        | old-k8s-version-596000 | jenkins | v1.31.2 | 25 Sep 23 04:20 PDT | 25 Sep 23 04:20 PDT |

	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                        |         |         |                     |                     |

	|         | --registries=MetricsServer=fake.domain                 |                        |         |         |                     |                     |

	| stop    | -p old-k8s-version-596000                              | old-k8s-version-596000 | jenkins | v1.31.2 | 25 Sep 23 04:20 PDT | 25 Sep 23 04:20 PDT |

	|         | --alsologtostderr -v=3                                 |                        |         |         |                     |                     |

	| addons  | enable dashboard -p old-k8s-version-596000             | old-k8s-version-596000 | jenkins | v1.31.2 | 25 Sep 23 04:20 PDT | 25 Sep 23 04:20 PDT |

	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                        |         |         |                     |                     |

	| start   | -p old-k8s-version-596000                              | old-k8s-version-596000 | jenkins | v1.31.2 | 25 Sep 23 04:20 PDT | 25 Sep 23 04:28 PDT |

	|         | --memory=2200                                          |                        |         |         |                     |                     |

	|         | --alsologtostderr --wait=true                          |                        |         |         |                     |                     |

	|         | --kvm-network=default                                  |                        |         |         |                     |                     |

	|         | --kvm-qemu-uri=qemu:///system                          |                        |         |         |                     |                     |

	|         | --disable-driver-mounts                                |                        |         |         |                     |                     |

	|         | --keep-context=false                                   |                        |         |         |                     |                     |

	|         | --driver=hyperkit                                      |                        |         |         |                     |                     |

	|         | --kubernetes-version=v1.16.0                           |                        |         |         |                     |                     |

	| addons  | enable metrics-server -p no-preload-821000             | no-preload-821000      | jenkins | v1.31.2 | 25 Sep 23 04:20 PDT | 25 Sep 23 04:20 PDT |

	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                        |         |         |                     |                     |

	|         | --registries=MetricsServer=fake.domain                 |                        |         |         |                     |                     |

	| stop    | -p no-preload-821000                                   | no-preload-821000      | jenkins | v1.31.2 | 25 Sep 23 04:20 PDT | 25 Sep 23 04:20 PDT |

	|         | --alsologtostderr -v=3                                 |                        |         |         |                     |                     |

	| addons  | enable dashboard -p no-preload-821000                  | no-preload-821000      | jenkins | v1.31.2 | 25 Sep 23 04:20 PDT | 25 Sep 23 04:20 PDT |

	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                        |         |         |                     |                     |

	| start   | -p no-preload-821000                                   | no-preload-821000      | jenkins | v1.31.2 | 25 Sep 23 04:21 PDT | 25 Sep 23 04:25 PDT |

	|         | --memory=2200                                          |                        |         |         |                     |                     |

	|         | --alsologtostderr                                      |                        |         |         |                     |                     |

	|         | --wait=true --preload=false                            |                        |         |         |                     |                     |

	|         | --driver=hyperkit                                      |                        |         |         |                     |                     |

	|         | --kubernetes-version=v1.28.2                           |                        |         |         |                     |                     |

	| ssh     | -p no-preload-821000 sudo                              | no-preload-821000      | jenkins | v1.31.2 | 25 Sep 23 04:26 PDT | 25 Sep 23 04:26 PDT |

	|         | crictl images -o json                                  |                        |         |         |                     |                     |

	| pause   | -p no-preload-821000                                   | no-preload-821000      | jenkins | v1.31.2 | 25 Sep 23 04:26 PDT | 25 Sep 23 04:26 PDT |

	|         | --alsologtostderr -v=1                                 |                        |         |         |                     |                     |

	| unpause | -p no-preload-821000                                   | no-preload-821000      | jenkins | v1.31.2 | 25 Sep 23 04:26 PDT | 25 Sep 23 04:26 PDT |

	|         | --alsologtostderr -v=1                                 |                        |         |         |                     |                     |

	| delete  | -p no-preload-821000                                   | no-preload-821000      | jenkins | v1.31.2 | 25 Sep 23 04:26 PDT | 25 Sep 23 04:26 PDT |

	| delete  | -p no-preload-821000                                   | no-preload-821000      | jenkins | v1.31.2 | 25 Sep 23 04:26 PDT | 25 Sep 23 04:26 PDT |

	| start   | -p embed-certs-952000                                  | embed-certs-952000     | jenkins | v1.31.2 | 25 Sep 23 04:26 PDT | 25 Sep 23 04:27 PDT |

	|         | --memory=2200                                          |                        |         |         |                     |                     |

	|         | --alsologtostderr                                      |                        |         |         |                     |                     |

	|         | --wait=true --embed-certs                              |                        |         |         |                     |                     |

	|         | --driver=hyperkit                                      |                        |         |         |                     |                     |

	|         | --kubernetes-version=v1.28.2                           |                        |         |         |                     |                     |

	| addons  | enable metrics-server -p embed-certs-952000            | embed-certs-952000     | jenkins | v1.31.2 | 25 Sep 23 04:27 PDT | 25 Sep 23 04:27 PDT |

	|         | --images=MetricsServer=registry.k8s.io/echoserver:1.4  |                        |         |         |                     |                     |

	|         | --registries=MetricsServer=fake.domain                 |                        |         |         |                     |                     |

	| stop    | -p embed-certs-952000                                  | embed-certs-952000     | jenkins | v1.31.2 | 25 Sep 23 04:27 PDT | 25 Sep 23 04:28 PDT |

	|         | --alsologtostderr -v=3                                 |                        |         |         |                     |                     |

	| addons  | enable dashboard -p embed-certs-952000                 | embed-certs-952000     | jenkins | v1.31.2 | 25 Sep 23 04:28 PDT | 25 Sep 23 04:28 PDT |

	|         | --images=MetricsScraper=registry.k8s.io/echoserver:1.4 |                        |         |         |                     |                     |

	| start   | -p embed-certs-952000                                  | embed-certs-952000     | jenkins | v1.31.2 | 25 Sep 23 04:28 PDT |                     |

	|         | --memory=2200                                          |                        |         |         |                     |                     |

	|         | --alsologtostderr                                      |                        |         |         |                     |                     |

	|         | --wait=true --embed-certs                              |                        |         |         |                     |                     |

	|         | --driver=hyperkit                                      |                        |         |         |                     |                     |

	|         | --kubernetes-version=v1.28.2                           |                        |         |         |                     |                     |

	| ssh     | -p old-k8s-version-596000 sudo                         | old-k8s-version-596000 | jenkins | v1.31.2 | 25 Sep 23 04:28 PDT |                     |

	|         | crictl images -o json                                  |                        |         |         |                     |                     |

	|---------|--------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/09/25 04:28:03

	Running on machine: MacOS-Agent-4

	Binary: Built with gc go1.21.1 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0925 04:28:03.276312    9153 out.go:296] Setting OutFile to fd 1 ...

	I0925 04:28:03.276556    9153 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0925 04:28:03.276561    9153 out.go:309] Setting ErrFile to fd 2...

	I0925 04:28:03.276565    9153 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0925 04:28:03.276745    9153 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17297-1019/.minikube/bin

	I0925 04:28:03.278080    9153 out.go:303] Setting JSON to false

	I0925 04:28:03.297498    9153 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":3457,"bootTime":1695637826,"procs":442,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.6","kernelVersion":"22.6.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}

	W0925 04:28:03.297589    9153 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I0925 04:28:03.320015    9153 out.go:177] * [embed-certs-952000] minikube v1.31.2 on Darwin 13.6

	I0925 04:28:03.363258    9153 out.go:177]   - MINIKUBE_LOCATION=17297

	I0925 04:28:03.363329    9153 notify.go:220] Checking for updates...

	I0925 04:28:03.406012    9153 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17297-1019/kubeconfig

	I0925 04:28:03.427103    9153 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0925 04:28:03.448270    9153 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0925 04:28:03.469343    9153 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17297-1019/.minikube

	I0925 04:28:03.490173    9153 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0925 04:28:03.512021    9153 config.go:182] Loaded profile config "embed-certs-952000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I0925 04:28:03.512746    9153 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 04:28:03.512828    9153 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 04:28:03.520861    9153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56460

	I0925 04:28:03.521220    9153 main.go:141] libmachine: () Calling .GetVersion

	I0925 04:28:03.521655    9153 main.go:141] libmachine: Using API Version  1

	I0925 04:28:03.521669    9153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 04:28:03.521920    9153 main.go:141] libmachine: () Calling .GetMachineName

	I0925 04:28:03.522057    9153 main.go:141] libmachine: (embed-certs-952000) Calling .DriverName

	I0925 04:28:03.522250    9153 driver.go:373] Setting default libvirt URI to qemu:///system

	I0925 04:28:03.522486    9153 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 04:28:03.522529    9153 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 04:28:03.529639    9153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56462

	I0925 04:28:03.529961    9153 main.go:141] libmachine: () Calling .GetVersion

	I0925 04:28:03.530339    9153 main.go:141] libmachine: Using API Version  1

	I0925 04:28:03.530356    9153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 04:28:03.530564    9153 main.go:141] libmachine: () Calling .GetMachineName

	I0925 04:28:03.530675    9153 main.go:141] libmachine: (embed-certs-952000) Calling .DriverName

	I0925 04:28:03.558066    9153 out.go:177] * Using the hyperkit driver based on existing profile

	I0925 04:28:03.600239    9153 start.go:298] selected driver: hyperkit

	I0925 04:28:03.600266    9153 start.go:902] validating driver "hyperkit" against &{Name:embed-certs-952000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet

esConfig:{KubernetesVersion:v1.28.2 ClusterName:embed-certs-952000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.42 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedP

orts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I0925 04:28:03.600467    9153 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0925 04:28:03.604438    9153 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0925 04:28:03.604529    9153 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17297-1019/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin

	I0925 04:28:03.611398    9153 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.31.2

	I0925 04:28:03.614883    9153 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 04:28:03.614901    9153 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good

	I0925 04:28:03.615021    9153 start_flags.go:922] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0925 04:28:03.615048    9153 cni.go:84] Creating CNI manager for ""

	I0925 04:28:03.615060    9153 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0925 04:28:03.615073    9153 start_flags.go:321] config:

	{Name:embed-certs-952000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:embed-certs-952000 Namespace:defau

lt APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.42 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 Cert

Expiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I0925 04:28:03.615207    9153 iso.go:125] acquiring lock: {Name:mk5685b8103aa0f952a2e44c47bdd1882fdd0bc3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0925 04:28:03.657080    9153 out.go:177] * Starting control plane node embed-certs-952000 in cluster embed-certs-952000

	I0925 04:28:03.677962    9153 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I0925 04:28:03.678018    9153 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17297-1019/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4

	I0925 04:28:03.678058    9153 cache.go:57] Caching tarball of preloaded images

	I0925 04:28:03.678163    9153 preload.go:174] Found /Users/jenkins/minikube-integration/17297-1019/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0925 04:28:03.678173    9153 cache.go:60] Finished verifying existence of preloaded tar for  v1.28.2 on docker

	I0925 04:28:03.678261    9153 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/embed-certs-952000/config.json ...

	I0925 04:28:03.678622    9153 start.go:365] acquiring machines lock for embed-certs-952000: {Name:mkc5a9c335a363bfa8f942e55cb9e7e0d08ada9f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0925 04:28:03.678672    9153 start.go:369] acquired machines lock for "embed-certs-952000" in 38.169µs

	I0925 04:28:03.678691    9153 start.go:96] Skipping create...Using existing machine configuration

	I0925 04:28:03.678710    9153 fix.go:54] fixHost starting: 

	I0925 04:28:03.678926    9153 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 04:28:03.678948    9153 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 04:28:03.686221    9153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56464

	I0925 04:28:03.686543    9153 main.go:141] libmachine: () Calling .GetVersion

	I0925 04:28:03.686940    9153 main.go:141] libmachine: Using API Version  1

	I0925 04:28:03.686956    9153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 04:28:03.687191    9153 main.go:141] libmachine: () Calling .GetMachineName

	I0925 04:28:03.687319    9153 main.go:141] libmachine: (embed-certs-952000) Calling .DriverName

	I0925 04:28:03.687414    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetState

	I0925 04:28:03.687510    9153 main.go:141] libmachine: (embed-certs-952000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:28:03.687568    9153 main.go:141] libmachine: (embed-certs-952000) DBG | hyperkit pid from json: 9084

	I0925 04:28:03.688538    9153 main.go:141] libmachine: (embed-certs-952000) DBG | hyperkit pid 9084 missing from process table

	I0925 04:28:03.688568    9153 fix.go:102] recreateIfNeeded on embed-certs-952000: state=Stopped err=<nil>

	I0925 04:28:03.688586    9153 main.go:141] libmachine: (embed-certs-952000) Calling .DriverName

	W0925 04:28:03.688663    9153 fix.go:128] unexpected machine state, will restart: <nil>

	I0925 04:28:03.747375    9153 out.go:177] * Restarting existing hyperkit VM for "embed-certs-952000" ...

	I0925 04:28:04.442023    8765 system_pods.go:86] 4 kube-system pods found

	I0925 04:28:04.442037    8765 system_pods.go:89] "coredns-5644d7b6d9-fhm6m" [261b0b1b-bbe6-420e-af7f-6e7cab5f7c35] Running

	I0925 04:28:04.442041    8765 system_pods.go:89] "kube-proxy-9jcsn" [1329f3cf-e0f3-43b7-8d1e-23961ea3ffe7] Running

	I0925 04:28:04.442046    8765 system_pods.go:89] "metrics-server-74d5856cc6-8mcq6" [e3f5ea81-2285-4c21-9779-49cd559184dc] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0925 04:28:04.442051    8765 system_pods.go:89] "storage-provisioner" [5b3475c5-65f3-44a9-8561-bf6c52a49a9e] Running

	I0925 04:28:04.442060    8765 retry.go:31] will retry after 5.989730828s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler

	I0925 04:28:03.770293    9153 main.go:141] libmachine: (embed-certs-952000) Calling .Start

	I0925 04:28:03.770507    9153 main.go:141] libmachine: (embed-certs-952000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:28:03.770542    9153 main.go:141] libmachine: (embed-certs-952000) minikube might have been shutdown in an unclean way, the hyperkit pid file still exists: /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/hyperkit.pid

	I0925 04:28:03.771718    9153 main.go:141] libmachine: (embed-certs-952000) DBG | hyperkit pid 9084 missing from process table

	I0925 04:28:03.771736    9153 main.go:141] libmachine: (embed-certs-952000) DBG | pid 9084 is in state "Stopped"

	I0925 04:28:03.771748    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Removing stale pid file /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/hyperkit.pid...

	I0925 04:28:03.771867    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Using UUID 586bb914-5b96-11ee-be5f-149d997fca88

	I0925 04:28:03.800542    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Generated MAC 26:bc:14:7f:ef:ed

	I0925 04:28:03.800568    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Starting with cmdline: loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=embed-certs-952000

	I0925 04:28:03.800715    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:03 DEBUG: hyperkit: Start &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"586bb914-5b96-11ee-be5f-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc00040a600)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/bzimage", Initrd:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:

(*os.Process)(nil)}

	I0925 04:28:03.800745    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:03 DEBUG: hyperkit: check &hyperkit.HyperKit{HyperKit:"/usr/local/bin/hyperkit", Argv0:"", StateDir:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000", VPNKitSock:"", VPNKitUUID:"", VPNKitPreferredIPv4:"", UUID:"586bb914-5b96-11ee-be5f-149d997fca88", Disks:[]hyperkit.Disk{(*hyperkit.RawDisk)(0xc00040a600)}, ISOImages:[]string{"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/boot2docker.iso"}, VSock:false, VSockDir:"", VSockPorts:[]int(nil), VSockGuestCID:3, VMNet:true, Sockets9P:[]hyperkit.Socket9P(nil), Kernel:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/bzimage", Initrd:"/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/initrd", Bootrom:"", CPUs:2, Memory:2200, Console:1, Serials:[]hyperkit.Serial(nil), Pid:0, Arguments:[]string(nil), CmdLine:"", process:

(*os.Process)(nil)}

	I0925 04:28:03.800797    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:03 DEBUG: hyperkit: Arguments: []string{"-A", "-u", "-F", "/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/hyperkit.pid", "-c", "2", "-m", "2200M", "-s", "0:0,hostbridge", "-s", "31,lpc", "-s", "1:0,virtio-net", "-U", "586bb914-5b96-11ee-be5f-149d997fca88", "-s", "2:0,virtio-blk,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/embed-certs-952000.rawdisk", "-s", "3,ahci-cd,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/boot2docker.iso", "-s", "4,virtio-rnd", "-l", "com1,autopty=/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/tty,log=/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/console-ring", "-f", "kexec,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/bzimage,/Users/jenkins/minikube-

integration/17297-1019/.minikube/machines/embed-certs-952000/initrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=embed-certs-952000"}

	I0925 04:28:03.800848    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:03 DEBUG: hyperkit: CmdLine: "/usr/local/bin/hyperkit -A -u -F /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/hyperkit.pid -c 2 -m 2200M -s 0:0,hostbridge -s 31,lpc -s 1:0,virtio-net -U 586bb914-5b96-11ee-be5f-149d997fca88 -s 2:0,virtio-blk,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/embed-certs-952000.rawdisk -s 3,ahci-cd,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/boot2docker.iso -s 4,virtio-rnd -l com1,autopty=/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/tty,log=/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/console-ring -f kexec,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/bzimage,/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/i

nitrd,earlyprintk=serial loglevel=3 console=ttyS0 console=tty0 noembed nomodeset norestore waitusb=10 systemd.legacy_systemd_cgroup_controller=yes random.trust_cpu=on hw_rng_model=virtio base host=embed-certs-952000"

	I0925 04:28:03.800861    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:03 DEBUG: hyperkit: Redirecting stdout/stderr to logger

	I0925 04:28:03.802157    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:03 DEBUG: hyperkit: Pid is 9164

	I0925 04:28:03.802524    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Attempt 0

	I0925 04:28:03.802535    9153 main.go:141] libmachine: (embed-certs-952000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:28:03.802612    9153 main.go:141] libmachine: (embed-certs-952000) DBG | hyperkit pid from json: 9164

	I0925 04:28:03.804117    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Searching for 26:bc:14:7f:ef:ed in /var/db/dhcpd_leases ...

	I0925 04:28:03.804174    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Found 41 entries in /var/db/dhcpd_leases!

	I0925 04:28:03.804193    9153 main.go:141] libmachine: (embed-certs-952000) DBG | dhcp entry: {Name:minikube IPAddress:192.168.64.42 HWAddress:26:bc:14:7f:ef:ed ID:1,26:bc:14:7f:ef:ed Lease:0x6512bfe2}

	I0925 04:28:03.804235    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Found match: 26:bc:14:7f:ef:ed

	I0925 04:28:03.804258    9153 main.go:141] libmachine: (embed-certs-952000) DBG | IP: 192.168.64.42

	I0925 04:28:03.804285    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetConfigRaw

	I0925 04:28:03.804844    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetIP

	I0925 04:28:03.805025    9153 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/embed-certs-952000/config.json ...

	I0925 04:28:03.805437    9153 machine.go:88] provisioning docker machine ...

	I0925 04:28:03.805451    9153 main.go:141] libmachine: (embed-certs-952000) Calling .DriverName

	I0925 04:28:03.805554    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetMachineName

	I0925 04:28:03.805649    9153 buildroot.go:166] provisioning hostname "embed-certs-952000"

	I0925 04:28:03.805658    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetMachineName

	I0925 04:28:03.805735    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHHostname

	I0925 04:28:03.805809    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHPort

	I0925 04:28:03.805894    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:03.805973    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:03.806065    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHUsername

	I0925 04:28:03.806182    9153 main.go:141] libmachine: Using SSH client type: native

	I0925 04:28:03.806472    9153 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.42 22 <nil> <nil>}

	I0925 04:28:03.806482    9153 main.go:141] libmachine: About to run SSH command:

	sudo hostname embed-certs-952000 && echo "embed-certs-952000" | sudo tee /etc/hostname

	I0925 04:28:03.808566    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:03 INFO : hyperkit: stderr: Using fd 5 for I/O notifications

	I0925 04:28:03.816781    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:03 INFO : hyperkit: stderr: /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/boot2docker.iso: fcntl(F_PUNCHHOLE) Operation not permitted: block device will not support TRIM/DISCARD

	I0925 04:28:03.817658    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:03 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I0925 04:28:03.817685    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:03 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I0925 04:28:03.817695    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:03 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I0925 04:28:03.817711    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:03 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I0925 04:28:04.183387    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:04 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 0

	I0925 04:28:04.183404    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:04 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 0

	I0925 04:28:04.287460    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:04 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 2 bit: 22 unspecified don't care: bit is 0

	I0925 04:28:04.287481    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:04 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 12 unspecified don't care: bit is 0

	I0925 04:28:04.287510    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:04 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 4 bit: 20 unspecified don't care: bit is 0

	I0925 04:28:04.287525    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:04 INFO : hyperkit: stderr: vmx_set_ctlreg: cap_field: 3 bit: 13 unspecified don't care: bit is 0

	I0925 04:28:04.288333    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:04 INFO : hyperkit: stderr: rdmsr to register 0x3a on vcpu 1

	I0925 04:28:04.288347    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:04 INFO : hyperkit: stderr: rdmsr to register 0x140 on vcpu 1

	I0925 04:28:10.435961    8765 system_pods.go:86] 4 kube-system pods found

	I0925 04:28:10.435974    8765 system_pods.go:89] "coredns-5644d7b6d9-fhm6m" [261b0b1b-bbe6-420e-af7f-6e7cab5f7c35] Running

	I0925 04:28:10.435979    8765 system_pods.go:89] "kube-proxy-9jcsn" [1329f3cf-e0f3-43b7-8d1e-23961ea3ffe7] Running

	I0925 04:28:10.435992    8765 system_pods.go:89] "metrics-server-74d5856cc6-8mcq6" [e3f5ea81-2285-4c21-9779-49cd559184dc] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0925 04:28:10.435998    8765 system_pods.go:89] "storage-provisioner" [5b3475c5-65f3-44a9-8561-bf6c52a49a9e] Running

	I0925 04:28:10.436009    8765 retry.go:31] will retry after 9.143725034s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler

	I0925 04:28:09.153307    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:09 INFO : hyperkit: stderr: rdmsr to register 0x64d on vcpu 1

	I0925 04:28:09.153356    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:09 INFO : hyperkit: stderr: rdmsr to register 0x64e on vcpu 1

	I0925 04:28:09.153388    9153 main.go:141] libmachine: (embed-certs-952000) DBG | 2023/09/25 04:28:09 INFO : hyperkit: stderr: rdmsr to register 0x34 on vcpu 1

	I0925 04:28:16.990204    9153 main.go:141] libmachine: SSH cmd err, output: <nil>: embed-certs-952000

	I0925 04:28:16.990223    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHHostname

	I0925 04:28:16.990367    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHPort

	I0925 04:28:16.990454    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:16.990547    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:16.990655    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHUsername

	I0925 04:28:16.990789    9153 main.go:141] libmachine: Using SSH client type: native

	I0925 04:28:16.991042    9153 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.42 22 <nil> <nil>}

	I0925 04:28:16.991057    9153 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sembed-certs-952000' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-952000/g' /etc/hosts;

				else 

					echo '127.0.1.1 embed-certs-952000' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0925 04:28:17.059059    9153 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0925 04:28:17.059077    9153 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17297-1019/.minikube CaCertPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17297-1019/.minikube}

	I0925 04:28:17.059092    9153 buildroot.go:174] setting up certificates

	I0925 04:28:17.059102    9153 provision.go:83] configureAuth start

	I0925 04:28:17.059111    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetMachineName

	I0925 04:28:17.059262    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetIP

	I0925 04:28:17.059351    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHHostname

	I0925 04:28:17.059435    9153 provision.go:138] copyHostCerts

	I0925 04:28:17.059528    9153 exec_runner.go:144] found /Users/jenkins/minikube-integration/17297-1019/.minikube/cert.pem, removing ...

	I0925 04:28:17.059539    9153 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17297-1019/.minikube/cert.pem

	I0925 04:28:17.059659    9153 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17297-1019/.minikube/cert.pem (1123 bytes)

	I0925 04:28:17.059897    9153 exec_runner.go:144] found /Users/jenkins/minikube-integration/17297-1019/.minikube/key.pem, removing ...

	I0925 04:28:17.059904    9153 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17297-1019/.minikube/key.pem

	I0925 04:28:17.059969    9153 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17297-1019/.minikube/key.pem (1675 bytes)

	I0925 04:28:17.060118    9153 exec_runner.go:144] found /Users/jenkins/minikube-integration/17297-1019/.minikube/ca.pem, removing ...

	I0925 04:28:17.060130    9153 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17297-1019/.minikube/ca.pem

	I0925 04:28:17.060198    9153 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17297-1019/.minikube/ca.pem (1078 bytes)

	I0925 04:28:17.060325    9153 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca-key.pem org=jenkins.embed-certs-952000 san=[192.168.64.42 192.168.64.42 localhost 127.0.0.1 minikube embed-certs-952000]

	I0925 04:28:17.184037    9153 provision.go:172] copyRemoteCerts

	I0925 04:28:17.184102    9153 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0925 04:28:17.184124    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHHostname

	I0925 04:28:17.184269    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHPort

	I0925 04:28:17.184363    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:17.184447    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHUsername

	I0925 04:28:17.184528    9153 sshutil.go:53] new ssh client: &{IP:192.168.64.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/id_rsa Username:docker}

	I0925 04:28:17.222392    9153 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0925 04:28:17.239209    9153 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server.pem --> /etc/docker/server.pem (1229 bytes)

	I0925 04:28:17.256157    9153 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0925 04:28:17.273993    9153 provision.go:86] duration metric: configureAuth took 214.876189ms

	I0925 04:28:17.274007    9153 buildroot.go:189] setting minikube options for container-runtime

	I0925 04:28:17.274144    9153 config.go:182] Loaded profile config "embed-certs-952000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I0925 04:28:17.274181    9153 main.go:141] libmachine: (embed-certs-952000) Calling .DriverName

	I0925 04:28:17.274316    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHHostname

	I0925 04:28:17.274409    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHPort

	I0925 04:28:17.274502    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:17.274586    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:17.274666    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHUsername

	I0925 04:28:17.274771    9153 main.go:141] libmachine: Using SSH client type: native

	I0925 04:28:17.274999    9153 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.42 22 <nil> <nil>}

	I0925 04:28:17.275007    9153 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0925 04:28:17.335948    9153 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0925 04:28:17.335962    9153 buildroot.go:70] root file system type: tmpfs

	I0925 04:28:17.336031    9153 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0925 04:28:17.336050    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHHostname

	I0925 04:28:17.336178    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHPort

	I0925 04:28:17.336267    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:17.336354    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:17.336448    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHUsername

	I0925 04:28:17.336573    9153 main.go:141] libmachine: Using SSH client type: native

	I0925 04:28:17.336818    9153 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.42 22 <nil> <nil>}

	I0925 04:28:17.336868    9153 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0925 04:28:17.405745    9153 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0925 04:28:17.405772    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHHostname

	I0925 04:28:17.405898    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHPort

	I0925 04:28:17.406007    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:17.406100    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:17.406192    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHUsername

	I0925 04:28:17.406330    9153 main.go:141] libmachine: Using SSH client type: native

	I0925 04:28:17.406577    9153 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.42 22 <nil> <nil>}

	I0925 04:28:17.406590    9153 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0925 04:28:17.990853    9153 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0925 04:28:17.990868    9153 machine.go:91] provisioned docker machine in 14.185375494s

	I0925 04:28:17.990881    9153 start.go:300] post-start starting for "embed-certs-952000" (driver="hyperkit")

	I0925 04:28:17.990890    9153 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0925 04:28:17.990902    9153 main.go:141] libmachine: (embed-certs-952000) Calling .DriverName

	I0925 04:28:17.991096    9153 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0925 04:28:17.991111    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHHostname

	I0925 04:28:17.991200    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHPort

	I0925 04:28:17.991277    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:17.991371    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHUsername

	I0925 04:28:17.991469    9153 sshutil.go:53] new ssh client: &{IP:192.168.64.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/id_rsa Username:docker}

	I0925 04:28:18.028325    9153 ssh_runner.go:195] Run: cat /etc/os-release

	I0925 04:28:18.031209    9153 info.go:137] Remote host: Buildroot 2021.02.12

	I0925 04:28:18.031223    9153 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17297-1019/.minikube/addons for local assets ...

	I0925 04:28:18.031306    9153 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17297-1019/.minikube/files for local assets ...

	I0925 04:28:18.031455    9153 filesync.go:149] local asset: /Users/jenkins/minikube-integration/17297-1019/.minikube/files/etc/ssl/certs/14872.pem -> 14872.pem in /etc/ssl/certs

	I0925 04:28:18.031623    9153 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0925 04:28:18.037350    9153 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/files/etc/ssl/certs/14872.pem --> /etc/ssl/certs/14872.pem (1708 bytes)

	I0925 04:28:18.053321    9153 start.go:303] post-start completed in 62.431352ms

	I0925 04:28:18.053336    9153 fix.go:56] fixHost completed within 14.374591756s

	I0925 04:28:18.053350    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHHostname

	I0925 04:28:18.053488    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHPort

	I0925 04:28:18.053585    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:18.053676    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:18.053766    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHUsername

	I0925 04:28:18.053877    9153 main.go:141] libmachine: Using SSH client type: native

	I0925 04:28:18.054111    9153 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f2920] 0x13f5600 <nil>  [] 0s} 192.168.64.42 22 <nil> <nil>}

	I0925 04:28:18.054119    9153 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0925 04:28:18.115607    9153 main.go:141] libmachine: SSH cmd err, output: <nil>: 1695641298.082157995

	I0925 04:28:18.115619    9153 fix.go:206] guest clock: 1695641298.082157995

	I0925 04:28:18.115625    9153 fix.go:219] Guest: 2023-09-25 04:28:18.082157995 -0700 PDT Remote: 2023-09-25 04:28:18.05334 -0700 PDT m=+14.807503251 (delta=28.817995ms)

	I0925 04:28:18.115643    9153 fix.go:190] guest clock delta is within tolerance: 28.817995ms

	I0925 04:28:18.115646    9153 start.go:83] releasing machines lock for "embed-certs-952000", held for 14.43692058s

	I0925 04:28:18.115663    9153 main.go:141] libmachine: (embed-certs-952000) Calling .DriverName

	I0925 04:28:18.115787    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetIP

	I0925 04:28:18.115887    9153 main.go:141] libmachine: (embed-certs-952000) Calling .DriverName

	I0925 04:28:18.116157    9153 main.go:141] libmachine: (embed-certs-952000) Calling .DriverName

	I0925 04:28:18.116250    9153 main.go:141] libmachine: (embed-certs-952000) Calling .DriverName

	I0925 04:28:18.116318    9153 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0925 04:28:18.116355    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHHostname

	I0925 04:28:18.116381    9153 ssh_runner.go:195] Run: cat /version.json

	I0925 04:28:18.116394    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHHostname

	I0925 04:28:18.116483    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHPort

	I0925 04:28:18.116497    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHPort

	I0925 04:28:18.116576    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:18.116589    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:18.116671    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHUsername

	I0925 04:28:18.116699    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHUsername

	I0925 04:28:18.116782    9153 sshutil.go:53] new ssh client: &{IP:192.168.64.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/id_rsa Username:docker}

	I0925 04:28:18.116802    9153 sshutil.go:53] new ssh client: &{IP:192.168.64.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/id_rsa Username:docker}

	I0925 04:28:18.193733    9153 ssh_runner.go:195] Run: systemctl --version

	I0925 04:28:18.198084    9153 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0925 04:28:18.201709    9153 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0925 04:28:18.201755    9153 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0925 04:28:18.212149    9153 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0925 04:28:18.212164    9153 start.go:469] detecting cgroup driver to use...

	I0925 04:28:18.212260    9153 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0925 04:28:18.224034    9153 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0925 04:28:18.230984    9153 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0925 04:28:18.238095    9153 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...

	I0925 04:28:18.238153    9153 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0925 04:28:18.244999    9153 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0925 04:28:18.251905    9153 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0925 04:28:18.258768    9153 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0925 04:28:18.265618    9153 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0925 04:28:18.272660    9153 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0925 04:28:18.279638    9153 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0925 04:28:18.307373    9153 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0925 04:28:18.313709    9153 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0925 04:28:18.393710    9153 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0925 04:28:18.405850    9153 start.go:469] detecting cgroup driver to use...

	I0925 04:28:18.405920    9153 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0925 04:28:18.415572    9153 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0925 04:28:18.424703    9153 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0925 04:28:18.438300    9153 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0925 04:28:18.446864    9153 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0925 04:28:18.455281    9153 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0925 04:28:18.476046    9153 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0925 04:28:18.485473    9153 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0925 04:28:18.497843    9153 ssh_runner.go:195] Run: which cri-dockerd

	I0925 04:28:18.500152    9153 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0925 04:28:18.505655    9153 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0925 04:28:18.516570    9153 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0925 04:28:18.597931    9153 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0925 04:28:18.681875    9153 docker.go:554] configuring docker to use "cgroupfs" as cgroup driver...

	I0925 04:28:18.681945    9153 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0925 04:28:18.692285    9153 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0925 04:28:18.773274    9153 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0925 04:28:20.031175    9153 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1.257876512s)

	I0925 04:28:20.031242    9153 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0925 04:28:20.117343    9153 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0925 04:28:20.202805    9153 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0925 04:28:20.290526    9153 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0925 04:28:20.375777    9153 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0925 04:28:20.387920    9153 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0925 04:28:20.471927    9153 ssh_runner.go:195] Run: sudo systemctl restart cri-docker

	I0925 04:28:20.525424    9153 start.go:516] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0925 04:28:20.525512    9153 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0925 04:28:20.529352    9153 start.go:537] Will wait 60s for crictl version

	I0925 04:28:20.529411    9153 ssh_runner.go:195] Run: which crictl

	I0925 04:28:20.531997    9153 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0925 04:28:20.570280    9153 start.go:553] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  24.0.6

	RuntimeApiVersion:  v1

	I0925 04:28:20.570353    9153 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0925 04:28:20.588295    9153 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0925 04:28:19.585045    8765 system_pods.go:86] 5 kube-system pods found

	I0925 04:28:19.585077    8765 system_pods.go:89] "coredns-5644d7b6d9-fhm6m" [261b0b1b-bbe6-420e-af7f-6e7cab5f7c35] Running

	I0925 04:28:19.585082    8765 system_pods.go:89] "kube-proxy-9jcsn" [1329f3cf-e0f3-43b7-8d1e-23961ea3ffe7] Running

	I0925 04:28:19.585087    8765 system_pods.go:89] "kube-scheduler-old-k8s-version-596000" [29492770-13f3-480b-b887-d880e8df61a6] Pending

	I0925 04:28:19.585092    8765 system_pods.go:89] "metrics-server-74d5856cc6-8mcq6" [e3f5ea81-2285-4c21-9779-49cd559184dc] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0925 04:28:19.585096    8765 system_pods.go:89] "storage-provisioner" [5b3475c5-65f3-44a9-8561-bf6c52a49a9e] Running

	I0925 04:28:19.585104    8765 retry.go:31] will retry after 12.164129069s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler

	I0925 04:28:20.628298    9153 out.go:204] * Preparing Kubernetes v1.28.2 on Docker 24.0.6 ...

	I0925 04:28:20.628347    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetIP

	I0925 04:28:20.628740    9153 ssh_runner.go:195] Run: grep 192.168.64.1	host.minikube.internal$ /etc/hosts

	I0925 04:28:20.632714    9153 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.64.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0925 04:28:20.641498    9153 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I0925 04:28:20.641559    9153 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0925 04:28:20.655062    9153 docker.go:664] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.28.2

	registry.k8s.io/kube-controller-manager:v1.28.2

	registry.k8s.io/kube-scheduler:v1.28.2

	registry.k8s.io/kube-proxy:v1.28.2

	registry.k8s.io/etcd:3.5.9-0

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28.4-glibc

	-- /stdout --

	I0925 04:28:20.655084    9153 docker.go:594] Images already preloaded, skipping extraction

	I0925 04:28:20.655162    9153 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0925 04:28:20.668218    9153 docker.go:664] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.28.2

	registry.k8s.io/kube-controller-manager:v1.28.2

	registry.k8s.io/kube-scheduler:v1.28.2

	registry.k8s.io/kube-proxy:v1.28.2

	registry.k8s.io/etcd:3.5.9-0

	registry.k8s.io/coredns/coredns:v1.10.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28.4-glibc

	-- /stdout --

	I0925 04:28:20.668240    9153 cache_images.go:84] Images are preloaded, skipping loading

	I0925 04:28:20.668314    9153 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0925 04:28:20.685930    9153 cni.go:84] Creating CNI manager for ""

	I0925 04:28:20.685944    9153 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0925 04:28:20.685956    9153 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0925 04:28:20.685972    9153 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.64.42 APIServerPort:8443 KubernetesVersion:v1.28.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-952000 NodeName:embed-certs-952000 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.64.42"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.64.42 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPa

th:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0925 04:28:20.686089    9153 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.64.42

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "embed-certs-952000"

	  kubeletExtraArgs:

	    node-ip: 192.168.64.42

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.64.42"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.28.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0925 04:28:20.686139    9153 kubeadm.go:976] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.28.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=embed-certs-952000 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.64.42

	[Install]

	 config:

	{KubernetesVersion:v1.28.2 ClusterName:embed-certs-952000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0925 04:28:20.686197    9153 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.2

	I0925 04:28:20.692218    9153 binaries.go:44] Found k8s binaries, skipping transfer

	I0925 04:28:20.692265    9153 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0925 04:28:20.698086    9153 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (380 bytes)

	I0925 04:28:20.709246    9153 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0925 04:28:20.720129    9153 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2104 bytes)

	I0925 04:28:20.731173    9153 ssh_runner.go:195] Run: grep 192.168.64.42	control-plane.minikube.internal$ /etc/hosts

	I0925 04:28:20.733472    9153 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.64.42	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0925 04:28:20.741479    9153 certs.go:56] Setting up /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/embed-certs-952000 for IP: 192.168.64.42

	I0925 04:28:20.741501    9153 certs.go:190] acquiring lock for shared ca certs: {Name:mk3676345378806ecb3fbe1837a9e59a7bfdf67f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0925 04:28:20.741643    9153 certs.go:199] skipping minikubeCA CA generation: /Users/jenkins/minikube-integration/17297-1019/.minikube/ca.key

	I0925 04:28:20.741693    9153 certs.go:199] skipping proxyClientCA CA generation: /Users/jenkins/minikube-integration/17297-1019/.minikube/proxy-client-ca.key

	I0925 04:28:20.741781    9153 certs.go:315] skipping minikube-user signed cert generation: /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/embed-certs-952000/client.key

	I0925 04:28:20.741846    9153 certs.go:315] skipping minikube signed cert generation: /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/embed-certs-952000/apiserver.key.7a4a9a43

	I0925 04:28:20.741897    9153 certs.go:315] skipping aggregator signed cert generation: /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/embed-certs-952000/proxy-client.key

	I0925 04:28:20.742095    9153 certs.go:437] found cert: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/1487.pem (1338 bytes)

	W0925 04:28:20.742136    9153 certs.go:433] ignoring /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/1487_empty.pem, impossibly tiny 0 bytes

	I0925 04:28:20.742152    9153 certs.go:437] found cert: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca-key.pem (1679 bytes)

	I0925 04:28:20.742183    9153 certs.go:437] found cert: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/ca.pem (1078 bytes)

	I0925 04:28:20.742213    9153 certs.go:437] found cert: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/cert.pem (1123 bytes)

	I0925 04:28:20.742244    9153 certs.go:437] found cert: /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/Users/jenkins/minikube-integration/17297-1019/.minikube/certs/key.pem (1675 bytes)

	I0925 04:28:20.742312    9153 certs.go:437] found cert: /Users/jenkins/minikube-integration/17297-1019/.minikube/files/etc/ssl/certs/Users/jenkins/minikube-integration/17297-1019/.minikube/files/etc/ssl/certs/14872.pem (1708 bytes)

	I0925 04:28:20.742773    9153 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/embed-certs-952000/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0925 04:28:20.758908    9153 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/embed-certs-952000/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0925 04:28:20.774914    9153 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/embed-certs-952000/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0925 04:28:20.790773    9153 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/embed-certs-952000/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0925 04:28:20.806577    9153 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0925 04:28:20.822668    9153 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0925 04:28:20.839134    9153 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0925 04:28:20.854958    9153 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0925 04:28:20.871268    9153 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/files/etc/ssl/certs/14872.pem --> /usr/share/ca-certificates/14872.pem (1708 bytes)

	I0925 04:28:20.887087    9153 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0925 04:28:20.902819    9153 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17297-1019/.minikube/certs/1487.pem --> /usr/share/ca-certificates/1487.pem (1338 bytes)

	I0925 04:28:20.918633    9153 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0925 04:28:20.929740    9153 ssh_runner.go:195] Run: openssl version

	I0925 04:28:20.933235    9153 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/14872.pem && ln -fs /usr/share/ca-certificates/14872.pem /etc/ssl/certs/14872.pem"

	I0925 04:28:20.939820    9153 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/14872.pem

	I0925 04:28:20.942709    9153 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Sep 25 10:38 /usr/share/ca-certificates/14872.pem

	I0925 04:28:20.942752    9153 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/14872.pem

	I0925 04:28:20.946432    9153 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/14872.pem /etc/ssl/certs/3ec20f2e.0"

	I0925 04:28:20.953017    9153 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0925 04:28:20.959561    9153 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0925 04:28:20.962577    9153 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Sep 25 10:33 /usr/share/ca-certificates/minikubeCA.pem

	I0925 04:28:20.962612    9153 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0925 04:28:20.966209    9153 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0925 04:28:20.973057    9153 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1487.pem && ln -fs /usr/share/ca-certificates/1487.pem /etc/ssl/certs/1487.pem"

	I0925 04:28:20.979581    9153 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1487.pem

	I0925 04:28:20.982583    9153 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Sep 25 10:38 /usr/share/ca-certificates/1487.pem

	I0925 04:28:20.982619    9153 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1487.pem

	I0925 04:28:20.986171    9153 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1487.pem /etc/ssl/certs/51391683.0"

	I0925 04:28:20.992647    9153 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I0925 04:28:20.995387    9153 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I0925 04:28:20.999026    9153 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I0925 04:28:21.002636    9153 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I0925 04:28:21.006262    9153 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I0925 04:28:21.009856    9153 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I0925 04:28:21.013384    9153 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I0925 04:28:21.017064    9153 kubeadm.go:404] StartCluster: {Name:embed-certs-952000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVe

rsion:v1.28.2 ClusterName:embed-certs-952000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.42 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress:

Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I0925 04:28:21.017154    9153 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0925 04:28:21.029930    9153 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0925 04:28:21.035915    9153 kubeadm.go:419] found existing configuration files, will attempt cluster restart

	I0925 04:28:21.035934    9153 kubeadm.go:636] restartCluster start

	I0925 04:28:21.035977    9153 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I0925 04:28:21.041664    9153 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:21.042047    9153 kubeconfig.go:135] verify returned: extract IP: "embed-certs-952000" does not appear in /Users/jenkins/minikube-integration/17297-1019/kubeconfig

	I0925 04:28:21.042196    9153 kubeconfig.go:146] "embed-certs-952000" context is missing from /Users/jenkins/minikube-integration/17297-1019/kubeconfig - will repair!

	I0925 04:28:21.042484    9153 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17297-1019/kubeconfig: {Name:mk089a453556df7022ab2ad95444bff17ceaaa35 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0925 04:28:21.043948    9153 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0925 04:28:21.049741    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:21.049778    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:21.057386    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:21.057394    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:21.057433    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:21.064853    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:21.565884    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:21.565988    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:21.574986    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:22.065798    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:22.065903    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:22.074662    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:22.566187    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:22.566348    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:22.575837    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:23.066771    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:23.066932    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:23.076688    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:23.564988    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:23.565121    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:23.573430    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:24.065746    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:24.065870    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:24.075582    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:24.565576    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:24.565681    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:24.575342    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:25.065365    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:25.065469    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:25.075128    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:25.565010    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:25.565213    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:25.575533    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:26.065982    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:26.066126    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:26.075336    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:26.565750    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:26.565836    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:26.574556    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:27.066602    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:27.066715    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:27.076288    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:27.565275    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:27.565378    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:27.574829    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:28.065737    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:28.065938    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:28.075275    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:28.565821    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:28.565932    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:28.575484    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:29.065566    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:29.065745    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:29.074580    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:29.565800    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:29.565985    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:29.575101    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:30.065501    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:30.065692    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:30.074472    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:30.565651    9153 api_server.go:166] Checking apiserver status ...

	I0925 04:28:30.565738    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0925 04:28:30.573712    9153 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0925 04:28:31.051067    9153 kubeadm.go:611] needs reconfigure: apiserver error: context deadline exceeded

	I0925 04:28:31.051101    9153 kubeadm.go:1128] stopping kube-system containers ...

	I0925 04:28:31.051227    9153 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0925 04:28:31.067362    9153 docker.go:463] Stopping containers: [7fa4a0ebb174 9dce62db1db6 101e52f35f8a 8ed83d102101 b134bc054a85 4ad2c63ceb14 ef924609f9a1 ce6773b07b99 596a9b0cbe08 e63740b87413 c6384edd5158 3bbe6f084b06 a74d7783cda3 631ce28f6d7a]

	I0925 04:28:31.067439    9153 ssh_runner.go:195] Run: docker stop 7fa4a0ebb174 9dce62db1db6 101e52f35f8a 8ed83d102101 b134bc054a85 4ad2c63ceb14 ef924609f9a1 ce6773b07b99 596a9b0cbe08 e63740b87413 c6384edd5158 3bbe6f084b06 a74d7783cda3 631ce28f6d7a

	I0925 04:28:31.080988    9153 ssh_runner.go:195] Run: sudo systemctl stop kubelet

	I0925 04:28:31.091155    9153 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0925 04:28:31.097073    9153 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0925 04:28:31.097123    9153 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0925 04:28:31.102779    9153 kubeadm.go:713] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I0925 04:28:31.102787    9153 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I0925 04:28:31.177091    9153 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I0925 04:28:31.684172    9153 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I0925 04:28:31.820790    9153 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I0925 04:28:31.875763    9153 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I0925 04:28:31.924522    9153 api_server.go:52] waiting for apiserver process to appear ...

	I0925 04:28:31.924598    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0925 04:28:31.933995    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0925 04:28:32.444866    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0925 04:28:32.945351    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0925 04:28:31.752907    8765 system_pods.go:86] 8 kube-system pods found

	I0925 04:28:31.752921    8765 system_pods.go:89] "coredns-5644d7b6d9-fhm6m" [261b0b1b-bbe6-420e-af7f-6e7cab5f7c35] Running

	I0925 04:28:31.752926    8765 system_pods.go:89] "etcd-old-k8s-version-596000" [a4089b4d-bb12-4bdf-800a-0aac385df57a] Pending

	I0925 04:28:31.752929    8765 system_pods.go:89] "kube-apiserver-old-k8s-version-596000" [66c79610-9a29-4e3c-838d-035e86a4089c] Pending

	I0925 04:28:31.752933    8765 system_pods.go:89] "kube-controller-manager-old-k8s-version-596000" [26ce3f96-6152-4480-a78a-315a4dbbc8ed] Pending

	I0925 04:28:31.752936    8765 system_pods.go:89] "kube-proxy-9jcsn" [1329f3cf-e0f3-43b7-8d1e-23961ea3ffe7] Running

	I0925 04:28:31.752940    8765 system_pods.go:89] "kube-scheduler-old-k8s-version-596000" [29492770-13f3-480b-b887-d880e8df61a6] Running

	I0925 04:28:31.752945    8765 system_pods.go:89] "metrics-server-74d5856cc6-8mcq6" [e3f5ea81-2285-4c21-9779-49cd559184dc] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0925 04:28:31.752950    8765 system_pods.go:89] "storage-provisioner" [5b3475c5-65f3-44a9-8561-bf6c52a49a9e] Running

	I0925 04:28:31.752961    8765 retry.go:31] will retry after 10.620928088s: missing components: etcd, kube-apiserver, kube-controller-manager

	I0925 04:28:33.445228    9153 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0925 04:28:33.456910    9153 api_server.go:72] duration metric: took 1.532384418s to wait for apiserver process to appear ...

	I0925 04:28:33.456923    9153 api_server.go:88] waiting for apiserver healthz status ...

	I0925 04:28:33.456938    9153 api_server.go:253] Checking apiserver healthz at https://192.168.64.42:8443/healthz ...

	I0925 04:28:36.011164    9153 api_server.go:279] https://192.168.64.42:8443/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W0925 04:28:36.011181    9153 api_server.go:103] status: https://192.168.64.42:8443/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0925 04:28:36.011189    9153 api_server.go:253] Checking apiserver healthz at https://192.168.64.42:8443/healthz ...

	I0925 04:28:36.027004    9153 api_server.go:279] https://192.168.64.42:8443/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W0925 04:28:36.027019    9153 api_server.go:103] status: https://192.168.64.42:8443/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0925 04:28:36.529004    9153 api_server.go:253] Checking apiserver healthz at https://192.168.64.42:8443/healthz ...

	I0925 04:28:36.534086    9153 api_server.go:279] https://192.168.64.42:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	W0925 04:28:36.534106    9153 api_server.go:103] status: https://192.168.64.42:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	I0925 04:28:37.027978    9153 api_server.go:253] Checking apiserver healthz at https://192.168.64.42:8443/healthz ...

	I0925 04:28:37.032811    9153 api_server.go:279] https://192.168.64.42:8443/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	W0925 04:28:37.032830    9153 api_server.go:103] status: https://192.168.64.42:8443/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	I0925 04:28:37.527907    9153 api_server.go:253] Checking apiserver healthz at https://192.168.64.42:8443/healthz ...

	I0925 04:28:37.531261    9153 api_server.go:279] https://192.168.64.42:8443/healthz returned 200:

	ok

	I0925 04:28:37.536735    9153 api_server.go:141] control plane version: v1.28.2

	I0925 04:28:37.536748    9153 api_server.go:131] duration metric: took 4.079806587s to wait for apiserver health ...

	I0925 04:28:37.536756    9153 cni.go:84] Creating CNI manager for ""

	I0925 04:28:37.536782    9153 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0925 04:28:37.575559    9153 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0925 04:28:37.611269    9153 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0925 04:28:37.627745    9153 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)

	I0925 04:28:37.662310    9153 system_pods.go:43] waiting for kube-system pods to appear ...

	I0925 04:28:37.668618    9153 system_pods.go:59] 8 kube-system pods found

	I0925 04:28:37.668636    9153 system_pods.go:61] "coredns-5dd5756b68-vbhcz" [973bbf6e-65be-4aeb-b0fc-47e2ce9d3cd0] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I0925 04:28:37.668649    9153 system_pods.go:61] "etcd-embed-certs-952000" [dde02afb-8926-4fbf-911d-880d65f6e30f] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I0925 04:28:37.668658    9153 system_pods.go:61] "kube-apiserver-embed-certs-952000" [05d97e32-7bbe-49da-8572-a73bca294976] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I0925 04:28:37.668664    9153 system_pods.go:61] "kube-controller-manager-embed-certs-952000" [fa55dc33-cb9c-4276-9948-d4528d774a11] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0925 04:28:37.668669    9153 system_pods.go:61] "kube-proxy-jl6vp" [4c9c4fbd-f6a6-42d4-b579-f62284c71415] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])

	I0925 04:28:37.668674    9153 system_pods.go:61] "kube-scheduler-embed-certs-952000" [e13497f3-60b5-4574-9260-0546e88aa2c8] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I0925 04:28:37.668680    9153 system_pods.go:61] "metrics-server-57f55c9bc5-jw9fg" [3ca2111d-356b-4d2b-9438-df139140faec] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0925 04:28:37.668686    9153 system_pods.go:61] "storage-provisioner" [bd610097-3842-4dbf-98a5-65f64b4b4c22] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0925 04:28:37.668692    9153 system_pods.go:74] duration metric: took 6.371095ms to wait for pod list to return data ...

	I0925 04:28:37.668706    9153 node_conditions.go:102] verifying NodePressure condition ...

	I0925 04:28:37.670987    9153 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I0925 04:28:37.671002    9153 node_conditions.go:123] node cpu capacity is 2

	I0925 04:28:37.671013    9153 node_conditions.go:105] duration metric: took 2.304437ms to run NodePressure ...

	I0925 04:28:37.671028    9153 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.2:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I0925 04:28:37.910944    9153 kubeadm.go:772] waiting for restarted kubelet to initialise ...

	I0925 04:28:37.915755    9153 kubeadm.go:787] kubelet initialised

	I0925 04:28:37.915768    9153 kubeadm.go:788] duration metric: took 4.810072ms waiting for restarted kubelet to initialise ...

	I0925 04:28:37.915775    9153 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0925 04:28:37.920994    9153 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-vbhcz" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:37.924777    9153 pod_ready.go:97] node "embed-certs-952000" hosting pod "coredns-5dd5756b68-vbhcz" in "kube-system" namespace is currently not "Ready" (skipping!): node "embed-certs-952000" has status "Ready":"False"

	I0925 04:28:37.924790    9153 pod_ready.go:81] duration metric: took 3.782305ms waiting for pod "coredns-5dd5756b68-vbhcz" in "kube-system" namespace to be "Ready" ...

	E0925 04:28:37.924796    9153 pod_ready.go:66] WaitExtra: waitPodCondition: node "embed-certs-952000" hosting pod "coredns-5dd5756b68-vbhcz" in "kube-system" namespace is currently not "Ready" (skipping!): node "embed-certs-952000" has status "Ready":"False"

	I0925 04:28:37.924802    9153 pod_ready.go:78] waiting up to 4m0s for pod "etcd-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:37.931804    9153 pod_ready.go:97] node "embed-certs-952000" hosting pod "etcd-embed-certs-952000" in "kube-system" namespace is currently not "Ready" (skipping!): node "embed-certs-952000" has status "Ready":"False"

	I0925 04:28:37.931819    9153 pod_ready.go:81] duration metric: took 7.011197ms waiting for pod "etcd-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	E0925 04:28:37.931827    9153 pod_ready.go:66] WaitExtra: waitPodCondition: node "embed-certs-952000" hosting pod "etcd-embed-certs-952000" in "kube-system" namespace is currently not "Ready" (skipping!): node "embed-certs-952000" has status "Ready":"False"

	I0925 04:28:37.931833    9153 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:37.940486    9153 pod_ready.go:97] node "embed-certs-952000" hosting pod "kube-apiserver-embed-certs-952000" in "kube-system" namespace is currently not "Ready" (skipping!): node "embed-certs-952000" has status "Ready":"False"

	I0925 04:28:37.940500    9153 pod_ready.go:81] duration metric: took 8.662274ms waiting for pod "kube-apiserver-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	E0925 04:28:37.940510    9153 pod_ready.go:66] WaitExtra: waitPodCondition: node "embed-certs-952000" hosting pod "kube-apiserver-embed-certs-952000" in "kube-system" namespace is currently not "Ready" (skipping!): node "embed-certs-952000" has status "Ready":"False"

	I0925 04:28:37.940529    9153 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:38.065407    9153 pod_ready.go:97] node "embed-certs-952000" hosting pod "kube-controller-manager-embed-certs-952000" in "kube-system" namespace is currently not "Ready" (skipping!): node "embed-certs-952000" has status "Ready":"False"

	I0925 04:28:38.065422    9153 pod_ready.go:81] duration metric: took 124.885749ms waiting for pod "kube-controller-manager-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	E0925 04:28:38.065428    9153 pod_ready.go:66] WaitExtra: waitPodCondition: node "embed-certs-952000" hosting pod "kube-controller-manager-embed-certs-952000" in "kube-system" namespace is currently not "Ready" (skipping!): node "embed-certs-952000" has status "Ready":"False"

	I0925 04:28:38.065434    9153 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-jl6vp" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:38.466660    9153 pod_ready.go:97] node "embed-certs-952000" hosting pod "kube-proxy-jl6vp" in "kube-system" namespace is currently not "Ready" (skipping!): node "embed-certs-952000" has status "Ready":"False"

	I0925 04:28:38.466677    9153 pod_ready.go:81] duration metric: took 401.236799ms waiting for pod "kube-proxy-jl6vp" in "kube-system" namespace to be "Ready" ...

	E0925 04:28:38.466686    9153 pod_ready.go:66] WaitExtra: waitPodCondition: node "embed-certs-952000" hosting pod "kube-proxy-jl6vp" in "kube-system" namespace is currently not "Ready" (skipping!): node "embed-certs-952000" has status "Ready":"False"

	I0925 04:28:38.466691    9153 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:38.864591    9153 pod_ready.go:97] node "embed-certs-952000" hosting pod "kube-scheduler-embed-certs-952000" in "kube-system" namespace is currently not "Ready" (skipping!): node "embed-certs-952000" has status "Ready":"False"

	I0925 04:28:38.864606    9153 pod_ready.go:81] duration metric: took 397.90568ms waiting for pod "kube-scheduler-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	E0925 04:28:38.864612    9153 pod_ready.go:66] WaitExtra: waitPodCondition: node "embed-certs-952000" hosting pod "kube-scheduler-embed-certs-952000" in "kube-system" namespace is currently not "Ready" (skipping!): node "embed-certs-952000" has status "Ready":"False"

	I0925 04:28:38.864617    9153 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-57f55c9bc5-jw9fg" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:39.265789    9153 pod_ready.go:97] node "embed-certs-952000" hosting pod "metrics-server-57f55c9bc5-jw9fg" in "kube-system" namespace is currently not "Ready" (skipping!): node "embed-certs-952000" has status "Ready":"False"

	I0925 04:28:39.265808    9153 pod_ready.go:81] duration metric: took 401.183287ms waiting for pod "metrics-server-57f55c9bc5-jw9fg" in "kube-system" namespace to be "Ready" ...

	E0925 04:28:39.265817    9153 pod_ready.go:66] WaitExtra: waitPodCondition: node "embed-certs-952000" hosting pod "metrics-server-57f55c9bc5-jw9fg" in "kube-system" namespace is currently not "Ready" (skipping!): node "embed-certs-952000" has status "Ready":"False"

	I0925 04:28:39.265827    9153 pod_ready.go:38] duration metric: took 1.350039768s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0925 04:28:39.265840    9153 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0925 04:28:39.273913    9153 ops.go:34] apiserver oom_adj: -16

	I0925 04:28:39.273926    9153 kubeadm.go:640] restartCluster took 18.23792422s

	I0925 04:28:39.273930    9153 kubeadm.go:406] StartCluster complete in 18.256814449s

	I0925 04:28:39.273940    9153 settings.go:142] acquiring lock: {Name:mk37b0392249d6bd036812bb5e31347cdeef3bc5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0925 04:28:39.274020    9153 settings.go:150] Updating kubeconfig:  /Users/jenkins/minikube-integration/17297-1019/kubeconfig

	I0925 04:28:39.274775    9153 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17297-1019/kubeconfig: {Name:mk089a453556df7022ab2ad95444bff17ceaaa35 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0925 04:28:39.275040    9153 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0925 04:28:39.275078    9153 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]

	I0925 04:28:39.275125    9153 addons.go:69] Setting storage-provisioner=true in profile "embed-certs-952000"

	I0925 04:28:39.275135    9153 addons.go:69] Setting default-storageclass=true in profile "embed-certs-952000"

	I0925 04:28:39.275138    9153 addons.go:231] Setting addon storage-provisioner=true in "embed-certs-952000"

	I0925 04:28:39.275143    9153 addons.go:69] Setting metrics-server=true in profile "embed-certs-952000"

	W0925 04:28:39.275149    9153 addons.go:240] addon storage-provisioner should already be in state true

	I0925 04:28:39.275152    9153 addons.go:69] Setting dashboard=true in profile "embed-certs-952000"

	I0925 04:28:39.275159    9153 addons.go:231] Setting addon metrics-server=true in "embed-certs-952000"

	I0925 04:28:39.275161    9153 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "embed-certs-952000"

	W0925 04:28:39.275172    9153 addons.go:240] addon metrics-server should already be in state true

	I0925 04:28:39.275175    9153 config.go:182] Loaded profile config "embed-certs-952000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I0925 04:28:39.275176    9153 addons.go:231] Setting addon dashboard=true in "embed-certs-952000"

	W0925 04:28:39.275187    9153 addons.go:240] addon dashboard should already be in state true

	I0925 04:28:39.275195    9153 host.go:66] Checking if "embed-certs-952000" exists ...

	I0925 04:28:39.275209    9153 host.go:66] Checking if "embed-certs-952000" exists ...

	I0925 04:28:39.275217    9153 host.go:66] Checking if "embed-certs-952000" exists ...

	I0925 04:28:39.275473    9153 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 04:28:39.275476    9153 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 04:28:39.275474    9153 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 04:28:39.275503    9153 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 04:28:39.275509    9153 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 04:28:39.275511    9153 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 04:28:39.275558    9153 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 04:28:39.275572    9153 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 04:28:39.284060    9153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56490

	I0925 04:28:39.284478    9153 main.go:141] libmachine: () Calling .GetVersion

	I0925 04:28:39.285070    9153 main.go:141] libmachine: Using API Version  1

	I0925 04:28:39.285092    9153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 04:28:39.285102    9153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56492

	I0925 04:28:39.285385    9153 main.go:141] libmachine: () Calling .GetMachineName

	I0925 04:28:39.285613    9153 main.go:141] libmachine: () Calling .GetVersion

	I0925 04:28:39.285812    9153 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 04:28:39.285849    9153 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 04:28:39.286782    9153 main.go:141] libmachine: Using API Version  1

	I0925 04:28:39.286782    9153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56494

	I0925 04:28:39.286876    9153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 04:28:39.287883    9153 main.go:141] libmachine: () Calling .GetVersion

	I0925 04:28:39.288008    9153 main.go:141] libmachine: () Calling .GetMachineName

	I0925 04:28:39.288012    9153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56496

	I0925 04:28:39.288450    9153 main.go:141] libmachine: Using API Version  1

	I0925 04:28:39.288467    9153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 04:28:39.288492    9153 main.go:141] libmachine: () Calling .GetVersion

	I0925 04:28:39.288503    9153 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 04:28:39.288528    9153 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 04:28:39.289423    9153 main.go:141] libmachine: () Calling .GetMachineName

	I0925 04:28:39.289537    9153 main.go:141] libmachine: Using API Version  1

	I0925 04:28:39.289830    9153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 04:28:39.290799    9153 kapi.go:248] "coredns" deployment in "kube-system" namespace and "embed-certs-952000" context rescaled to 1 replicas

	I0925 04:28:39.290822    9153 main.go:141] libmachine: () Calling .GetMachineName

	I0925 04:28:39.290827    9153 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.64.42 Port:8443 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0925 04:28:39.312481    9153 out.go:177] * Verifying Kubernetes components...

	I0925 04:28:39.290870    9153 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 04:28:39.290969    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetState

	I0925 04:28:39.294399    9153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56498

	I0925 04:28:39.354155    9153 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0925 04:28:39.296021    9153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56499

	I0925 04:28:39.312536    9153 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 04:28:39.354327    9153 main.go:141] libmachine: (embed-certs-952000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:28:39.354426    9153 main.go:141] libmachine: (embed-certs-952000) DBG | hyperkit pid from json: 9164

	I0925 04:28:39.355393    9153 main.go:141] libmachine: () Calling .GetVersion

	I0925 04:28:39.355395    9153 main.go:141] libmachine: () Calling .GetVersion

	I0925 04:28:39.356739    9153 main.go:141] libmachine: Using API Version  1

	I0925 04:28:39.356760    9153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 04:28:39.356761    9153 main.go:141] libmachine: Using API Version  1

	I0925 04:28:39.356780    9153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 04:28:39.357012    9153 main.go:141] libmachine: () Calling .GetMachineName

	I0925 04:28:39.357030    9153 main.go:141] libmachine: () Calling .GetMachineName

	I0925 04:28:39.357149    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetState

	I0925 04:28:39.357153    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetState

	I0925 04:28:39.357262    9153 main.go:141] libmachine: (embed-certs-952000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:28:39.357282    9153 main.go:141] libmachine: (embed-certs-952000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:28:39.357328    9153 main.go:141] libmachine: (embed-certs-952000) DBG | hyperkit pid from json: 9164

	I0925 04:28:39.357338    9153 main.go:141] libmachine: (embed-certs-952000) DBG | hyperkit pid from json: 9164

	I0925 04:28:39.358550    9153 main.go:141] libmachine: (embed-certs-952000) Calling .DriverName

	I0925 04:28:39.358555    9153 main.go:141] libmachine: (embed-certs-952000) Calling .DriverName

	I0925 04:28:39.380089    9153 out.go:177]   - Using image fake.domain/registry.k8s.io/echoserver:1.4

	I0925 04:28:39.361953    9153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56502

	I0925 04:28:39.362580    9153 addons.go:231] Setting addon default-storageclass=true in "embed-certs-952000"

	I0925 04:28:39.401235    9153 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	W0925 04:28:39.401242    9153 addons.go:240] addon default-storageclass should already be in state true

	I0925 04:28:39.401261    9153 host.go:66] Checking if "embed-certs-952000" exists ...

	I0925 04:28:39.401277    9153 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0925 04:28:39.422079    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0925 04:28:39.422091    9153 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0925 04:28:39.422099    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0925 04:28:39.422101    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHHostname

	I0925 04:28:39.401665    9153 main.go:141] libmachine: () Calling .GetVersion

	I0925 04:28:39.422114    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHHostname

	I0925 04:28:39.422259    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHPort

	I0925 04:28:39.422259    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHPort

	I0925 04:28:39.422367    9153 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 04:28:39.422384    9153 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 04:28:39.422387    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:39.422397    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:39.422494    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHUsername

	I0925 04:28:39.422510    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHUsername

	I0925 04:28:39.423155    9153 sshutil.go:53] new ssh client: &{IP:192.168.64.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/id_rsa Username:docker}

	I0925 04:28:39.423162    9153 sshutil.go:53] new ssh client: &{IP:192.168.64.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/id_rsa Username:docker}

	I0925 04:28:39.423163    9153 main.go:141] libmachine: Using API Version  1

	I0925 04:28:39.423382    9153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 04:28:39.423975    9153 main.go:141] libmachine: () Calling .GetMachineName

	I0925 04:28:39.424290    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetState

	I0925 04:28:39.424515    9153 main.go:141] libmachine: (embed-certs-952000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:28:39.424600    9153 main.go:141] libmachine: (embed-certs-952000) DBG | hyperkit pid from json: 9164

	I0925 04:28:39.425628    9153 main.go:141] libmachine: (embed-certs-952000) Calling .DriverName

	I0925 04:28:39.447038    9153 out.go:177]   - Using image docker.io/kubernetesui/dashboard:v2.7.0

	I0925 04:28:39.429768    9153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56506

	I0925 04:28:39.436011    9153 start.go:896] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I0925 04:28:39.436026    9153 node_ready.go:35] waiting up to 6m0s for node "embed-certs-952000" to be "Ready" ...

	I0925 04:28:39.489154    9153 out.go:177]   - Using image registry.k8s.io/echoserver:1.4

	I0925 04:28:39.447445    9153 main.go:141] libmachine: () Calling .GetVersion

	I0925 04:28:39.477266    9153 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0925 04:28:39.488498    9153 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0925 04:28:39.509998    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)

	I0925 04:28:39.510073    9153 addons.go:423] installing /etc/kubernetes/addons/dashboard-ns.yaml

	I0925 04:28:39.510088    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)

	I0925 04:28:39.510108    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHHostname

	I0925 04:28:39.510316    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHPort

	I0925 04:28:39.510480    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:39.510552    9153 main.go:141] libmachine: Using API Version  1

	I0925 04:28:39.510570    9153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 04:28:39.510637    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHUsername

	I0925 04:28:39.510792    9153 sshutil.go:53] new ssh client: &{IP:192.168.64.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/id_rsa Username:docker}

	I0925 04:28:39.510843    9153 main.go:141] libmachine: () Calling .GetMachineName

	I0925 04:28:39.511327    9153 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 04:28:39.511355    9153 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 04:28:39.518770    9153 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:56509

	I0925 04:28:39.519115    9153 main.go:141] libmachine: () Calling .GetVersion

	I0925 04:28:39.519463    9153 main.go:141] libmachine: Using API Version  1

	I0925 04:28:39.519474    9153 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 04:28:39.519681    9153 main.go:141] libmachine: () Calling .GetMachineName

	I0925 04:28:39.519780    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetState

	I0925 04:28:39.519857    9153 main.go:141] libmachine: (embed-certs-952000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0

	I0925 04:28:39.519937    9153 main.go:141] libmachine: (embed-certs-952000) DBG | hyperkit pid from json: 9164

	I0925 04:28:39.520929    9153 main.go:141] libmachine: (embed-certs-952000) Calling .DriverName

	I0925 04:28:39.521090    9153 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml

	I0925 04:28:39.521098    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0925 04:28:39.521107    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHHostname

	I0925 04:28:39.521198    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHPort

	I0925 04:28:39.521275    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHKeyPath

	I0925 04:28:39.521359    9153 main.go:141] libmachine: (embed-certs-952000) Calling .GetSSHUsername

	I0925 04:28:39.521437    9153 sshutil.go:53] new ssh client: &{IP:192.168.64.42 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17297-1019/.minikube/machines/embed-certs-952000/id_rsa Username:docker}

	I0925 04:28:39.523980    9153 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0925 04:28:39.523990    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0925 04:28:39.550278    9153 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0925 04:28:39.550290    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0925 04:28:39.580430    9153 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0925 04:28:39.605117    9153 addons.go:423] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml

	I0925 04:28:39.605131    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)

	I0925 04:28:39.611083    9153 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0925 04:28:39.706953    9153 addons.go:423] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml

	I0925 04:28:39.706969    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)

	I0925 04:28:39.757871    9153 addons.go:423] installing /etc/kubernetes/addons/dashboard-configmap.yaml

	I0925 04:28:39.757884    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)

	I0925 04:28:39.771737    9153 addons.go:423] installing /etc/kubernetes/addons/dashboard-dp.yaml

	I0925 04:28:39.771749    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)

	I0925 04:28:39.802397    9153 addons.go:423] installing /etc/kubernetes/addons/dashboard-role.yaml

	I0925 04:28:39.802410    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)

	I0925 04:28:39.843535    9153 addons.go:423] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml

	I0925 04:28:39.843548    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)

	I0925 04:28:39.872163    9153 addons.go:423] installing /etc/kubernetes/addons/dashboard-sa.yaml

	I0925 04:28:39.872175    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)

	I0925 04:28:39.886883    9153 addons.go:423] installing /etc/kubernetes/addons/dashboard-secret.yaml

	I0925 04:28:39.886894    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)

	I0925 04:28:39.904503    9153 addons.go:423] installing /etc/kubernetes/addons/dashboard-svc.yaml

	I0925 04:28:39.904516    9153 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)

	I0925 04:28:39.921894    9153 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	I0925 04:28:40.678407    9153 node_ready.go:49] node "embed-certs-952000" has status "Ready":"True"

	I0925 04:28:40.678422    9153 node_ready.go:38] duration metric: took 1.210388259s waiting for node "embed-certs-952000" to be "Ready" ...

	I0925 04:28:40.678428    9153 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0925 04:28:40.682158    9153 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-vbhcz" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:40.833307    9153 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.323268343s)

	I0925 04:28:40.833343    9153 main.go:141] libmachine: Making call to close driver server

	I0925 04:28:40.833355    9153 main.go:141] libmachine: (embed-certs-952000) Calling .Close

	I0925 04:28:40.833369    9153 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.252913151s)

	I0925 04:28:40.833398    9153 main.go:141] libmachine: Making call to close driver server

	I0925 04:28:40.833397    9153 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.222292287s)

	I0925 04:28:40.833409    9153 main.go:141] libmachine: (embed-certs-952000) Calling .Close

	I0925 04:28:40.833444    9153 main.go:141] libmachine: Making call to close driver server

	I0925 04:28:40.833461    9153 main.go:141] libmachine: (embed-certs-952000) Calling .Close

	I0925 04:28:40.833610    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Closing plugin on server side

	I0925 04:28:40.833628    9153 main.go:141] libmachine: Successfully made call to close driver server

	I0925 04:28:40.833640    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Closing plugin on server side

	I0925 04:28:40.833645    9153 main.go:141] libmachine: Successfully made call to close driver server

	I0925 04:28:40.833647    9153 main.go:141] libmachine: Making call to close connection to plugin binary

	I0925 04:28:40.833651    9153 main.go:141] libmachine: Successfully made call to close driver server

	I0925 04:28:40.833653    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Closing plugin on server side

	I0925 04:28:40.833655    9153 main.go:141] libmachine: Making call to close connection to plugin binary

	I0925 04:28:40.833660    9153 main.go:141] libmachine: Making call to close connection to plugin binary

	I0925 04:28:40.833668    9153 main.go:141] libmachine: Making call to close driver server

	I0925 04:28:40.833675    9153 main.go:141] libmachine: Making call to close driver server

	I0925 04:28:40.833658    9153 main.go:141] libmachine: Making call to close driver server

	I0925 04:28:40.833686    9153 main.go:141] libmachine: (embed-certs-952000) Calling .Close

	I0925 04:28:40.833695    9153 main.go:141] libmachine: (embed-certs-952000) Calling .Close

	I0925 04:28:40.833685    9153 main.go:141] libmachine: (embed-certs-952000) Calling .Close

	I0925 04:28:40.833847    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Closing plugin on server side

	I0925 04:28:40.833847    9153 main.go:141] libmachine: Successfully made call to close driver server

	I0925 04:28:40.833860    9153 main.go:141] libmachine: Making call to close connection to plugin binary

	I0925 04:28:40.833876    9153 main.go:141] libmachine: Making call to close driver server

	I0925 04:28:40.833881    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Closing plugin on server side

	I0925 04:28:40.833883    9153 main.go:141] libmachine: (embed-certs-952000) Calling .Close

	I0925 04:28:40.833912    9153 main.go:141] libmachine: Successfully made call to close driver server

	I0925 04:28:40.833922    9153 main.go:141] libmachine: Making call to close connection to plugin binary

	I0925 04:28:40.833929    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Closing plugin on server side

	I0925 04:28:40.833962    9153 main.go:141] libmachine: Successfully made call to close driver server

	I0925 04:28:40.833979    9153 main.go:141] libmachine: Making call to close connection to plugin binary

	I0925 04:28:40.833990    9153 addons.go:467] Verifying addon metrics-server=true in "embed-certs-952000"

	I0925 04:28:40.834062    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Closing plugin on server side

	I0925 04:28:40.834109    9153 main.go:141] libmachine: Successfully made call to close driver server

	I0925 04:28:40.834124    9153 main.go:141] libmachine: Making call to close connection to plugin binary

	I0925 04:28:41.118030    9153 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.2/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (1.196091364s)

	I0925 04:28:41.118062    9153 main.go:141] libmachine: Making call to close driver server

	I0925 04:28:41.118070    9153 main.go:141] libmachine: (embed-certs-952000) Calling .Close

	I0925 04:28:41.118223    9153 main.go:141] libmachine: Successfully made call to close driver server

	I0925 04:28:41.118233    9153 main.go:141] libmachine: Making call to close connection to plugin binary

	I0925 04:28:41.118241    9153 main.go:141] libmachine: Making call to close driver server

	I0925 04:28:41.118249    9153 main.go:141] libmachine: (embed-certs-952000) Calling .Close

	I0925 04:28:41.118251    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Closing plugin on server side

	I0925 04:28:41.118386    9153 main.go:141] libmachine: (embed-certs-952000) DBG | Closing plugin on server side

	I0925 04:28:41.118406    9153 main.go:141] libmachine: Successfully made call to close driver server

	I0925 04:28:41.118418    9153 main.go:141] libmachine: Making call to close connection to plugin binary

	I0925 04:28:41.139799    9153 out.go:177] * Some dashboard features require the metrics-server addon. To enable all features please run:

		minikube -p embed-certs-952000 addons enable metrics-server	

	I0925 04:28:41.197436    9153 out.go:177] * Enabled addons: storage-provisioner, metrics-server, default-storageclass, dashboard

	I0925 04:28:42.378767    8765 system_pods.go:86] 8 kube-system pods found

	I0925 04:28:42.378780    8765 system_pods.go:89] "coredns-5644d7b6d9-fhm6m" [261b0b1b-bbe6-420e-af7f-6e7cab5f7c35] Running

	I0925 04:28:42.378784    8765 system_pods.go:89] "etcd-old-k8s-version-596000" [a4089b4d-bb12-4bdf-800a-0aac385df57a] Running

	I0925 04:28:42.378788    8765 system_pods.go:89] "kube-apiserver-old-k8s-version-596000" [66c79610-9a29-4e3c-838d-035e86a4089c] Running

	I0925 04:28:42.378804    8765 system_pods.go:89] "kube-controller-manager-old-k8s-version-596000" [26ce3f96-6152-4480-a78a-315a4dbbc8ed] Running

	I0925 04:28:42.378812    8765 system_pods.go:89] "kube-proxy-9jcsn" [1329f3cf-e0f3-43b7-8d1e-23961ea3ffe7] Running

	I0925 04:28:42.378819    8765 system_pods.go:89] "kube-scheduler-old-k8s-version-596000" [29492770-13f3-480b-b887-d880e8df61a6] Running

	I0925 04:28:42.378828    8765 system_pods.go:89] "metrics-server-74d5856cc6-8mcq6" [e3f5ea81-2285-4c21-9779-49cd559184dc] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0925 04:28:42.378835    8765 system_pods.go:89] "storage-provisioner" [5b3475c5-65f3-44a9-8561-bf6c52a49a9e] Running

	I0925 04:28:42.378841    8765 system_pods.go:126] duration metric: took 1m4.323877371s to wait for k8s-apps to be running ...

	I0925 04:28:42.378846    8765 system_svc.go:44] waiting for kubelet service to be running ....

	I0925 04:28:42.378899    8765 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0925 04:28:42.388996    8765 system_svc.go:56] duration metric: took 10.145002ms WaitForService to wait for kubelet.

	I0925 04:28:42.389012    8765 kubeadm.go:581] duration metric: took 1m13.793225187s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0925 04:28:42.389030    8765 node_conditions.go:102] verifying NodePressure condition ...

	I0925 04:28:42.391070    8765 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki

	I0925 04:28:42.391084    8765 node_conditions.go:123] node cpu capacity is 2

	I0925 04:28:42.391090    8765 node_conditions.go:105] duration metric: took 2.057781ms to run NodePressure ...

	I0925 04:28:42.391098    8765 start.go:228] waiting for startup goroutines ...

	I0925 04:28:42.391103    8765 start.go:233] waiting for cluster config update ...

	I0925 04:28:42.391114    8765 start.go:242] writing updated cluster config ...

	I0925 04:28:42.391429    8765 ssh_runner.go:195] Run: rm -f paused

	I0925 04:28:42.428749    8765 start.go:600] kubectl: 1.27.2, cluster: 1.16.0 (minor skew: 11)

	I0925 04:28:42.452877    8765 out.go:177] 

	W0925 04:28:42.474552    8765 out.go:239] ! /usr/local/bin/kubectl is version 1.27.2, which may have incompatibilities with Kubernetes 1.16.0.

	I0925 04:28:42.495668    8765 out.go:177]   - Want kubectl v1.16.0? Try 'minikube kubectl -- get pods -A'

	I0925 04:28:42.537530    8765 out.go:177] * Done! kubectl is now configured to use "old-k8s-version-596000" cluster and "default" namespace by default

	I0925 04:28:41.270664    9153 addons.go:502] enable addons completed in 1.995590067s: enabled=[storage-provisioner metrics-server default-storageclass dashboard]

	I0925 04:28:43.071499    9153 pod_ready.go:102] pod "coredns-5dd5756b68-vbhcz" in "kube-system" namespace has status "Ready":"False"

	I0925 04:28:45.571471    9153 pod_ready.go:102] pod "coredns-5dd5756b68-vbhcz" in "kube-system" namespace has status "Ready":"False"

	I0925 04:28:46.072170    9153 pod_ready.go:92] pod "coredns-5dd5756b68-vbhcz" in "kube-system" namespace has status "Ready":"True"

	I0925 04:28:46.072183    9153 pod_ready.go:81] duration metric: took 5.389995906s waiting for pod "coredns-5dd5756b68-vbhcz" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:46.072189    9153 pod_ready.go:78] waiting up to 6m0s for pod "etcd-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:48.083497    9153 pod_ready.go:102] pod "etcd-embed-certs-952000" in "kube-system" namespace has status "Ready":"False"

	I0925 04:28:48.590037    9153 pod_ready.go:92] pod "etcd-embed-certs-952000" in "kube-system" namespace has status "Ready":"True"

	I0925 04:28:48.590050    9153 pod_ready.go:81] duration metric: took 2.51784815s waiting for pod "etcd-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:48.590058    9153 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:48.608877    9153 pod_ready.go:92] pod "kube-apiserver-embed-certs-952000" in "kube-system" namespace has status "Ready":"True"

	I0925 04:28:48.608890    9153 pod_ready.go:81] duration metric: took 18.826851ms waiting for pod "kube-apiserver-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:48.608897    9153 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:50.071756    9153 pod_ready.go:92] pod "kube-controller-manager-embed-certs-952000" in "kube-system" namespace has status "Ready":"True"

	I0925 04:28:50.071767    9153 pod_ready.go:81] duration metric: took 1.462861153s waiting for pod "kube-controller-manager-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:50.071774    9153 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-jl6vp" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:50.269695    9153 pod_ready.go:92] pod "kube-proxy-jl6vp" in "kube-system" namespace has status "Ready":"True"

	I0925 04:28:50.269706    9153 pod_ready.go:81] duration metric: took 197.927657ms waiting for pod "kube-proxy-jl6vp" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:50.269712    9153 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:50.665958    9153 pod_ready.go:92] pod "kube-scheduler-embed-certs-952000" in "kube-system" namespace has status "Ready":"True"

	I0925 04:28:50.665970    9153 pod_ready.go:81] duration metric: took 396.251712ms waiting for pod "kube-scheduler-embed-certs-952000" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:50.665976    9153 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-57f55c9bc5-jw9fg" in "kube-system" namespace to be "Ready" ...

	I0925 04:28:52.970964    9153 pod_ready.go:102] pod "metrics-server-57f55c9bc5-jw9fg" in "kube-system" namespace has status "Ready":"False"

	* 

	* ==> Docker <==

	* -- Journal begins at Mon 2023-09-25 11:20:54 UTC, ends at Mon 2023-09-25 11:28:53 UTC. --

	Sep 25 11:27:44 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:27:44.043401928Z" level=info msg="shim disconnected" id=3933a1cd85ca25d57f92c33ac343bfe9c9bd3c0dd20df263ca7745a95d7c38ec namespace=moby

	Sep 25 11:27:44 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:27:44.044250167Z" level=warning msg="cleaning up after shim disconnected" id=3933a1cd85ca25d57f92c33ac343bfe9c9bd3c0dd20df263ca7745a95d7c38ec namespace=moby

	Sep 25 11:27:44 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:27:44.044353196Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 25 11:27:46 old-k8s-version-596000 dockerd[1163]: time="2023-09-25T11:27:46.932483736Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.64.1:53: no such host"

	Sep 25 11:27:46 old-k8s-version-596000 dockerd[1163]: time="2023-09-25T11:27:46.933184372Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.64.1:53: no such host"

	Sep 25 11:27:46 old-k8s-version-596000 dockerd[1163]: time="2023-09-25T11:27:46.934327119Z" level=error msg="Handler for POST /images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.64.1:53: no such host"

	Sep 25 11:28:03 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:28:03.098955232Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 25 11:28:03 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:28:03.099019414Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 25 11:28:03 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:28:03.099403836Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Sep 25 11:28:03 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:28:03.099418566Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 25 11:28:03 old-k8s-version-596000 dockerd[1163]: time="2023-09-25T11:28:03.378479615Z" level=info msg="ignoring event" container=0be11ea9d18c37aad81694d7ec43ea642ccf67728782aefb6c62afed0e6c4d3e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 25 11:28:03 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:28:03.378947986Z" level=info msg="shim disconnected" id=0be11ea9d18c37aad81694d7ec43ea642ccf67728782aefb6c62afed0e6c4d3e namespace=moby

	Sep 25 11:28:03 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:28:03.379048385Z" level=warning msg="cleaning up after shim disconnected" id=0be11ea9d18c37aad81694d7ec43ea642ccf67728782aefb6c62afed0e6c4d3e namespace=moby

	Sep 25 11:28:03 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:28:03.379080647Z" level=info msg="cleaning up dead shim" namespace=moby

	Sep 25 11:28:11 old-k8s-version-596000 dockerd[1163]: time="2023-09-25T11:28:11.930178721Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.64.1:53: no such host"

	Sep 25 11:28:11 old-k8s-version-596000 dockerd[1163]: time="2023-09-25T11:28:11.930217529Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.64.1:53: no such host"

	Sep 25 11:28:11 old-k8s-version-596000 dockerd[1163]: time="2023-09-25T11:28:11.931687889Z" level=error msg="Handler for POST /images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.64.1:53: no such host"

	Sep 25 11:28:34 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:28:34.969602319Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Sep 25 11:28:34 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:28:34.969900812Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 25 11:28:34 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:28:34.970029503Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Sep 25 11:28:34 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:28:34.970091935Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Sep 25 11:28:35 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:28:35.244480454Z" level=info msg="shim disconnected" id=4a1b756bd3e299be0966589705dcd15a0f4a9e4bc9159ce48ff1790fd8eafec0 namespace=moby

	Sep 25 11:28:35 old-k8s-version-596000 dockerd[1163]: time="2023-09-25T11:28:35.244572405Z" level=info msg="ignoring event" container=4a1b756bd3e299be0966589705dcd15a0f4a9e4bc9159ce48ff1790fd8eafec0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Sep 25 11:28:35 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:28:35.244780783Z" level=warning msg="cleaning up after shim disconnected" id=4a1b756bd3e299be0966589705dcd15a0f4a9e4bc9159ce48ff1790fd8eafec0 namespace=moby

	Sep 25 11:28:35 old-k8s-version-596000 dockerd[1169]: time="2023-09-25T11:28:35.244825871Z" level=info msg="cleaning up dead shim" namespace=moby

	* 

	* ==> container status <==

	* CONTAINER ID   IMAGE                    COMMAND                  CREATED              STATUS                      PORTS     NAMES

	4a1b756bd3e2   a90209bb39e3             "nginx -g 'daemon of…"   19 seconds ago       Exited (1) 18 seconds ago             k8s_dashboard-metrics-scraper_dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard_959ea4ad-dd53-4edd-9b0c-3dc1f22fde25_3

	11e6f66d7d1e   kubernetesui/dashboard   "/dashboard --insecu…"   About a minute ago   Up About a minute                     k8s_kubernetes-dashboard_kubernetes-dashboard-84b68f675b-h2hm9_kubernetes-dashboard_47e68605-826a-4bf6-8f58-e49bb6b880fd_0

	10ec9d0f85bf   k8s.gcr.io/pause:3.1     "/pause"                 About a minute ago   Up About a minute                     k8s_POD_dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard_959ea4ad-dd53-4edd-9b0c-3dc1f22fde25_0

	1affbc9072d9   k8s.gcr.io/pause:3.1     "/pause"                 About a minute ago   Up About a minute                     k8s_POD_kubernetes-dashboard-84b68f675b-h2hm9_kubernetes-dashboard_47e68605-826a-4bf6-8f58-e49bb6b880fd_0

	a0c8d5d59637   k8s.gcr.io/pause:3.1     "/pause"                 About a minute ago   Up About a minute                     k8s_POD_metrics-server-74d5856cc6-8mcq6_kube-system_e3f5ea81-2285-4c21-9779-49cd559184dc_0

	1826970338f8   6e38f40d628d             "/storage-provisioner"   About a minute ago   Up About a minute                     k8s_storage-provisioner_storage-provisioner_kube-system_5b3475c5-65f3-44a9-8561-bf6c52a49a9e_0

	56b89dea6f68   bf261d157914             "/coredns -conf /etc…"   About a minute ago   Up About a minute                     k8s_coredns_coredns-5644d7b6d9-fhm6m_kube-system_261b0b1b-bbe6-420e-af7f-6e7cab5f7c35_0

	e368cc3e8a0e   k8s.gcr.io/pause:3.1     "/pause"                 About a minute ago   Up About a minute                     k8s_POD_storage-provisioner_kube-system_5b3475c5-65f3-44a9-8561-bf6c52a49a9e_0

	9918c73a325c   k8s.gcr.io/pause:3.1     "/pause"                 About a minute ago   Up About a minute                     k8s_POD_coredns-5644d7b6d9-fhm6m_kube-system_261b0b1b-bbe6-420e-af7f-6e7cab5f7c35_0

	9b72b8dd9942   c21b0c7400f9             "/usr/local/bin/kube…"   About a minute ago   Up About a minute                     k8s_kube-proxy_kube-proxy-9jcsn_kube-system_1329f3cf-e0f3-43b7-8d1e-23961ea3ffe7_0

	4276f9894a19   k8s.gcr.io/pause:3.1     "/pause"                 About a minute ago   Up About a minute                     k8s_POD_kube-proxy-9jcsn_kube-system_1329f3cf-e0f3-43b7-8d1e-23961ea3ffe7_0

	8ef8d62c0a2f   b2756210eeab             "etcd --advertise-cl…"   About a minute ago   Up About a minute                     k8s_etcd_etcd-old-k8s-version-596000_kube-system_a7a4ab991673adbe74e24224e670c8b4_0

	a829220abd9f   301ddc62b80b             "kube-scheduler --au…"   About a minute ago   Up About a minute                     k8s_kube-scheduler_kube-scheduler-old-k8s-version-596000_kube-system_b3d303074fe0ca1d42a8bd9ed248df09_0

	ab36bd02c56d   b305571ca60a             "kube-apiserver --ad…"   About a minute ago   Up About a minute                     k8s_kube-apiserver_kube-apiserver-old-k8s-version-596000_kube-system_7ab33bae85b14572b4945e1e94beb673_0

	4ee8f9066e9e   06a629a7e51c             "kube-controller-man…"   About a minute ago   Up About a minute                     k8s_kube-controller-manager_kube-controller-manager-old-k8s-version-596000_kube-system_7376ddb4f190a0ded9394063437bcb4e_0

	fddcbbcbe3b9   k8s.gcr.io/pause:3.1     "/pause"                 About a minute ago   Up About a minute                     k8s_POD_etcd-old-k8s-version-596000_kube-system_a7a4ab991673adbe74e24224e670c8b4_0

	b09be620b570   k8s.gcr.io/pause:3.1     "/pause"                 About a minute ago   Up About a minute                     k8s_POD_kube-scheduler-old-k8s-version-596000_kube-system_b3d303074fe0ca1d42a8bd9ed248df09_0

	118c8922ee29   k8s.gcr.io/pause:3.1     "/pause"                 About a minute ago   Up About a minute                     k8s_POD_kube-controller-manager-old-k8s-version-596000_kube-system_7376ddb4f190a0ded9394063437bcb4e_0

	324a7648f364   k8s.gcr.io/pause:3.1     "/pause"                 About a minute ago   Up About a minute                     k8s_POD_kube-apiserver-old-k8s-version-596000_kube-system_7ab33bae85b14572b4945e1e94beb673_0

	time="2023-09-25T11:28:53Z" level=fatal msg="validate service connection: validate CRI v1 runtime API for endpoint \"unix:///var/run/dockershim.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.RuntimeService"

	* 

	* ==> coredns [56b89dea6f68] <==

	* .:53

	2023-09-25T11:27:30.243Z [INFO] plugin/reload: Running configuration MD5 = 46cbc15810136842e5653e578aaacfef

	2023-09-25T11:27:30.243Z [INFO] CoreDNS-1.6.2

	2023-09-25T11:27:30.243Z [INFO] linux/amd64, go1.12.8, 795a3eb

	CoreDNS-1.6.2

	linux/amd64, go1.12.8, 795a3eb

	2023-09-25T11:27:30.248Z [INFO] 127.0.0.1:59820 - 3726 "HINFO IN 1083097832645627984.6742915448314799892. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.004226111s

	* 

	* ==> describe nodes <==

	* Name:               old-k8s-version-596000

	Roles:              master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=old-k8s-version-596000

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=1bf6c3d5317028f348e55ea19d261973a6487d3c

	                    minikube.k8s.io/name=old-k8s-version-596000

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_09_25T04_27_12_0700

	                    minikube.k8s.io/version=v1.31.2

	                    node-role.kubernetes.io/master=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 25 Sep 2023 11:27:07 +0000

	Taints:             <none>

	Unschedulable:      false

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 25 Sep 2023 11:28:07 +0000   Mon, 25 Sep 2023 11:27:04 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 25 Sep 2023 11:28:07 +0000   Mon, 25 Sep 2023 11:27:04 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 25 Sep 2023 11:28:07 +0000   Mon, 25 Sep 2023 11:27:04 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 25 Sep 2023 11:28:07 +0000   Mon, 25 Sep 2023 11:27:04 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.64.40

	  Hostname:    old-k8s-version-596000

	Capacity:

	 cpu:                2

	 ephemeral-storage:  17784752Ki

	 hugepages-2Mi:      0

	 memory:             2166052Ki

	 pods:               110

	Allocatable:

	 cpu:                2

	 ephemeral-storage:  17784752Ki

	 hugepages-2Mi:      0

	 memory:             2166052Ki

	 pods:               110

	System Info:

	 Machine ID:                 216ad66d17e04de29aa366b932b26216

	 System UUID:                34f011ee-0000-0000-88a8-149d997fca88

	 Boot ID:                    fecdf2a5-fae2-47ab-81be-3584e62b17a1

	 Kernel Version:             5.10.57

	 OS Image:                   Buildroot 2021.02.12

	 Operating System:           linux

	 Architecture:               amd64

	 Container Runtime Version:  docker://24.0.6

	 Kubelet Version:            v1.16.0

	 Kube-Proxy Version:         v1.16.0

	PodCIDR:                     10.244.0.0/24

	PodCIDRs:                    10.244.0.0/24

	Non-terminated Pods:         (10 in total)

	  Namespace                  Name                                              CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE

	  ---------                  ----                                              ------------  ----------  ---------------  -------------  ---

	  kube-system                coredns-5644d7b6d9-fhm6m                          100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     86s

	  kube-system                etcd-old-k8s-version-596000                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         30s

	  kube-system                kube-apiserver-old-k8s-version-596000             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         26s

	  kube-system                kube-controller-manager-old-k8s-version-596000    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         26s

	  kube-system                kube-proxy-9jcsn                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         86s

	  kube-system                kube-scheduler-old-k8s-version-596000             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         42s

	  kube-system                metrics-server-74d5856cc6-8mcq6                   100m (5%!)(MISSING)     0 (0%!)(MISSING)      200Mi (9%!)(MISSING)       0 (0%!)(MISSING)         84s

	  kube-system                storage-provisioner                               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         85s

	  kubernetes-dashboard       dashboard-metrics-scraper-d6b4b5544-lfvc8         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         83s

	  kubernetes-dashboard       kubernetes-dashboard-84b68f675b-h2hm9             0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         83s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                750m (37%!)(MISSING)   0 (0%!)(MISSING)

	  memory             270Mi (12%!)(MISSING)  170Mi (8%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                  From                                Message

	  ----    ------                   ----                 ----                                -------

	  Normal  Starting                 112s                 kubelet, old-k8s-version-596000     Starting kubelet.

	  Normal  NodeHasSufficientMemory  111s (x8 over 111s)  kubelet, old-k8s-version-596000     Node old-k8s-version-596000 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    111s (x8 over 111s)  kubelet, old-k8s-version-596000     Node old-k8s-version-596000 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     111s (x7 over 111s)  kubelet, old-k8s-version-596000     Node old-k8s-version-596000 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  111s                 kubelet, old-k8s-version-596000     Updated Node Allocatable limit across pods

	  Normal  Starting                 85s                  kube-proxy, old-k8s-version-596000  Starting kube-proxy.

	* 

	* ==> dmesg <==

	* [  +0.028784] ACPI BIOS Warning (bug): Incorrect checksum in table [DSDT] - 0xBE, should be 0x1B (20200925/tbprint-173)

	[  +4.972545] ACPI Error: Could not enable RealTimeClock event (20200925/evxfevnt-182)

	[  +0.000002] ACPI Warning: Could not enable fixed event - RealTimeClock (4) (20200925/evxface-618)

	[  +0.007163] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +2.195763] systemd-fstab-generator[125]: Ignoring "noauto" for root device

	[  +0.039969] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.

	[  +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)

	[  +1.852062] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000008] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)

	[Sep25 11:21] systemd-fstab-generator[519]: Ignoring "noauto" for root device

	[  +0.088218] systemd-fstab-generator[530]: Ignoring "noauto" for root device

	[  +0.758521] systemd-fstab-generator[783]: Ignoring "noauto" for root device

	[  +0.218437] systemd-fstab-generator[820]: Ignoring "noauto" for root device

	[  +0.087554] systemd-fstab-generator[831]: Ignoring "noauto" for root device

	[  +0.122881] systemd-fstab-generator[859]: Ignoring "noauto" for root device

	[  +6.068803] systemd-fstab-generator[1154]: Ignoring "noauto" for root device

	[  +1.716451] kauditd_printk_skb: 67 callbacks suppressed

	[ +14.130874] systemd-fstab-generator[1610]: Ignoring "noauto" for root device

	[ +20.571665] kauditd_printk_skb: 29 callbacks suppressed

	[  +0.080099] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.

	[Sep25 11:22] kauditd_printk_skb: 5 callbacks suppressed

	[Sep25 11:26] systemd-fstab-generator[6873]: Ignoring "noauto" for root device

	[Sep25 11:27] TCP: eth0: Driver has suspect GRO implementation, TCP performance may be compromised.

	[  +0.043629] kauditd_printk_skb: 4 callbacks suppressed

	* 

	* ==> etcd [8ef8d62c0a2f] <==

	* 2023-09-25 11:27:04.746531 I | etcdserver: starting member 8700b5f30fd8925d in cluster 39244c9d1c1d508b

	2023-09-25 11:27:04.763441 I | raft: 8700b5f30fd8925d became follower at term 0

	2023-09-25 11:27:04.767668 I | raft: newRaft 8700b5f30fd8925d [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]

	2023-09-25 11:27:04.770511 I | raft: 8700b5f30fd8925d became follower at term 1

	2023-09-25 11:27:04.816261 W | auth: simple token is not cryptographically signed

	2023-09-25 11:27:04.817817 I | etcdserver: starting server... [version: 3.3.15, cluster version: to_be_decided]

	2023-09-25 11:27:04.821822 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, ca = , trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 

	2023-09-25 11:27:04.822082 I | embed: listening for metrics on http://192.168.64.40:2381

	2023-09-25 11:27:04.825106 I | etcdserver: 8700b5f30fd8925d as single-node; fast-forwarding 9 ticks (election ticks 10)

	2023-09-25 11:27:04.825854 I | embed: listening for metrics on http://127.0.0.1:2381

	2023-09-25 11:27:04.825941 I | etcdserver/membership: added member 8700b5f30fd8925d [https://192.168.64.40:2380] to cluster 39244c9d1c1d508b

	2023-09-25 11:27:05.393162 I | raft: 8700b5f30fd8925d is starting a new election at term 1

	2023-09-25 11:27:05.393205 I | raft: 8700b5f30fd8925d became candidate at term 2

	2023-09-25 11:27:05.393214 I | raft: 8700b5f30fd8925d received MsgVoteResp from 8700b5f30fd8925d at term 2

	2023-09-25 11:27:05.393221 I | raft: 8700b5f30fd8925d became leader at term 2

	2023-09-25 11:27:05.393225 I | raft: raft.node: 8700b5f30fd8925d elected leader 8700b5f30fd8925d at term 2

	2023-09-25 11:27:05.393624 I | embed: ready to serve client requests

	2023-09-25 11:27:05.393676 I | etcdserver: published {Name:old-k8s-version-596000 ClientURLs:[https://192.168.64.40:2379]} to cluster 39244c9d1c1d508b

	2023-09-25 11:27:05.393865 I | embed: ready to serve client requests

	2023-09-25 11:27:05.394714 I | embed: serving client requests on 127.0.0.1:2379

	2023-09-25 11:27:05.394848 I | embed: serving client requests on 192.168.64.40:2379

	2023-09-25 11:27:05.394882 I | etcdserver: setting up the initial cluster version to 3.3

	2023-09-25 11:27:05.410147 N | etcdserver/membership: set the initial cluster version to 3.3

	2023-09-25 11:27:05.410240 I | etcdserver/api: enabled capabilities for version 3.3

	2023-09-25 11:27:28.819487 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/coredns-5644d7b6d9-9bzj5\" " with result "range_response_count:1 size:1447" took too long (113.687882ms) to execute

	* 

	* ==> kernel <==

	*  11:28:54 up 8 min,  0 users,  load average: 0.31, 0.33, 0.17

	Linux old-k8s-version-596000 5.10.57 #1 SMP Mon Sep 18 23:12:38 UTC 2023 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2021.02.12"

	* 

	* ==> kube-apiserver [ab36bd02c56d] <==

	* I0925 11:27:08.664549       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).

	I0925 11:27:08.664589       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

	I0925 11:27:08.676393       1 storage_scheduling.go:139] created PriorityClass system-node-critical with value 2000001000

	I0925 11:27:08.680742       1 storage_scheduling.go:139] created PriorityClass system-cluster-critical with value 2000000000

	I0925 11:27:08.680799       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.

	I0925 11:27:10.445653       1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0925 11:27:10.725680       1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	W0925 11:27:11.015270       1 lease.go:222] Resetting endpoints for master service "kubernetes" to [192.168.64.40]

	I0925 11:27:11.015864       1 controller.go:606] quota admission added evaluator for: endpoints

	I0925 11:27:11.944718       1 controller.go:606] quota admission added evaluator for: serviceaccounts

	I0925 11:27:12.437251       1 controller.go:606] quota admission added evaluator for: deployments.apps

	I0925 11:27:12.739685       1 controller.go:606] quota admission added evaluator for: daemonsets.apps

	I0925 11:27:28.446369       1 controller.go:606] quota admission added evaluator for: replicasets.apps

	I0925 11:27:28.470281       1 controller.go:606] quota admission added evaluator for: events.events.k8s.io

	I0925 11:27:28.895467       1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps

	I0925 11:27:31.332214       1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io

	W0925 11:27:31.332257       1 handler_proxy.go:99] no RequestInfo found in the context

	E0925 11:27:31.332329       1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	I0925 11:27:31.332336       1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	I0925 11:28:31.337350       1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io

	W0925 11:28:31.337539       1 handler_proxy.go:99] no RequestInfo found in the context

	E0925 11:28:31.337639       1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	I0925 11:28:31.337660       1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	* 

	* ==> kube-controller-manager [4ee8f9066e9e] <==

	* I0925 11:27:29.022533       1 garbagecollector.go:139] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0925 11:27:29.765009       1 event.go:255] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"metrics-server", UID:"e15f2e60-d093-47c5-93ca-f6d0b6dc3f38", APIVersion:"apps/v1", ResourceVersion:"387", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set metrics-server-74d5856cc6 to 1

	I0925 11:27:29.772928       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"metrics-server-74d5856cc6", UID:"16720cae-50e8-4edf-b9ff-1c782c9ff24d", APIVersion:"apps/v1", ResourceVersion:"388", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "metrics-server-74d5856cc6-" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount "metrics-server" not found

	E0925 11:27:29.883475       1 replica_set.go:450] Sync "kube-system/metrics-server-74d5856cc6" failed with pods "metrics-server-74d5856cc6-" is forbidden: error looking up service account kube-system/metrics-server: serviceaccount "metrics-server" not found

	I0925 11:27:29.919930       1 shared_informer.go:197] Waiting for caches to sync for garbage collector

	I0925 11:27:30.030192       1 shared_informer.go:204] Caches are synced for garbage collector 

	I0925 11:27:30.320503       1 event.go:255] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper", UID:"8e5dd157-2a0c-4319-850e-ffffc78f74da", APIVersion:"apps/v1", ResourceVersion:"420", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set dashboard-metrics-scraper-d6b4b5544 to 1

	I0925 11:27:30.350215       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-d6b4b5544", UID:"ba532e2d-6080-41fa-a567-edd5d2d630d6", APIVersion:"apps/v1", ResourceVersion:"422", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "dashboard-metrics-scraper-d6b4b5544-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0925 11:27:30.357601       1 event.go:255] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard", UID:"3f78dc83-d98c-4fef-a2c3-7b8ecf77c53a", APIVersion:"apps/v1", ResourceVersion:"429", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set kubernetes-dashboard-84b68f675b to 1

	E0925 11:27:30.357749       1 replica_set.go:450] Sync "kubernetes-dashboard/dashboard-metrics-scraper-d6b4b5544" failed with pods "dashboard-metrics-scraper-d6b4b5544-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0925 11:27:30.362613       1 replica_set.go:450] Sync "kubernetes-dashboard/dashboard-metrics-scraper-d6b4b5544" failed with pods "dashboard-metrics-scraper-d6b4b5544-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0925 11:27:30.362727       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-d6b4b5544", UID:"ba532e2d-6080-41fa-a567-edd5d2d630d6", APIVersion:"apps/v1", ResourceVersion:"431", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "dashboard-metrics-scraper-d6b4b5544-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0925 11:27:30.366659       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-84b68f675b", UID:"6a46b785-9156-4843-beec-90b7d18a0c24", APIVersion:"apps/v1", ResourceVersion:"433", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-84b68f675b-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0925 11:27:30.373572       1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-84b68f675b" failed with pods "kubernetes-dashboard-84b68f675b-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0925 11:27:30.388337       1 replica_set.go:450] Sync "kubernetes-dashboard/dashboard-metrics-scraper-d6b4b5544" failed with pods "dashboard-metrics-scraper-d6b4b5544-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0925 11:27:30.388756       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-d6b4b5544", UID:"ba532e2d-6080-41fa-a567-edd5d2d630d6", APIVersion:"apps/v1", ResourceVersion:"431", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "dashboard-metrics-scraper-d6b4b5544-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0925 11:27:30.400146       1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-84b68f675b" failed with pods "kubernetes-dashboard-84b68f675b-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0925 11:27:30.400602       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-84b68f675b", UID:"6a46b785-9156-4843-beec-90b7d18a0c24", APIVersion:"apps/v1", ResourceVersion:"438", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-84b68f675b-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0925 11:27:30.888880       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"metrics-server-74d5856cc6", UID:"16720cae-50e8-4edf-b9ff-1c782c9ff24d", APIVersion:"apps/v1", ResourceVersion:"391", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: metrics-server-74d5856cc6-8mcq6

	I0925 11:27:31.407286       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-84b68f675b", UID:"6a46b785-9156-4843-beec-90b7d18a0c24", APIVersion:"apps/v1", ResourceVersion:"438", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kubernetes-dashboard-84b68f675b-h2hm9

	I0925 11:27:31.419013       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-d6b4b5544", UID:"ba532e2d-6080-41fa-a567-edd5d2d630d6", APIVersion:"apps/v1", ResourceVersion:"431", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: dashboard-metrics-scraper-d6b4b5544-lfvc8

	E0925 11:27:59.176924       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	W0925 11:28:02.033344       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E0925 11:28:29.432783       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	W0925 11:28:34.035211       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	* 

	* ==> kube-proxy [9b72b8dd9942] <==

	* W0925 11:27:29.701993       1 server_others.go:329] Flag proxy-mode="" unknown, assuming iptables proxy

	I0925 11:27:29.738193       1 node.go:135] Successfully retrieved node IP: 192.168.64.40

	I0925 11:27:29.738214       1 server_others.go:149] Using iptables Proxier.

	I0925 11:27:29.747291       1 server.go:529] Version: v1.16.0

	I0925 11:27:29.775237       1 config.go:313] Starting service config controller

	I0925 11:27:29.775503       1 shared_informer.go:197] Waiting for caches to sync for service config

	I0925 11:27:29.775521       1 config.go:131] Starting endpoints config controller

	I0925 11:27:29.775587       1 shared_informer.go:197] Waiting for caches to sync for endpoints config

	I0925 11:27:29.875914       1 shared_informer.go:204] Caches are synced for endpoints config 

	I0925 11:27:29.875979       1 shared_informer.go:204] Caches are synced for service config 

	* 

	* ==> kube-scheduler [a829220abd9f] <==

	* I0925 11:27:07.732498       1 deprecated_insecure_serving.go:51] Serving healthz insecurely on [::]:10251

	I0925 11:27:07.733154       1 secure_serving.go:123] Serving securely on 127.0.0.1:10259

	E0925 11:27:07.769765       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0925 11:27:07.772565       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0925 11:27:07.772831       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0925 11:27:07.773035       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0925 11:27:07.773368       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0925 11:27:07.774705       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0925 11:27:07.774788       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0925 11:27:07.774905       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0925 11:27:07.774989       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0925 11:27:07.775005       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0925 11:27:07.777126       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0925 11:27:08.773439       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0925 11:27:08.775422       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0925 11:27:08.778396       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0925 11:27:08.780325       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0925 11:27:08.781626       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0925 11:27:08.783439       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0925 11:27:08.784425       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0925 11:27:08.786075       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0925 11:27:08.788778       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0925 11:27:08.792115       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0925 11:27:08.794700       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0925 11:27:28.476294       1 factory.go:585] pod is already present in the activeQ

	* 

	* ==> kubelet <==

	* -- Journal begins at Mon 2023-09-25 11:20:54 UTC, ends at Mon 2023-09-25 11:28:55 UTC. --

	Sep 25 11:27:45 old-k8s-version-596000 kubelet[6879]: E0925 11:27:45.746884    6879 pod_workers.go:191] Error syncing pod 959ea4ad-dd53-4edd-9b0c-3dc1f22fde25 ("dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"

	Sep 25 11:27:46 old-k8s-version-596000 kubelet[6879]: E0925 11:27:46.934711    6879 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.64.1:53: no such host

	Sep 25 11:27:46 old-k8s-version-596000 kubelet[6879]: E0925 11:27:46.934812    6879 kuberuntime_image.go:50] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.64.1:53: no such host

	Sep 25 11:27:46 old-k8s-version-596000 kubelet[6879]: E0925 11:27:46.934860    6879 kuberuntime_manager.go:783] container start failed: ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.64.1:53: no such host

	Sep 25 11:27:46 old-k8s-version-596000 kubelet[6879]: E0925 11:27:46.934880    6879 pod_workers.go:191] Error syncing pod e3f5ea81-2285-4c21-9779-49cd559184dc ("metrics-server-74d5856cc6-8mcq6_kube-system(e3f5ea81-2285-4c21-9779-49cd559184dc)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.64.1:53: no such host"

	Sep 25 11:27:48 old-k8s-version-596000 kubelet[6879]: E0925 11:27:48.109367    6879 pod_workers.go:191] Error syncing pod 959ea4ad-dd53-4edd-9b0c-3dc1f22fde25 ("dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 10s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"

	Sep 25 11:27:59 old-k8s-version-596000 kubelet[6879]: E0925 11:27:59.927920    6879 pod_workers.go:191] Error syncing pod e3f5ea81-2285-4c21-9779-49cd559184dc ("metrics-server-74d5856cc6-8mcq6_kube-system(e3f5ea81-2285-4c21-9779-49cd559184dc)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Sep 25 11:28:03 old-k8s-version-596000 kubelet[6879]: W0925 11:28:03.850919    6879 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-d6b4b5544-lfvc8 through plugin: invalid network status for

	Sep 25 11:28:03 old-k8s-version-596000 kubelet[6879]: E0925 11:28:03.855765    6879 pod_workers.go:191] Error syncing pod 959ea4ad-dd53-4edd-9b0c-3dc1f22fde25 ("dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"

	Sep 25 11:28:04 old-k8s-version-596000 kubelet[6879]: W0925 11:28:04.861382    6879 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-d6b4b5544-lfvc8 through plugin: invalid network status for

	Sep 25 11:28:08 old-k8s-version-596000 kubelet[6879]: E0925 11:28:08.108185    6879 pod_workers.go:191] Error syncing pod 959ea4ad-dd53-4edd-9b0c-3dc1f22fde25 ("dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"

	Sep 25 11:28:11 old-k8s-version-596000 kubelet[6879]: E0925 11:28:11.932158    6879 remote_image.go:113] PullImage "fake.domain/registry.k8s.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.64.1:53: no such host

	Sep 25 11:28:11 old-k8s-version-596000 kubelet[6879]: E0925 11:28:11.932495    6879 kuberuntime_image.go:50] Pull image "fake.domain/registry.k8s.io/echoserver:1.4" failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.64.1:53: no such host

	Sep 25 11:28:11 old-k8s-version-596000 kubelet[6879]: E0925 11:28:11.932572    6879 kuberuntime_manager.go:783] container start failed: ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.64.1:53: no such host

	Sep 25 11:28:11 old-k8s-version-596000 kubelet[6879]: E0925 11:28:11.932689    6879 pod_workers.go:191] Error syncing pod e3f5ea81-2285-4c21-9779-49cd559184dc ("metrics-server-74d5856cc6-8mcq6_kube-system(e3f5ea81-2285-4c21-9779-49cd559184dc)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.64.1:53: no such host"

	Sep 25 11:28:21 old-k8s-version-596000 kubelet[6879]: E0925 11:28:21.925076    6879 pod_workers.go:191] Error syncing pod 959ea4ad-dd53-4edd-9b0c-3dc1f22fde25 ("dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"

	Sep 25 11:28:25 old-k8s-version-596000 kubelet[6879]: E0925 11:28:25.927399    6879 pod_workers.go:191] Error syncing pod e3f5ea81-2285-4c21-9779-49cd559184dc ("metrics-server-74d5856cc6-8mcq6_kube-system(e3f5ea81-2285-4c21-9779-49cd559184dc)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Sep 25 11:28:35 old-k8s-version-596000 kubelet[6879]: W0925 11:28:35.031719    6879 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-d6b4b5544-lfvc8 through plugin: invalid network status for

	Sep 25 11:28:36 old-k8s-version-596000 kubelet[6879]: W0925 11:28:36.240088    6879 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-d6b4b5544-lfvc8 through plugin: invalid network status for

	Sep 25 11:28:36 old-k8s-version-596000 kubelet[6879]: E0925 11:28:36.244519    6879 pod_workers.go:191] Error syncing pod 959ea4ad-dd53-4edd-9b0c-3dc1f22fde25 ("dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"

	Sep 25 11:28:36 old-k8s-version-596000 kubelet[6879]: E0925 11:28:36.929393    6879 pod_workers.go:191] Error syncing pod e3f5ea81-2285-4c21-9779-49cd559184dc ("metrics-server-74d5856cc6-8mcq6_kube-system(e3f5ea81-2285-4c21-9779-49cd559184dc)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	Sep 25 11:28:37 old-k8s-version-596000 kubelet[6879]: W0925 11:28:37.250813    6879 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-d6b4b5544-lfvc8 through plugin: invalid network status for

	Sep 25 11:28:38 old-k8s-version-596000 kubelet[6879]: E0925 11:28:38.108342    6879 pod_workers.go:191] Error syncing pod 959ea4ad-dd53-4edd-9b0c-3dc1f22fde25 ("dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"

	Sep 25 11:28:48 old-k8s-version-596000 kubelet[6879]: E0925 11:28:48.928190    6879 pod_workers.go:191] Error syncing pod 959ea4ad-dd53-4edd-9b0c-3dc1f22fde25 ("dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-d6b4b5544-lfvc8_kubernetes-dashboard(959ea4ad-dd53-4edd-9b0c-3dc1f22fde25)"

	Sep 25 11:28:51 old-k8s-version-596000 kubelet[6879]: E0925 11:28:51.927118    6879 pod_workers.go:191] Error syncing pod e3f5ea81-2285-4c21-9779-49cd559184dc ("metrics-server-74d5856cc6-8mcq6_kube-system(e3f5ea81-2285-4c21-9779-49cd559184dc)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/registry.k8s.io/echoserver:1.4\""

	* 

	* ==> kubernetes-dashboard [11e6f66d7d1e] <==

	* 2023/09/25 11:27:37 Using namespace: kubernetes-dashboard

	2023/09/25 11:27:37 Using in-cluster config to connect to apiserver

	2023/09/25 11:27:37 Using secret token for csrf signing

	2023/09/25 11:27:37 Initializing csrf token from kubernetes-dashboard-csrf secret

	2023/09/25 11:27:37 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf

	2023/09/25 11:27:37 Successful initial request to the apiserver, version: v1.16.0

	2023/09/25 11:27:37 Generating JWE encryption key

	2023/09/25 11:27:37 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting

	2023/09/25 11:27:37 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard

	2023/09/25 11:27:37 Initializing JWE encryption key from synchronized object

	2023/09/25 11:27:37 Creating in-cluster Sidecar client

	2023/09/25 11:27:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2023/09/25 11:27:37 Serving insecurely on HTTP port: 9090

	2023/09/25 11:28:07 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2023/09/25 11:28:37 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2023/09/25 11:27:37 Starting overwatch

	* 

	* ==> storage-provisioner [1826970338f8] <==

	* I0925 11:27:30.332078       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0925 11:27:30.390477       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0925 11:27:30.390737       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0925 11:27:30.417200       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0925 11:27:30.417629       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-596000_553a453a-6a73-4a2e-b079-e7e2b249b66e!

	I0925 11:27:30.422418       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"5aec8f39-d843-4b0e-bee7-3b6a62595cec", APIVersion:"v1", ResourceVersion:"445", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-596000_553a453a-6a73-4a2e-b079-e7e2b249b66e became leader

	I0925 11:27:30.518063       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-596000_553a453a-6a73-4a2e-b079-e7e2b249b66e!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.APIServer}} -p old-k8s-version-596000 -n old-k8s-version-596000

helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-596000 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: metrics-server-74d5856cc6-8mcq6

helpers_test.go:274: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context old-k8s-version-596000 describe pod metrics-server-74d5856cc6-8mcq6

helpers_test.go:277: (dbg) Non-zero exit: kubectl --context old-k8s-version-596000 describe pod metrics-server-74d5856cc6-8mcq6: exit status 1 (50.392251ms)

** stderr ** 

	Error from server (NotFound): pods "metrics-server-74d5856cc6-8mcq6" not found

** /stderr **

helpers_test.go:279: kubectl --context old-k8s-version-596000 describe pod metrics-server-74d5856cc6-8mcq6: exit status 1

--- FAIL: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (2.69s)

=== RUN   TestDownloadOnly/v1.16.0/json-events

aaa_download_only_test.go:69: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-677000 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=hyperkit 

aaa_download_only_test.go:69: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-677000 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=hyperkit : (11.739702207s)

--- PASS: TestDownloadOnly/v1.16.0/json-events (11.74s)

=== RUN   TestDownloadOnly/v1.16.0/preload-exists

--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

=== RUN   TestDownloadOnly/v1.16.0/kubectl

--- PASS: TestDownloadOnly/v1.16.0/kubectl (0.00s)

=== RUN   TestDownloadOnly/v1.16.0/LogsDuration

aaa_download_only_test.go:169: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-677000

aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-677000: exit status 85 (274.345689ms)

-- stdout --

	* 

	* ==> Audit <==

	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|

	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|

	| start   | -o=json --download-only        | download-only-677000 | jenkins | v1.31.2 | 25 Sep 23 03:32 PDT |          |

	|         | -p download-only-677000        |                      |         |         |                     |          |

	|         | --force --alsologtostderr      |                      |         |         |                     |          |

	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |

	|         | --container-runtime=docker     |                      |         |         |                     |          |

	|         | --driver=hyperkit              |                      |         |         |                     |          |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/09/25 03:32:57

	Running on machine: MacOS-Agent-4

	Binary: Built with gc go1.21.1 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0925 03:32:57.628326    1489 out.go:296] Setting OutFile to fd 1 ...

	I0925 03:32:57.628583    1489 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0925 03:32:57.628589    1489 out.go:309] Setting ErrFile to fd 2...

	I0925 03:32:57.628593    1489 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0925 03:32:57.628760    1489 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17297-1019/.minikube/bin

	W0925 03:32:57.628860    1489 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/17297-1019/.minikube/config/config.json: open /Users/jenkins/minikube-integration/17297-1019/.minikube/config/config.json: no such file or directory

	I0925 03:32:57.630463    1489 out.go:303] Setting JSON to true

	I0925 03:32:57.651915    1489 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":151,"bootTime":1695637826,"procs":382,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.6","kernelVersion":"22.6.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}

	W0925 03:32:57.652021    1489 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I0925 03:32:57.674935    1489 out.go:97] [download-only-677000] minikube v1.31.2 on Darwin 13.6

	I0925 03:32:57.695506    1489 out.go:169] MINIKUBE_LOCATION=17297

	I0925 03:32:57.675187    1489 notify.go:220] Checking for updates...

	W0925 03:32:57.675254    1489 preload.go:295] Failed to list preload files: open /Users/jenkins/minikube-integration/17297-1019/.minikube/cache/preloaded-tarball: no such file or directory

	I0925 03:32:57.737645    1489 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/17297-1019/kubeconfig

	I0925 03:32:57.758506    1489 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64

	I0925 03:32:57.779785    1489 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0925 03:32:57.801860    1489 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/17297-1019/.minikube

	W0925 03:32:57.844768    1489 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I0925 03:32:57.845297    1489 driver.go:373] Setting default libvirt URI to qemu:///system

	I0925 03:32:57.938713    1489 out.go:97] Using the hyperkit driver based on user configuration

	I0925 03:32:57.938743    1489 start.go:298] selected driver: hyperkit

	I0925 03:32:57.938750    1489 start.go:902] validating driver "hyperkit" against <nil>

	I0925 03:32:57.938874    1489 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0925 03:32:57.939092    1489 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17297-1019/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin

	I0925 03:32:58.080001    1489 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.31.2

	I0925 03:32:58.084083    1489 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 03:32:58.084100    1489 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good

	I0925 03:32:58.084129    1489 start_flags.go:307] no existing cluster config was found, will generate one from the flags 

	I0925 03:32:58.088039    1489 start_flags.go:384] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB

	I0925 03:32:58.088193    1489 start_flags.go:904] Wait components to verify : map[apiserver:true system_pods:true]

	I0925 03:32:58.088222    1489 cni.go:84] Creating CNI manager for ""

	I0925 03:32:58.088237    1489 cni.go:162] CNI unnecessary in this configuration, recommending no CNI

	I0925 03:32:58.088245    1489 start_flags.go:321] config:

	{Name:download-only-677000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-677000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Container

Runtime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I0925 03:32:58.088493    1489 iso.go:125] acquiring lock: {Name:mk5685b8103aa0f952a2e44c47bdd1882fdd0bc3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0925 03:32:58.109518    1489 out.go:97] Downloading VM boot image ...

	I0925 03:32:58.109683    1489 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso.sha256 -> /Users/jenkins/minikube-integration/17297-1019/.minikube/cache/iso/amd64/minikube-v1.31.0-1695060926-17240-amd64.iso

	I0925 03:33:02.192079    1489 out.go:97] Starting control plane node download-only-677000 in cluster download-only-677000

	I0925 03:33:02.192113    1489 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0925 03:33:02.270036    1489 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4

	I0925 03:33:02.270066    1489 cache.go:57] Caching tarball of preloaded images

	I0925 03:33:02.270368    1489 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0925 03:33:02.291267    1489 out.go:97] Downloading Kubernetes v1.16.0 preload ...

	I0925 03:33:02.291295    1489 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 ...

	I0925 03:33:02.374052    1489 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4?checksum=md5:326f3ce331abb64565b50b8c9e791244 -> /Users/jenkins/minikube-integration/17297-1019/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4

	I0925 03:33:07.452413    1489 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 ...

	I0925 03:33:07.452548    1489 preload.go:256] verifying checksum of /Users/jenkins/minikube-integration/17297-1019/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 ...

	* 

	* The control plane node "" does not exist.

	  To start a cluster, run: "minikube start -p download-only-677000"

-- /stdout --

aaa_download_only_test.go:170: minikube logs failed with error: exit status 85

--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.27s)

=== RUN   TestDownloadOnly/v1.28.2/json-events

aaa_download_only_test.go:69: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-677000 --force --alsologtostderr --kubernetes-version=v1.28.2 --container-runtime=docker --driver=hyperkit 

aaa_download_only_test.go:69: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-677000 --force --alsologtostderr --kubernetes-version=v1.28.2 --container-runtime=docker --driver=hyperkit : (7.488120824s)

--- PASS: TestDownloadOnly/v1.28.2/json-events (7.49s)

=== RUN   TestDownloadOnly/v1.28.2/preload-exists

--- PASS: TestDownloadOnly/v1.28.2/preload-exists (0.00s)

=== RUN   TestDownloadOnly/v1.28.2/kubectl

--- PASS: TestDownloadOnly/v1.28.2/kubectl (0.00s)

=== RUN   TestDownloadOnly/v1.28.2/LogsDuration

aaa_download_only_test.go:169: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-677000

aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-677000: exit status 85 (318.223566ms)

-- stdout --

	* 

	* ==> Audit <==

	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|

	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|

	| start   | -o=json --download-only        | download-only-677000 | jenkins | v1.31.2 | 25 Sep 23 03:32 PDT |          |

	|         | -p download-only-677000        |                      |         |         |                     |          |

	|         | --force --alsologtostderr      |                      |         |         |                     |          |

	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |

	|         | --container-runtime=docker     |                      |         |         |                     |          |

	|         | --driver=hyperkit              |                      |         |         |                     |          |

	| start   | -o=json --download-only        | download-only-677000 | jenkins | v1.31.2 | 25 Sep 23 03:33 PDT |          |

	|         | -p download-only-677000        |                      |         |         |                     |          |

	|         | --force --alsologtostderr      |                      |         |         |                     |          |

	|         | --kubernetes-version=v1.28.2   |                      |         |         |                     |          |

	|         | --container-runtime=docker     |                      |         |         |                     |          |

	|         | --driver=hyperkit              |                      |         |         |                     |          |

	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|

	* 

	* ==> Last Start <==

	* Log file created at: 2023/09/25 03:33:09

	Running on machine: MacOS-Agent-4

	Binary: Built with gc go1.21.1 for darwin/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0925 03:33:09.648798    1503 out.go:296] Setting OutFile to fd 1 ...

	I0925 03:33:09.649080    1503 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0925 03:33:09.649085    1503 out.go:309] Setting ErrFile to fd 2...

	I0925 03:33:09.649089    1503 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0925 03:33:09.649278    1503 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17297-1019/.minikube/bin

	W0925 03:33:09.649376    1503 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/17297-1019/.minikube/config/config.json: open /Users/jenkins/minikube-integration/17297-1019/.minikube/config/config.json: no such file or directory

	I0925 03:33:09.651058    1503 out.go:303] Setting JSON to true

	I0925 03:33:09.671853    1503 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":163,"bootTime":1695637826,"procs":383,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.6","kernelVersion":"22.6.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}

	W0925 03:33:09.671985    1503 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I0925 03:33:09.693442    1503 out.go:97] [download-only-677000] minikube v1.31.2 on Darwin 13.6

	I0925 03:33:09.714477    1503 out.go:169] MINIKUBE_LOCATION=17297

	I0925 03:33:09.693600    1503 notify.go:220] Checking for updates...

	I0925 03:33:09.756339    1503 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/17297-1019/kubeconfig

	I0925 03:33:09.777369    1503 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64

	I0925 03:33:09.798373    1503 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0925 03:33:09.819370    1503 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/17297-1019/.minikube

	W0925 03:33:09.861314    1503 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior

	I0925 03:33:09.861721    1503 config.go:182] Loaded profile config "download-only-677000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.16.0

	W0925 03:33:09.861766    1503 start.go:810] api.Load failed for download-only-677000: filestore "download-only-677000": Docker machine "download-only-677000" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	I0925 03:33:09.861839    1503 driver.go:373] Setting default libvirt URI to qemu:///system

	W0925 03:33:09.861859    1503 start.go:810] api.Load failed for download-only-677000: filestore "download-only-677000": Docker machine "download-only-677000" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	I0925 03:33:09.889301    1503 out.go:97] Using the hyperkit driver based on existing profile

	I0925 03:33:09.889330    1503 start.go:298] selected driver: hyperkit

	I0925 03:33:09.889336    1503 start.go:902] validating driver "hyperkit" against &{Name:download-only-677000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuber

netesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-677000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirro

r: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I0925 03:33:09.889537    1503 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0925 03:33:09.889660    1503 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17297-1019/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin

	I0925 03:33:09.896887    1503 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.31.2

	I0925 03:33:09.900397    1503 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 03:33:09.900423    1503 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good

	I0925 03:33:09.902839    1503 cni.go:84] Creating CNI manager for ""

	I0925 03:33:09.902862    1503 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge

	I0925 03:33:09.902879    1503 start_flags.go:321] config:

	{Name:download-only-677000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.2 ClusterName:download-only-677000 Namespace:

default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketV

MnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I0925 03:33:09.903016    1503 iso.go:125] acquiring lock: {Name:mk5685b8103aa0f952a2e44c47bdd1882fdd0bc3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0925 03:33:09.924342    1503 out.go:97] Starting control plane node download-only-677000 in cluster download-only-677000

	I0925 03:33:09.924362    1503 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I0925 03:33:09.978958    1503 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.2/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4

	I0925 03:33:09.978988    1503 cache.go:57] Caching tarball of preloaded images

	I0925 03:33:09.979337    1503 preload.go:132] Checking if preload exists for k8s version v1.28.2 and runtime docker

	I0925 03:33:10.000630    1503 out.go:97] Downloading Kubernetes v1.28.2 preload ...

	I0925 03:33:10.000645    1503 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4 ...

	I0925 03:33:10.097060    1503 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.2/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4?checksum=md5:30a5cb95ef165c1e9196502a3ab2be2b -> /Users/jenkins/minikube-integration/17297-1019/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.2-docker-overlay2-amd64.tar.lz4

	* 

	* The control plane node "" does not exist.

	  To start a cluster, run: "minikube start -p download-only-677000"

-- /stdout --

aaa_download_only_test.go:170: minikube logs failed with error: exit status 85

--- PASS: TestDownloadOnly/v1.28.2/LogsDuration (0.32s)

=== RUN   TestDownloadOnly/DeleteAll

aaa_download_only_test.go:187: (dbg) Run:  out/minikube-darwin-amd64 delete --all

--- PASS: TestDownloadOnly/DeleteAll (0.37s)

=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds

aaa_download_only_test.go:199: (dbg) Run:  out/minikube-darwin-amd64 delete -p download-only-677000

--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.35s)

=== RUN   TestBinaryMirror

aaa_download_only_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 start --download-only -p binary-mirror-589000 --alsologtostderr --binary-mirror http://127.0.0.1:49342 --driver=hyperkit 

helpers_test.go:175: Cleaning up "binary-mirror-589000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p binary-mirror-589000

--- PASS: TestBinaryMirror (1.00s)

=== RUN   TestOffline

=== PAUSE TestOffline

=== CONT  TestOffline

aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-amd64 start -p offline-docker-993000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit 

aab_offline_test.go:55: (dbg) Done: out/minikube-darwin-amd64 start -p offline-docker-993000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit : (50.727461264s)

helpers_test.go:175: Cleaning up "offline-docker-993000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p offline-docker-993000

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p offline-docker-993000: (5.252362852s)

--- PASS: TestOffline (55.98s)

=== RUN   TestAddons/Setup

addons_test.go:88: (dbg) Run:  out/minikube-darwin-amd64 start -p addons-313000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=hyperkit  --addons=ingress --addons=ingress-dns --addons=helm-tiller

addons_test.go:88: (dbg) Done: out/minikube-darwin-amd64 start -p addons-313000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=hyperkit  --addons=ingress --addons=ingress-dns --addons=helm-tiller: (2m24.760904699s)

--- PASS: TestAddons/Setup (144.76s)

=== RUN   TestAddons/parallel/Registry

=== PAUSE TestAddons/parallel/Registry

=== CONT  TestAddons/parallel/Registry

addons_test.go:306: registry stabilized in 9.021245ms

addons_test.go:308: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...

helpers_test.go:344: "registry-nghpj" [382be575-2b8c-4ca2-8d87-33f1b3dc0433] Running

addons_test.go:308: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.010169449s

addons_test.go:311: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...

helpers_test.go:344: "registry-proxy-sg4nk" [72ae8b32-ea94-4c9f-82e4-6ad64e183600] Running

addons_test.go:311: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.011006882s

addons_test.go:316: (dbg) Run:  kubectl --context addons-313000 delete po -l run=registry-test --now

addons_test.go:321: (dbg) Run:  kubectl --context addons-313000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"

addons_test.go:321: (dbg) Done: kubectl --context addons-313000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (4.066814918s)

addons_test.go:335: (dbg) Run:  out/minikube-darwin-amd64 -p addons-313000 ip

2023/09/25 03:35:58 [DEBUG] GET http://192.168.64.2:5000

addons_test.go:364: (dbg) Run:  out/minikube-darwin-amd64 -p addons-313000 addons disable registry --alsologtostderr -v=1

--- PASS: TestAddons/parallel/Registry (14.75s)

=== RUN   TestAddons/parallel/Ingress

=== PAUSE TestAddons/parallel/Ingress

=== CONT  TestAddons/parallel/Ingress

addons_test.go:183: (dbg) Run:  kubectl --context addons-313000 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s

addons_test.go:208: (dbg) Run:  kubectl --context addons-313000 replace --force -f testdata/nginx-ingress-v1.yaml

addons_test.go:221: (dbg) Run:  kubectl --context addons-313000 replace --force -f testdata/nginx-pod-svc.yaml

addons_test.go:226: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...

helpers_test.go:344: "nginx" [f7b6f7ed-92dc-4a45-ada7-e7b721658411] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

helpers_test.go:344: "nginx" [f7b6f7ed-92dc-4a45-ada7-e7b721658411] Running

addons_test.go:226: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 11.009563472s

addons_test.go:238: (dbg) Run:  out/minikube-darwin-amd64 -p addons-313000 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"

addons_test.go:262: (dbg) Run:  kubectl --context addons-313000 replace --force -f testdata/ingress-dns-example-v1.yaml

addons_test.go:267: (dbg) Run:  out/minikube-darwin-amd64 -p addons-313000 ip

addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.64.2

addons_test.go:282: (dbg) Run:  out/minikube-darwin-amd64 -p addons-313000 addons disable ingress-dns --alsologtostderr -v=1

addons_test.go:287: (dbg) Run:  out/minikube-darwin-amd64 -p addons-313000 addons disable ingress --alsologtostderr -v=1

addons_test.go:287: (dbg) Done: out/minikube-darwin-amd64 -p addons-313000 addons disable ingress --alsologtostderr -v=1: (7.482218266s)

--- PASS: TestAddons/parallel/Ingress (20.48s)

=== RUN   TestAddons/parallel/InspektorGadget

=== PAUSE TestAddons/parallel/InspektorGadget

=== CONT  TestAddons/parallel/InspektorGadget

addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...

helpers_test.go:344: "gadget-jc46l" [14ecde39-54be-4e4a-b3af-1b234c7b3ae6] Running

addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.010081491s

addons_test.go:817: (dbg) Run:  out/minikube-darwin-amd64 addons disable inspektor-gadget -p addons-313000

addons_test.go:817: (dbg) Done: out/minikube-darwin-amd64 addons disable inspektor-gadget -p addons-313000: (5.493405714s)

--- PASS: TestAddons/parallel/InspektorGadget (10.50s)

=== RUN   TestAddons/parallel/MetricsServer

=== PAUSE TestAddons/parallel/MetricsServer

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:383: metrics-server stabilized in 5.172986ms

addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...

helpers_test.go:344: "metrics-server-7c66d45ddc-zljjh" [304edefd-76f4-457e-8ec2-38aee2972634] Running

addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.011160361s

addons_test.go:391: (dbg) Run:  kubectl --context addons-313000 top pods -n kube-system

addons_test.go:408: (dbg) Run:  out/minikube-darwin-amd64 -p addons-313000 addons disable metrics-server --alsologtostderr -v=1

--- PASS: TestAddons/parallel/MetricsServer (5.53s)

=== RUN   TestAddons/parallel/HelmTiller

=== PAUSE TestAddons/parallel/HelmTiller

=== CONT  TestAddons/parallel/HelmTiller

addons_test.go:432: tiller-deploy stabilized in 2.834047ms

addons_test.go:434: (dbg) TestAddons/parallel/HelmTiller: waiting 6m0s for pods matching "app=helm" in namespace "kube-system" ...

helpers_test.go:344: "tiller-deploy-7b677967b9-5mjdm" [a2a4d2e9-63ba-4d8e-8277-e9801c388df0] Running

addons_test.go:434: (dbg) TestAddons/parallel/HelmTiller: app=helm healthy within 5.01091265s

addons_test.go:449: (dbg) Run:  kubectl --context addons-313000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version

addons_test.go:449: (dbg) Done: kubectl --context addons-313000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version: (6.800673867s)

addons_test.go:454: kubectl --context addons-313000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version: unexpected stderr: Unable to use a TTY - input is not a terminal or the right kind of file

If you don't see a command prompt, try pressing enter.

warning: couldn't attach to pod/helm-test, falling back to streaming logs: 

addons_test.go:449: (dbg) Run:  kubectl --context addons-313000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version

addons_test.go:449: (dbg) Done: kubectl --context addons-313000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version: (2.874351366s)

addons_test.go:466: (dbg) Run:  out/minikube-darwin-amd64 -p addons-313000 addons disable helm-tiller --alsologtostderr -v=1

--- PASS: TestAddons/parallel/HelmTiller (15.42s)

=== RUN   TestAddons/parallel/CSI

=== PAUSE TestAddons/parallel/CSI

=== CONT  TestAddons/parallel/CSI

addons_test.go:537: csi-hostpath-driver pods stabilized in 4.493989ms

addons_test.go:540: (dbg) Run:  kubectl --context addons-313000 create -f testdata/csi-hostpath-driver/pvc.yaml

addons_test.go:545: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc -o jsonpath={.status.phase} -n default

addons_test.go:550: (dbg) Run:  kubectl --context addons-313000 create -f testdata/csi-hostpath-driver/pv-pod.yaml

addons_test.go:555: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...

helpers_test.go:344: "task-pv-pod" [f1c2c785-1d51-40c8-bd17-6bd68db51cce] Pending

helpers_test.go:344: "task-pv-pod" [f1c2c785-1d51-40c8-bd17-6bd68db51cce] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

helpers_test.go:344: "task-pv-pod" [f1c2c785-1d51-40c8-bd17-6bd68db51cce] Running

addons_test.go:555: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 14.01274089s

addons_test.go:560: (dbg) Run:  kubectl --context addons-313000 create -f testdata/csi-hostpath-driver/snapshot.yaml

addons_test.go:565: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...

helpers_test.go:419: (dbg) Run:  kubectl --context addons-313000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default

helpers_test.go:419: (dbg) Run:  kubectl --context addons-313000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default

helpers_test.go:419: (dbg) Run:  kubectl --context addons-313000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default

addons_test.go:570: (dbg) Run:  kubectl --context addons-313000 delete pod task-pv-pod

addons_test.go:576: (dbg) Run:  kubectl --context addons-313000 delete pvc hpvc

addons_test.go:582: (dbg) Run:  kubectl --context addons-313000 create -f testdata/csi-hostpath-driver/pvc-restore.yaml

addons_test.go:587: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-313000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

addons_test.go:592: (dbg) Run:  kubectl --context addons-313000 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml

addons_test.go:597: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...

helpers_test.go:344: "task-pv-pod-restore" [9e0e73e9-d01f-4f59-9935-72d4b3900b1e] Pending

helpers_test.go:344: "task-pv-pod-restore" [9e0e73e9-d01f-4f59-9935-72d4b3900b1e] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

helpers_test.go:344: "task-pv-pod-restore" [9e0e73e9-d01f-4f59-9935-72d4b3900b1e] Running

addons_test.go:597: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 9.012577179s

addons_test.go:602: (dbg) Run:  kubectl --context addons-313000 delete pod task-pv-pod-restore

addons_test.go:606: (dbg) Run:  kubectl --context addons-313000 delete pvc hpvc-restore

addons_test.go:610: (dbg) Run:  kubectl --context addons-313000 delete volumesnapshot new-snapshot-demo

addons_test.go:614: (dbg) Run:  out/minikube-darwin-amd64 -p addons-313000 addons disable csi-hostpath-driver --alsologtostderr -v=1

addons_test.go:614: (dbg) Done: out/minikube-darwin-amd64 -p addons-313000 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.393282674s)

addons_test.go:618: (dbg) Run:  out/minikube-darwin-amd64 -p addons-313000 addons disable volumesnapshots --alsologtostderr -v=1

--- PASS: TestAddons/parallel/CSI (60.41s)

=== RUN   TestAddons/parallel/Headlamp

=== PAUSE TestAddons/parallel/Headlamp

=== CONT  TestAddons/parallel/Headlamp

addons_test.go:800: (dbg) Run:  out/minikube-darwin-amd64 addons enable headlamp -p addons-313000 --alsologtostderr -v=1

addons_test.go:800: (dbg) Done: out/minikube-darwin-amd64 addons enable headlamp -p addons-313000 --alsologtostderr -v=1: (1.175902363s)

addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...

helpers_test.go:344: "headlamp-58b88cff49-s8bql" [11844e35-df88-49e9-9b04-c4a4b43540fa] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])

helpers_test.go:344: "headlamp-58b88cff49-s8bql" [11844e35-df88-49e9-9b04-c4a4b43540fa] Running

addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 12.009675692s

--- PASS: TestAddons/parallel/Headlamp (13.19s)

=== RUN   TestAddons/parallel/CloudSpanner

=== PAUSE TestAddons/parallel/CloudSpanner

=== CONT  TestAddons/parallel/CloudSpanner

addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...

helpers_test.go:344: "cloud-spanner-emulator-7d49f968d9-7kb5j" [6aecbc62-d22c-49e8-b820-30a566234336] Running

addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.008807268s

addons_test.go:836: (dbg) Run:  out/minikube-darwin-amd64 addons disable cloud-spanner -p addons-313000

--- PASS: TestAddons/parallel/CloudSpanner (5.43s)

=== RUN   TestAddons/serial/GCPAuth/Namespaces

addons_test.go:626: (dbg) Run:  kubectl --context addons-313000 create ns new-namespace

addons_test.go:640: (dbg) Run:  kubectl --context addons-313000 get secret gcp-auth -n new-namespace

--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.09s)

=== RUN   TestAddons/StoppedEnableDisable

addons_test.go:148: (dbg) Run:  out/minikube-darwin-amd64 stop -p addons-313000

addons_test.go:148: (dbg) Done: out/minikube-darwin-amd64 stop -p addons-313000: (5.216889233s)

addons_test.go:152: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p addons-313000

addons_test.go:156: (dbg) Run:  out/minikube-darwin-amd64 addons disable dashboard -p addons-313000

addons_test.go:161: (dbg) Run:  out/minikube-darwin-amd64 addons disable gvisor -p addons-313000

--- PASS: TestAddons/StoppedEnableDisable (5.69s)

=== RUN   TestCertOptions

=== PAUSE TestCertOptions

=== CONT  TestCertOptions

cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-options-162000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit 

cert_options_test.go:49: (dbg) Done: out/minikube-darwin-amd64 start -p cert-options-162000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit : (34.108963933s)

cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-amd64 -p cert-options-162000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"

cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-162000 config view

cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-amd64 ssh -p cert-options-162000 -- "sudo cat /etc/kubernetes/admin.conf"

helpers_test.go:175: Cleaning up "cert-options-162000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-options-162000

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p cert-options-162000: (3.440967252s)

--- PASS: TestCertOptions (37.85s)

=== RUN   TestCertExpiration

=== PAUSE TestCertExpiration

=== CONT  TestCertExpiration

cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-130000 --memory=2048 --cert-expiration=3m --driver=hyperkit 

cert_options_test.go:123: (dbg) Done: out/minikube-darwin-amd64 start -p cert-expiration-130000 --memory=2048 --cert-expiration=3m --driver=hyperkit : (34.483179282s)

cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-130000 --memory=2048 --cert-expiration=8760h --driver=hyperkit 

E0925 04:07:17.624209    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/skaffold-238000/client.crt: no such file or directory

cert_options_test.go:131: (dbg) Done: out/minikube-darwin-amd64 start -p cert-expiration-130000 --memory=2048 --cert-expiration=8760h --driver=hyperkit : (22.478975602s)

helpers_test.go:175: Cleaning up "cert-expiration-130000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-expiration-130000

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p cert-expiration-130000: (5.245036906s)

--- PASS: TestCertExpiration (242.21s)

=== RUN   TestDockerFlags

=== PAUSE TestDockerFlags

=== CONT  TestDockerFlags

docker_test.go:51: (dbg) Run:  out/minikube-darwin-amd64 start -p docker-flags-258000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit 

docker_test.go:51: (dbg) Done: out/minikube-darwin-amd64 start -p docker-flags-258000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit : (36.190221887s)

docker_test.go:56: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-258000 ssh "sudo systemctl show docker --property=Environment --no-pager"

docker_test.go:67: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-258000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"

helpers_test.go:175: Cleaning up "docker-flags-258000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p docker-flags-258000

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p docker-flags-258000: (3.471388789s)

--- PASS: TestDockerFlags (39.97s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:91: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-flag-105000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit 

docker_test.go:91: (dbg) Done: out/minikube-darwin-amd64 start -p force-systemd-flag-105000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit : (33.079573277s)

docker_test.go:110: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-flag-105000 ssh "docker info --format {{.CgroupDriver}}"

helpers_test.go:175: Cleaning up "force-systemd-flag-105000" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-flag-105000

helpers_test.go:178: (dbg) Done: out/minikube-darwin-amd64 delete -p force-systemd-flag-105000: (3.431920268s)

--- PASS: TestForceSystemdFlag (36.67s)

=== RUN   TestHyperKitDriverInstallOrUpdate

=== PAUSE TestHyperKitDriverInstallOrUpdate

=== CONT  TestHyperKitDriverInstallOrUpdate

--- PASS: TestHyperKitDriverInstallOrUpdate (6.72s)

=== RUN   TestErrorSpam/setup

error_spam_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -p nospam-428000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 --driver=hyperkit 

error_spam_test.go:81: (dbg) Done: out/minikube-darwin-amd64 start -p nospam-428000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 --driver=hyperkit : (32.997226866s)

--- PASS: TestErrorSpam/setup (33.00s)

=== RUN   TestErrorSpam/start

error_spam_test.go:216: Cleaning up 1 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 start --dry-run

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 start --dry-run

error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 start --dry-run

--- PASS: TestErrorSpam/start (1.43s)

=== RUN   TestErrorSpam/status

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 status

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 status

error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 status

--- PASS: TestErrorSpam/status (0.44s)

=== RUN   TestErrorSpam/pause

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 pause

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 pause

error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 pause

--- PASS: TestErrorSpam/pause (1.24s)

=== RUN   TestErrorSpam/unpause

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 unpause

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 unpause

error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 unpause

--- PASS: TestErrorSpam/unpause (1.26s)

=== RUN   TestErrorSpam/stop

error_spam_test.go:216: Cleaning up 0 logfile(s) ...

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 stop

error_spam_test.go:159: (dbg) Done: out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 stop: (3.222628774s)

error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 stop

error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-428000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-428000 stop

--- PASS: TestErrorSpam/stop (3.65s)

=== RUN   TestFunctional/serial/CopySyncFile

functional_test.go:1851: local sync path: /Users/jenkins/minikube-integration/17297-1019/.minikube/files/etc/test/nested/copy/1487/hosts

--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

=== RUN   TestFunctional/serial/StartWithProxy

functional_test.go:2230: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-220000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit 

functional_test.go:2230: (dbg) Done: out/minikube-darwin-amd64 start -p functional-220000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit : (50.423298949s)

--- PASS: TestFunctional/serial/StartWithProxy (50.42s)

=== RUN   TestFunctional/serial/AuditLog

--- PASS: TestFunctional/serial/AuditLog (0.00s)

=== RUN   TestFunctional/serial/SoftStart

functional_test.go:655: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-220000 --alsologtostderr -v=8

functional_test.go:655: (dbg) Done: out/minikube-darwin-amd64 start -p functional-220000 --alsologtostderr -v=8: (39.603539682s)

functional_test.go:659: soft start took 39.604156159s for "functional-220000" cluster.

--- PASS: TestFunctional/serial/SoftStart (39.60s)

=== RUN   TestFunctional/serial/KubeContext

functional_test.go:677: (dbg) Run:  kubectl config current-context

--- PASS: TestFunctional/serial/KubeContext (0.03s)

=== RUN   TestFunctional/serial/KubectlGetPods

functional_test.go:692: (dbg) Run:  kubectl --context functional-220000 get po -A

--- PASS: TestFunctional/serial/KubectlGetPods (0.05s)

=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote

functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 cache add registry.k8s.io/pause:3.1

functional_test.go:1045: (dbg) Done: out/minikube-darwin-amd64 -p functional-220000 cache add registry.k8s.io/pause:3.1: (1.528594407s)

functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 cache add registry.k8s.io/pause:3.3

functional_test.go:1045: (dbg) Done: out/minikube-darwin-amd64 -p functional-220000 cache add registry.k8s.io/pause:3.3: (1.399868276s)

functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 cache add registry.k8s.io/pause:latest

functional_test.go:1045: (dbg) Done: out/minikube-darwin-amd64 -p functional-220000 cache add registry.k8s.io/pause:latest: (1.36846267s)

--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (4.30s)

=== RUN   TestFunctional/serial/CacheCmd/cache/add_local

functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-220000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalserialCacheCmdcacheadd_local647564415/001

functional_test.go:1085: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 cache add minikube-local-cache-test:functional-220000

functional_test.go:1090: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 cache delete minikube-local-cache-test:functional-220000

functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-220000

--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.57s)

=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete

functional_test.go:1098: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:3.3

--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

=== RUN   TestFunctional/serial/CacheCmd/cache/list

functional_test.go:1106: (dbg) Run:  out/minikube-darwin-amd64 cache list

--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)

=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node

functional_test.go:1120: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 ssh sudo crictl images

--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.16s)

=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload

functional_test.go:1143: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 ssh sudo docker rmi registry.k8s.io/pause:latest

functional_test.go:1149: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 ssh sudo crictl inspecti registry.k8s.io/pause:latest

functional_test.go:1149: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-220000 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (130.948434ms)

-- stdout --

	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

-- /stdout --

** stderr ** 

	ssh: Process exited with status 1

** /stderr **

functional_test.go:1154: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 cache reload

functional_test.go:1159: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 ssh sudo crictl inspecti registry.k8s.io/pause:latest

--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (1.34s)

=== RUN   TestFunctional/serial/CacheCmd/cache/delete

functional_test.go:1168: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:3.1

functional_test.go:1168: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:latest

--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.13s)

=== RUN   TestFunctional/serial/MinikubeKubectlCmd

functional_test.go:712: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 kubectl -- --context functional-220000 get pods

--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.54s)

=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly

functional_test.go:737: (dbg) Run:  out/kubectl --context functional-220000 get pods

--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.73s)

=== RUN   TestFunctional/serial/ExtraConfig

functional_test.go:753: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-220000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all

E0925 03:40:44.247208    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/addons-313000/client.crt: no such file or directory

E0925 03:40:44.253850    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/addons-313000/client.crt: no such file or directory

E0925 03:40:44.264677    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/addons-313000/client.crt: no such file or directory

E0925 03:40:44.284817    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/addons-313000/client.crt: no such file or directory

E0925 03:40:44.326412    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/addons-313000/client.crt: no such file or directory

E0925 03:40:44.407434    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/addons-313000/client.crt: no such file or directory

E0925 03:40:44.567660    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/addons-313000/client.crt: no such file or directory

E0925 03:40:44.889061    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/addons-313000/client.crt: no such file or directory

E0925 03:40:45.529619    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/addons-313000/client.crt: no such file or directory

E0925 03:40:46.810790    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/addons-313000/client.crt: no such file or directory

functional_test.go:753: (dbg) Done: out/minikube-darwin-amd64 start -p functional-220000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (39.304988484s)

functional_test.go:757: restart took 39.305160795s for "functional-220000" cluster.

--- PASS: TestFunctional/serial/ExtraConfig (39.31s)

=== RUN   TestFunctional/serial/ComponentHealth

functional_test.go:806: (dbg) Run:  kubectl --context functional-220000 get po -l tier=control-plane -n kube-system -o=json

functional_test.go:821: etcd phase: Running

functional_test.go:831: etcd status: Ready

functional_test.go:821: kube-apiserver phase: Running

functional_test.go:831: kube-apiserver status: Ready

functional_test.go:821: kube-controller-manager phase: Running

functional_test.go:831: kube-controller-manager status: Ready

functional_test.go:821: kube-scheduler phase: Running

functional_test.go:831: kube-scheduler status: Ready

--- PASS: TestFunctional/serial/ComponentHealth (0.05s)

=== RUN   TestFunctional/serial/LogsCmd

functional_test.go:1232: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 logs

E0925 03:40:49.371253    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/addons-313000/client.crt: no such file or directory

functional_test.go:1232: (dbg) Done: out/minikube-darwin-amd64 -p functional-220000 logs: (2.708696069s)

--- PASS: TestFunctional/serial/LogsCmd (2.71s)

=== RUN   TestFunctional/serial/LogsFileCmd

functional_test.go:1246: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 logs --file /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalserialLogsFileCmd3803194061/001/logs.txt

functional_test.go:1246: (dbg) Done: out/minikube-darwin-amd64 -p functional-220000 logs --file /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalserialLogsFileCmd3803194061/001/logs.txt: (2.653883191s)

--- PASS: TestFunctional/serial/LogsFileCmd (2.67s)

=== RUN   TestFunctional/serial/InvalidService

functional_test.go:2317: (dbg) Run:  kubectl --context functional-220000 apply -f testdata/invalidsvc.yaml

E0925 03:40:54.521906    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/addons-313000/client.crt: no such file or directory

functional_test.go:2331: (dbg) Run:  out/minikube-darwin-amd64 service invalid-svc -p functional-220000

functional_test.go:2331: (dbg) Non-zero exit: out/minikube-darwin-amd64 service invalid-svc -p functional-220000: exit status 115 (245.546483ms)

-- stdout --

	|-----------|-------------|-------------|---------------------------|

	| NAMESPACE |    NAME     | TARGET PORT |            URL            |

	|-----------|-------------|-------------|---------------------------|

	| default   | invalid-svc |          80 | http://192.168.64.4:30907 |

	|-----------|-------------|-------------|---------------------------|

-- /stdout --

** stderr ** 

	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found

	* 

	╭────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                            │

	│    * If the above advice does not help, please let us know:                                                                │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                              │

	│                                                                                                                            │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                   │

	│    * Please also attach the following file to the GitHub issue:                                                            │

	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log    │

	│                                                                                                                            │

	╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

functional_test.go:2323: (dbg) Run:  kubectl --context functional-220000 delete -f testdata/invalidsvc.yaml

--- PASS: TestFunctional/serial/InvalidService (4.07s)

=== RUN   TestFunctional/parallel/ConfigCmd

=== PAUSE TestFunctional/parallel/ConfigCmd

=== CONT  TestFunctional/parallel/ConfigCmd

functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 config unset cpus

functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 config get cpus

functional_test.go:1195: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-220000 config get cpus: exit status 14 (41.057688ms)

** stderr ** 

	Error: specified key could not be found in config

** /stderr **

functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 config set cpus 2

functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 config get cpus

functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 config unset cpus

functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 config get cpus

functional_test.go:1195: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-220000 config get cpus: exit status 14 (65.520188ms)

** stderr ** 

	Error: specified key could not be found in config

** /stderr **

--- PASS: TestFunctional/parallel/ConfigCmd (0.48s)

=== RUN   TestFunctional/parallel/DashboardCmd

=== PAUSE TestFunctional/parallel/DashboardCmd

=== CONT  TestFunctional/parallel/DashboardCmd

functional_test.go:901: (dbg) daemon: [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-220000 --alsologtostderr -v=1]

functional_test.go:906: (dbg) stopping [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-220000 --alsologtostderr -v=1] ...

helpers_test.go:508: unable to kill pid 3061: os: process already finished

--- PASS: TestFunctional/parallel/DashboardCmd (14.73s)

=== RUN   TestFunctional/parallel/DryRun

=== PAUSE TestFunctional/parallel/DryRun

=== CONT  TestFunctional/parallel/DryRun

functional_test.go:970: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-220000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit 

functional_test.go:970: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-220000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit : exit status 23 (661.417122ms)

-- stdout --

	* [functional-220000] minikube v1.31.2 on Darwin 13.6

	  - MINIKUBE_LOCATION=17297

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17297-1019/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17297-1019/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the hyperkit driver based on existing profile

-- /stdout --

** stderr ** 

	I0925 03:42:01.671575    3007 out.go:296] Setting OutFile to fd 1 ...

	I0925 03:42:01.671815    3007 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0925 03:42:01.671820    3007 out.go:309] Setting ErrFile to fd 2...

	I0925 03:42:01.671824    3007 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0925 03:42:01.672002    3007 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17297-1019/.minikube/bin

	I0925 03:42:01.673424    3007 out.go:303] Setting JSON to false

	I0925 03:42:01.693659    3007 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":695,"bootTime":1695637826,"procs":504,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.6","kernelVersion":"22.6.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}

	W0925 03:42:01.693764    3007 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I0925 03:42:01.760291    3007 out.go:177] * [functional-220000] minikube v1.31.2 on Darwin 13.6

	I0925 03:42:01.818418    3007 out.go:177]   - MINIKUBE_LOCATION=17297

	I0925 03:42:01.781597    3007 notify.go:220] Checking for updates...

	I0925 03:42:01.876492    3007 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17297-1019/kubeconfig

	I0925 03:42:01.918442    3007 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0925 03:42:01.960325    3007 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0925 03:42:02.002446    3007 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17297-1019/.minikube

	I0925 03:42:02.044133    3007 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0925 03:42:02.065912    3007 config.go:182] Loaded profile config "functional-220000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I0925 03:42:02.066386    3007 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 03:42:02.066443    3007 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 03:42:02.073798    3007 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50466

	I0925 03:42:02.074181    3007 main.go:141] libmachine: () Calling .GetVersion

	I0925 03:42:02.074609    3007 main.go:141] libmachine: Using API Version  1

	I0925 03:42:02.074627    3007 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 03:42:02.074895    3007 main.go:141] libmachine: () Calling .GetMachineName

	I0925 03:42:02.075039    3007 main.go:141] libmachine: (functional-220000) Calling .DriverName

	I0925 03:42:02.075247    3007 driver.go:373] Setting default libvirt URI to qemu:///system

	I0925 03:42:02.075507    3007 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 03:42:02.075532    3007 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 03:42:02.082726    3007 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50470

	I0925 03:42:02.083092    3007 main.go:141] libmachine: () Calling .GetVersion

	I0925 03:42:02.083468    3007 main.go:141] libmachine: Using API Version  1

	I0925 03:42:02.083487    3007 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 03:42:02.083699    3007 main.go:141] libmachine: () Calling .GetMachineName

	I0925 03:42:02.083795    3007 main.go:141] libmachine: (functional-220000) Calling .DriverName

	I0925 03:42:02.111361    3007 out.go:177] * Using the hyperkit driver based on existing profile

	I0925 03:42:02.153304    3007 start.go:298] selected driver: hyperkit

	I0925 03:42:02.153318    3007 start.go:902] validating driver "hyperkit" against &{Name:functional-220000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet

esConfig:{KubernetesVersion:v1.28.2 ClusterName:functional-220000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.64.4 Port:8441 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDis

ks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I0925 03:42:02.153422    3007 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0925 03:42:02.193692    3007 out.go:177] 

	W0925 03:42:02.230501    3007 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB

	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB

	I0925 03:42:02.251474    3007 out.go:177] 

** /stderr **

functional_test.go:987: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-220000 --dry-run --alsologtostderr -v=1 --driver=hyperkit 

--- PASS: TestFunctional/parallel/DryRun (1.23s)

=== RUN   TestFunctional/parallel/InternationalLanguage

=== PAUSE TestFunctional/parallel/InternationalLanguage

=== CONT  TestFunctional/parallel/InternationalLanguage

functional_test.go:1016: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-220000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit 

functional_test.go:1016: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-220000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit : exit status 23 (718.599505ms)

-- stdout --

	* [functional-220000] minikube v1.31.2 sur Darwin 13.6

	  - MINIKUBE_LOCATION=17297

	  - KUBECONFIG=/Users/jenkins/minikube-integration/17297-1019/kubeconfig

	  - MINIKUBE_BIN=out/minikube-darwin-amd64

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17297-1019/.minikube

	  - MINIKUBE_FORCE_SYSTEMD=

	* Utilisation du pilote hyperkit basé sur le profil existant

-- /stdout --

** stderr ** 

	I0925 03:41:50.596686    2861 out.go:296] Setting OutFile to fd 1 ...

	I0925 03:41:50.596923    2861 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0925 03:41:50.596927    2861 out.go:309] Setting ErrFile to fd 2...

	I0925 03:41:50.596931    2861 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0925 03:41:50.597094    2861 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17297-1019/.minikube/bin

	I0925 03:41:50.598618    2861 out.go:303] Setting JSON to false

	I0925 03:41:50.618701    2861 start.go:128] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":684,"bootTime":1695637826,"procs":440,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.6","kernelVersion":"22.6.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}

	W0925 03:41:50.618807    2861 start.go:136] gopshost.Virtualization returned error: not implemented yet

	I0925 03:41:50.642812    2861 out.go:177] * [functional-220000] minikube v1.31.2 sur Darwin 13.6

	I0925 03:41:50.705830    2861 out.go:177]   - MINIKUBE_LOCATION=17297

	I0925 03:41:50.684846    2861 notify.go:220] Checking for updates...

	I0925 03:41:50.764731    2861 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17297-1019/kubeconfig

	I0925 03:41:50.838868    2861 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64

	I0925 03:41:50.880993    2861 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0925 03:41:50.954882    2861 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17297-1019/.minikube

	I0925 03:41:51.012690    2861 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0925 03:41:51.050725    2861 config.go:182] Loaded profile config "functional-220000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.2

	I0925 03:41:51.051431    2861 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 03:41:51.051515    2861 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 03:41:51.059370    2861 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50269

	I0925 03:41:51.059728    2861 main.go:141] libmachine: () Calling .GetVersion

	I0925 03:41:51.060169    2861 main.go:141] libmachine: Using API Version  1

	I0925 03:41:51.060180    2861 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 03:41:51.060391    2861 main.go:141] libmachine: () Calling .GetMachineName

	I0925 03:41:51.060494    2861 main.go:141] libmachine: (functional-220000) Calling .DriverName

	I0925 03:41:51.060675    2861 driver.go:373] Setting default libvirt URI to qemu:///system

	I0925 03:41:51.060916    2861 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit

	I0925 03:41:51.060940    2861 main.go:141] libmachine: Launching plugin server for driver hyperkit

	I0925 03:41:51.067985    2861 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50271

	I0925 03:41:51.068334    2861 main.go:141] libmachine: () Calling .GetVersion

	I0925 03:41:51.068710    2861 main.go:141] libmachine: Using API Version  1

	I0925 03:41:51.068727    2861 main.go:141] libmachine: () Calling .SetConfigRaw

	I0925 03:41:51.068939    2861 main.go:141] libmachine: () Calling .GetMachineName

	I0925 03:41:51.069047    2861 main.go:141] libmachine: (functional-220000) Calling .DriverName

	I0925 03:41:51.098534    2861 out.go:177] * Utilisation du pilote hyperkit basé sur le profil existant

	I0925 03:41:51.140760    2861 start.go:298] selected driver: hyperkit

	I0925 03:41:51.140776    2861 start.go:902] validating driver "hyperkit" against &{Name:functional-220000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17240/minikube-v1.31.0-1695060926-17240-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1694798187-17250@sha256:8d9a070cda8e1b1082ed355bde1aaf66fbf63d64fa6e9f553f449efc74157fe3 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet

esConfig:{KubernetesVersion:v1.28.2 ClusterName:functional-220000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.64.4 Port:8441 KubernetesVersion:v1.28.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDis

ks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}

	I0925 03:41:51.140870    2861 start.go:913] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0925 03:41:51.180579    2861 out.go:177] 

	W0925 03:41:51.218009    2861 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo

	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo

	I0925 03:41:51.239579    2861 out.go:177] 

** /stderr **

--- PASS: TestFunctional/parallel/InternationalLanguage (0.72s)

=== RUN   TestFunctional/parallel/StatusCmd

=== PAUSE TestFunctional/parallel/StatusCmd

=== CONT  TestFunctional/parallel/StatusCmd

functional_test.go:850: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 status

functional_test.go:856: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}

functional_test.go:868: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 status -o json

--- PASS: TestFunctional/parallel/StatusCmd (0.47s)

=== RUN   TestFunctional/parallel/ServiceCmdConnect

=== PAUSE TestFunctional/parallel/ServiceCmdConnect

=== CONT  TestFunctional/parallel/ServiceCmdConnect

functional_test.go:1628: (dbg) Run:  kubectl --context functional-220000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8

functional_test.go:1634: (dbg) Run:  kubectl --context functional-220000 expose deployment hello-node-connect --type=NodePort --port=8080

functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...

helpers_test.go:344: "hello-node-connect-55497b8b78-bk26m" [79f9ba91-6723-4274-bede-23e9f8596ed8] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver])

helpers_test.go:344: "hello-node-connect-55497b8b78-bk26m" [79f9ba91-6723-4274-bede-23e9f8596ed8] Running

functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 11.010568335s

functional_test.go:1648: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 service hello-node-connect --url

functional_test.go:1654: found endpoint for hello-node-connect: http://192.168.64.4:30432

functional_test.go:1674: http://192.168.64.4:30432: success! body:

Hostname: hello-node-connect-55497b8b78-bk26m

Pod Information:

	-no pod information available-

Server values:

	server_version=nginx: 1.13.3 - lua: 10008

Request Information:

	client_address=10.244.0.1

	method=GET

	real path=/

	query=

	request_version=1.1

	request_uri=http://192.168.64.4:8080/

Request Headers:

	accept-encoding=gzip

	host=192.168.64.4:30432

	user-agent=Go-http-client/1.1

Request Body:

	-no body in request-

--- PASS: TestFunctional/parallel/ServiceCmdConnect (11.35s)

=== RUN   TestFunctional/parallel/AddonsCmd

=== PAUSE TestFunctional/parallel/AddonsCmd

=== CONT  TestFunctional/parallel/AddonsCmd

functional_test.go:1689: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 addons list

functional_test.go:1701: (dbg) Run:  out/minikube-darwin-amd64 -p functional-220000 addons list -o json

--- PASS: TestFunctional/parallel/AddonsCmd (0.21s)

=== RUN   TestFunctional/parallel/PersistentVolumeClaim

=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...

helpers_test.go:344: "storage-provisioner" [e18d8dfb-b797-408e-9ccd-8fd287c98c32] Running

functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.057293897s

functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-220000 get storageclass -o=json

functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-220000 apply -f testdata/storage-provisioner/pvc.yaml

functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-220000 get pvc myclaim -o=json

functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-220000 apply -f testdata/storage-provisioner/pod.yaml

functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...

helpers_test.go:344: "sp-pod" [cd8b9a16-36b7-4b8b-9c73-0a3796ed6ef9] Pending

helpers_test.go:344: "sp-pod" [cd8b9a16-36b7-4b8b-9c73-0a3796ed6ef9] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])

E0925 03:41:25.243570    1487 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17297-1019/.minikube/profiles/addons-313000/client.crt: no such file or directory

helpers_test.go:344: "sp-pod" [cd8b9a16-36b7-4b8b-9c73-0a3796ed6ef9] Running

functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 20.009789718s

functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-220000 exec sp-pod -- touch /tmp/mount/foo

functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-220000 delete -f testdata/storage-provisioner/pod.yaml

functional_test_pvc_test.go:106: (dbg) Done: kubectl --context functional-220000 delete -f testdata/storage-provisioner/pod.yaml: (1.335980693s)

functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-220000 apply -f testdata/storage-provisioner/pod.yaml

functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...

helpers_test.go:344: "sp-pod" [98adff32-9a39-43b9-b2dd-a7a3d159d313] Pending

helpers_test.go:344: "sp-pod" [98adff32-9a39-43b9-b2dd-a7a3d159d313] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])

helpers_test.go:344: "sp-pod" [98adff32-9a39-43b9-b2dd-a7a3d159d313] Running

functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 7.011088257s

functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-220000 exec sp-pod -- ls /tmp/mount

--- PASS: TestFunctional/parallel/PersistentVolumeClaim (34.09s)