=== RUN TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run: out/minikube-darwin-arm64 start -p functional-942000 --alsologtostderr -v=8
functional_test.go:655: (dbg) Non-zero exit: out/minikube-darwin-arm64 start -p functional-942000 --alsologtostderr -v=8: exit status 90 (2m0.091568333s)
-- stdout --
* [functional-942000] minikube v1.31.2 on Darwin 13.5.2 (arm64)
- MINIKUBE_LOCATION=17225
- KUBECONFIG=/Users/jenkins/minikube-integration/17225-951/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-arm64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/17225-951/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the qemu2 driver based on existing profile
* Starting control plane node functional-942000 in cluster functional-942000
* Updating the running qemu2 "functional-942000" VM ...
-- /stdout --
** stderr **
I0911 03:36:30.790278 1611 out.go:296] Setting OutFile to fd 1 ...
I0911 03:36:30.790388 1611 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0911 03:36:30.790392 1611 out.go:309] Setting ErrFile to fd 2...
I0911 03:36:30.790394 1611 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0911 03:36:30.790517 1611 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17225-951/.minikube/bin
I0911 03:36:30.791498 1611 out.go:303] Setting JSON to false
I0911 03:36:30.806544 1611 start.go:128] hostinfo: {"hostname":"MacOS-M1-Agent-1.local","uptime":364,"bootTime":1694428226,"procs":397,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"13.5.2","kernelVersion":"22.6.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"5b726c3a-f72c-561b-b03e-814251f12bfa"}
W0911 03:36:30.806605 1611 start.go:136] gopshost.Virtualization returned error: not implemented yet
I0911 03:36:30.811201 1611 out.go:177] * [functional-942000] minikube v1.31.2 on Darwin 13.5.2 (arm64)
I0911 03:36:30.818183 1611 out.go:177] - MINIKUBE_LOCATION=17225
I0911 03:36:30.822137 1611 out.go:177] - KUBECONFIG=/Users/jenkins/minikube-integration/17225-951/kubeconfig
I0911 03:36:30.818230 1611 notify.go:220] Checking for updates...
I0911 03:36:30.831111 1611 out.go:177] - MINIKUBE_BIN=out/minikube-darwin-arm64
I0911 03:36:30.834135 1611 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0911 03:36:30.837147 1611 out.go:177] - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17225-951/.minikube
I0911 03:36:30.840168 1611 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0911 03:36:30.843431 1611 config.go:182] Loaded profile config "functional-942000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.1
I0911 03:36:30.843481 1611 driver.go:373] Setting default libvirt URI to qemu:///system
I0911 03:36:30.848279 1611 out.go:177] * Using the qemu2 driver based on existing profile
I0911 03:36:30.855165 1611 start.go:298] selected driver: qemu2
I0911 03:36:30.855172 1611 start.go:902] validating driver "qemu2" against &{Name:functional-942000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17120/minikube-v1.31.0-1692872107-17120-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConf
ig:{KubernetesVersion:v1.28.1 ClusterName:functional-942000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.28.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mount
IP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
I0911 03:36:30.855225 1611 start.go:913] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0911 03:36:30.857107 1611 cni.go:84] Creating CNI manager for ""
I0911 03:36:30.857125 1611 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0911 03:36:30.857131 1611 start_flags.go:321] config:
{Name:functional-942000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/17120/minikube-v1.31.0-1692872107-17120-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.40-1693938323-17174@sha256:4edc55cb1933a7155ece55408f8b4aebfd99e28fa2209bc82b369d8ca3bf525b Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.1 ClusterName:functional-942000 Namespace:default A
PIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.105.4 Port:8441 KubernetesVersion:v1.28.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker
BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s}
I0911 03:36:30.861114 1611 iso.go:125] acquiring lock: {Name:mk940869f3ea2950f9d7f9f25946c8b774cc6054 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0911 03:36:30.868133 1611 out.go:177] * Starting control plane node functional-942000 in cluster functional-942000
I0911 03:36:30.872130 1611 preload.go:132] Checking if preload exists for k8s version v1.28.1 and runtime docker
I0911 03:36:30.872150 1611 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17225-951/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-docker-overlay2-arm64.tar.lz4
I0911 03:36:30.872163 1611 cache.go:57] Caching tarball of preloaded images
I0911 03:36:30.872227 1611 preload.go:174] Found /Users/jenkins/minikube-integration/17225-951/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I0911 03:36:30.872235 1611 cache.go:60] Finished verifying existence of preloaded tar for v1.28.1 on docker
I0911 03:36:30.872317 1611 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17225-951/.minikube/profiles/functional-942000/config.json ...
I0911 03:36:30.872696 1611 start.go:365] acquiring machines lock for functional-942000: {Name:mk566ae5c3a47b82fb2ec8c89cbc5c1134299e3e Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0911 03:36:30.872733 1611 start.go:369] acquired machines lock for "functional-942000" in 30.042µs
I0911 03:36:30.872743 1611 start.go:96] Skipping create...Using existing machine configuration
I0911 03:36:30.872748 1611 fix.go:54] fixHost starting:
I0911 03:36:30.873357 1611 fix.go:102] recreateIfNeeded on functional-942000: state=Running err=<nil>
W0911 03:36:30.873367 1611 fix.go:128] unexpected machine state, will restart: <nil>
I0911 03:36:30.881157 1611 out.go:177] * Updating the running qemu2 "functional-942000" VM ...
I0911 03:36:30.884042 1611 machine.go:88] provisioning docker machine ...
I0911 03:36:30.884055 1611 buildroot.go:166] provisioning hostname "functional-942000"
I0911 03:36:30.884081 1611 main.go:141] libmachine: Using SSH client type: native
I0911 03:36:30.884378 1611 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100f763b0] 0x100f78e10 <nil> [] 0s} 192.168.105.4 22 <nil> <nil>}
I0911 03:36:30.884384 1611 main.go:141] libmachine: About to run SSH command:
sudo hostname functional-942000 && echo "functional-942000" | sudo tee /etc/hostname
I0911 03:36:30.956113 1611 main.go:141] libmachine: SSH cmd err, output: <nil>: functional-942000
I0911 03:36:30.956163 1611 main.go:141] libmachine: Using SSH client type: native
I0911 03:36:30.956451 1611 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100f763b0] 0x100f78e10 <nil> [] 0s} 192.168.105.4 22 <nil> <nil>}
I0911 03:36:30.956461 1611 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\sfunctional-942000' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 functional-942000/g' /etc/hosts;
else
echo '127.0.1.1 functional-942000' | sudo tee -a /etc/hosts;
fi
fi
I0911 03:36:31.022710 1611 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0911 03:36:31.022721 1611 buildroot.go:172] set auth options {CertDir:/Users/jenkins/minikube-integration/17225-951/.minikube CaCertPath:/Users/jenkins/minikube-integration/17225-951/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/jenkins/minikube-integration/17225-951/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/jenkins/minikube-integration/17225-951/.minikube/machines/server.pem ServerKeyPath:/Users/jenkins/minikube-integration/17225-951/.minikube/machines/server-key.pem ClientKeyPath:/Users/jenkins/minikube-integration/17225-951/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/jenkins/minikube-integration/17225-951/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/jenkins/minikube-integration/17225-951/.minikube}
I0911 03:36:31.022732 1611 buildroot.go:174] setting up certificates
I0911 03:36:31.022740 1611 provision.go:83] configureAuth start
I0911 03:36:31.022745 1611 provision.go:138] copyHostCerts
I0911 03:36:31.022780 1611 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17225-951/.minikube/certs/ca.pem -> /Users/jenkins/minikube-integration/17225-951/.minikube/ca.pem
I0911 03:36:31.022834 1611 exec_runner.go:144] found /Users/jenkins/minikube-integration/17225-951/.minikube/ca.pem, removing ...
I0911 03:36:31.022840 1611 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17225-951/.minikube/ca.pem
I0911 03:36:31.022955 1611 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17225-951/.minikube/certs/ca.pem --> /Users/jenkins/minikube-integration/17225-951/.minikube/ca.pem (1078 bytes)
I0911 03:36:31.023129 1611 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17225-951/.minikube/certs/cert.pem -> /Users/jenkins/minikube-integration/17225-951/.minikube/cert.pem
I0911 03:36:31.023156 1611 exec_runner.go:144] found /Users/jenkins/minikube-integration/17225-951/.minikube/cert.pem, removing ...
I0911 03:36:31.023160 1611 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17225-951/.minikube/cert.pem
I0911 03:36:31.023213 1611 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17225-951/.minikube/certs/cert.pem --> /Users/jenkins/minikube-integration/17225-951/.minikube/cert.pem (1123 bytes)
I0911 03:36:31.023309 1611 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17225-951/.minikube/certs/key.pem -> /Users/jenkins/minikube-integration/17225-951/.minikube/key.pem
I0911 03:36:31.023334 1611 exec_runner.go:144] found /Users/jenkins/minikube-integration/17225-951/.minikube/key.pem, removing ...
I0911 03:36:31.023337 1611 exec_runner.go:203] rm: /Users/jenkins/minikube-integration/17225-951/.minikube/key.pem
I0911 03:36:31.023386 1611 exec_runner.go:151] cp: /Users/jenkins/minikube-integration/17225-951/.minikube/certs/key.pem --> /Users/jenkins/minikube-integration/17225-951/.minikube/key.pem (1675 bytes)
I0911 03:36:31.023484 1611 provision.go:112] generating server cert: /Users/jenkins/minikube-integration/17225-951/.minikube/machines/server.pem ca-key=/Users/jenkins/minikube-integration/17225-951/.minikube/certs/ca.pem private-key=/Users/jenkins/minikube-integration/17225-951/.minikube/certs/ca-key.pem org=jenkins.functional-942000 san=[192.168.105.4 192.168.105.4 localhost 127.0.0.1 minikube functional-942000]
I0911 03:36:31.128611 1611 provision.go:172] copyRemoteCerts
I0911 03:36:31.128655 1611 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0911 03:36:31.128668 1611 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17225-951/.minikube/machines/functional-942000/id_rsa Username:docker}
I0911 03:36:31.163996 1611 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17225-951/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I0911 03:36:31.164056 1611 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17225-951/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0911 03:36:31.171734 1611 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17225-951/.minikube/machines/server.pem -> /etc/docker/server.pem
I0911 03:36:31.171777 1611 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17225-951/.minikube/machines/server.pem --> /etc/docker/server.pem (1229 bytes)
I0911 03:36:31.178693 1611 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17225-951/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I0911 03:36:31.178738 1611 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17225-951/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0911 03:36:31.185398 1611 provision.go:86] duration metric: configureAuth took 162.652625ms
I0911 03:36:31.185405 1611 buildroot.go:189] setting minikube options for container-runtime
I0911 03:36:31.185504 1611 config.go:182] Loaded profile config "functional-942000": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.28.1
I0911 03:36:31.185541 1611 main.go:141] libmachine: Using SSH client type: native
I0911 03:36:31.185758 1611 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100f763b0] 0x100f78e10 <nil> [] 0s} 192.168.105.4 22 <nil> <nil>}
I0911 03:36:31.185766 1611 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0911 03:36:31.246788 1611 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs
I0911 03:36:31.246799 1611 buildroot.go:70] root file system type: tmpfs
I0911 03:36:31.246855 1611 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0911 03:36:31.246903 1611 main.go:141] libmachine: Using SSH client type: native
I0911 03:36:31.247152 1611 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100f763b0] 0x100f78e10 <nil> [] 0s} 192.168.105.4 22 <nil> <nil>}
I0911 03:36:31.247202 1611 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0911 03:36:31.314218 1611 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0911 03:36:31.314263 1611 main.go:141] libmachine: Using SSH client type: native
I0911 03:36:31.314498 1611 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100f763b0] 0x100f78e10 <nil> [] 0s} 192.168.105.4 22 <nil> <nil>}
I0911 03:36:31.314511 1611 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0911 03:36:31.380122 1611 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0911 03:36:31.380133 1611 machine.go:91] provisioned docker machine in 496.093542ms
I0911 03:36:31.380137 1611 start.go:300] post-start starting for "functional-942000" (driver="qemu2")
I0911 03:36:31.380144 1611 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0911 03:36:31.380211 1611 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0911 03:36:31.380230 1611 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17225-951/.minikube/machines/functional-942000/id_rsa Username:docker}
I0911 03:36:31.416802 1611 ssh_runner.go:195] Run: cat /etc/os-release
I0911 03:36:31.418199 1611 command_runner.go:130] > NAME=Buildroot
I0911 03:36:31.418205 1611 command_runner.go:130] > VERSION=2021.02.12-1-g88b5c50-dirty
I0911 03:36:31.418208 1611 command_runner.go:130] > ID=buildroot
I0911 03:36:31.418212 1611 command_runner.go:130] > VERSION_ID=2021.02.12
I0911 03:36:31.418216 1611 command_runner.go:130] > PRETTY_NAME="Buildroot 2021.02.12"
I0911 03:36:31.418438 1611 info.go:137] Remote host: Buildroot 2021.02.12
I0911 03:36:31.418448 1611 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17225-951/.minikube/addons for local assets ...
I0911 03:36:31.418521 1611 filesync.go:126] Scanning /Users/jenkins/minikube-integration/17225-951/.minikube/files for local assets ...
I0911 03:36:31.418652 1611 filesync.go:149] local asset: /Users/jenkins/minikube-integration/17225-951/.minikube/files/etc/ssl/certs/13932.pem -> 13932.pem in /etc/ssl/certs
I0911 03:36:31.418657 1611 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17225-951/.minikube/files/etc/ssl/certs/13932.pem -> /etc/ssl/certs/13932.pem
I0911 03:36:31.418780 1611 filesync.go:149] local asset: /Users/jenkins/minikube-integration/17225-951/.minikube/files/etc/test/nested/copy/1393/hosts -> hosts in /etc/test/nested/copy/1393
I0911 03:36:31.418784 1611 vm_assets.go:163] NewFileAsset: /Users/jenkins/minikube-integration/17225-951/.minikube/files/etc/test/nested/copy/1393/hosts -> /etc/test/nested/copy/1393/hosts
I0911 03:36:31.418818 1611 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs /etc/test/nested/copy/1393
I0911 03:36:31.421912 1611 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17225-951/.minikube/files/etc/ssl/certs/13932.pem --> /etc/ssl/certs/13932.pem (1708 bytes)
I0911 03:36:31.429329 1611 ssh_runner.go:362] scp /Users/jenkins/minikube-integration/17225-951/.minikube/files/etc/test/nested/copy/1393/hosts --> /etc/test/nested/copy/1393/hosts (40 bytes)
I0911 03:36:31.436359 1611 start.go:303] post-start completed in 56.216625ms
I0911 03:36:31.436367 1611 fix.go:56] fixHost completed within 563.629584ms
I0911 03:36:31.436401 1611 main.go:141] libmachine: Using SSH client type: native
I0911 03:36:31.436631 1611 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x100f763b0] 0x100f78e10 <nil> [] 0s} 192.168.105.4 22 <nil> <nil>}
I0911 03:36:31.436636 1611 main.go:141] libmachine: About to run SSH command:
date +%s.%N
I0911 03:36:31.494421 1611 main.go:141] libmachine: SSH cmd err, output: <nil>: 1694428591.558615359
I0911 03:36:31.494428 1611 fix.go:206] guest clock: 1694428591.558615359
I0911 03:36:31.494434 1611 fix.go:219] Guest: 2023-09-11 03:36:31.558615359 -0700 PDT Remote: 2023-09-11 03:36:31.436368 -0700 PDT m=+0.664778251 (delta=122.247359ms)
I0911 03:36:31.494447 1611 fix.go:190] guest clock delta is within tolerance: 122.247359ms
I0911 03:36:31.494450 1611 start.go:83] releasing machines lock for "functional-942000", held for 621.723458ms
I0911 03:36:31.494718 1611 ssh_runner.go:195] Run: cat /version.json
I0911 03:36:31.494727 1611 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17225-951/.minikube/machines/functional-942000/id_rsa Username:docker}
I0911 03:36:31.494718 1611 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0911 03:36:31.494760 1611 sshutil.go:53] new ssh client: &{IP:192.168.105.4 Port:22 SSHKeyPath:/Users/jenkins/minikube-integration/17225-951/.minikube/machines/functional-942000/id_rsa Username:docker}
I0911 03:36:31.568650 1611 command_runner.go:130] > <a href="https://github.com/kubernetes/registry.k8s.io">Temporary Redirect</a>.
I0911 03:36:31.568930 1611 command_runner.go:130] > {"iso_version": "v1.31.0-1692872107-17120", "kicbase_version": "v0.0.40-1692613578-17086", "minikube_version": "v1.31.2", "commit": "9dc31f0284dc1a8a35859648c60120733f0f8296"}
I0911 03:36:31.569005 1611 ssh_runner.go:195] Run: systemctl --version
I0911 03:36:31.571329 1611 command_runner.go:130] > systemd 247 (247)
I0911 03:36:31.571344 1611 command_runner.go:130] > -PAM -AUDIT -SELINUX -IMA -APPARMOR -SMACK -SYSVINIT -UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ +LZ4 -ZSTD +SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid
I0911 03:36:31.571499 1611 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0911 03:36:31.573664 1611 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/*loopback.conf*': No such file or directory
W0911 03:36:31.573679 1611 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I0911 03:36:31.573711 1611 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0911 03:36:31.577224 1611 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I0911 03:36:31.577233 1611 start.go:466] detecting cgroup driver to use...
I0911 03:36:31.577308 1611 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0911 03:36:31.583313 1611 command_runner.go:130] > runtime-endpoint: unix:///run/containerd/containerd.sock
I0911 03:36:31.583572 1611 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
I0911 03:36:31.586837 1611 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0911 03:36:31.589804 1611 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
I0911 03:36:31.589829 1611 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0911 03:36:31.593003 1611 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0911 03:36:31.596155 1611 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0911 03:36:31.598926 1611 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0911 03:36:31.601815 1611 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0911 03:36:31.605180 1611 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0911 03:36:31.608387 1611 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0911 03:36:31.611120 1611 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1
I0911 03:36:31.611161 1611 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0911 03:36:31.613810 1611 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0911 03:36:31.683924 1611 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0911 03:36:31.690089 1611 start.go:466] detecting cgroup driver to use...
I0911 03:36:31.690150 1611 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0911 03:36:31.695901 1611 command_runner.go:130] > # /usr/lib/systemd/system/docker.service
I0911 03:36:31.696397 1611 command_runner.go:130] > [Unit]
I0911 03:36:31.696403 1611 command_runner.go:130] > Description=Docker Application Container Engine
I0911 03:36:31.696411 1611 command_runner.go:130] > Documentation=https://docs.docker.com
I0911 03:36:31.696415 1611 command_runner.go:130] > After=network.target minikube-automount.service docker.socket
I0911 03:36:31.696418 1611 command_runner.go:130] > Requires= minikube-automount.service docker.socket
I0911 03:36:31.696421 1611 command_runner.go:130] > StartLimitBurst=3
I0911 03:36:31.696423 1611 command_runner.go:130] > StartLimitIntervalSec=60
I0911 03:36:31.696425 1611 command_runner.go:130] > [Service]
I0911 03:36:31.696428 1611 command_runner.go:130] > Type=notify
I0911 03:36:31.696430 1611 command_runner.go:130] > Restart=on-failure
I0911 03:36:31.696434 1611 command_runner.go:130] > # This file is a systemd drop-in unit that inherits from the base dockerd configuration.
I0911 03:36:31.696440 1611 command_runner.go:130] > # The base configuration already specifies an 'ExecStart=...' command. The first directive
I0911 03:36:31.696444 1611 command_runner.go:130] > # here is to clear out that command inherited from the base configuration. Without this,
I0911 03:36:31.696448 1611 command_runner.go:130] > # the command from the base configuration and the command specified here are treated as
I0911 03:36:31.696453 1611 command_runner.go:130] > # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
I0911 03:36:31.696456 1611 command_runner.go:130] > # will catch this invalid input and refuse to start the service with an error like:
I0911 03:36:31.696461 1611 command_runner.go:130] > # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
I0911 03:36:31.696470 1611 command_runner.go:130] > # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
I0911 03:36:31.696475 1611 command_runner.go:130] > # container runtimes. If left unlimited, it may result in OOM issues with MySQL.
I0911 03:36:31.696477 1611 command_runner.go:130] > ExecStart=
I0911 03:36:31.696486 1611 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=qemu2 --insecure-registry 10.96.0.0/12
I0911 03:36:31.696490 1611 command_runner.go:130] > ExecReload=/bin/kill -s HUP $MAINPID
I0911 03:36:31.696494 1611 command_runner.go:130] > # Having non-zero Limit*s causes performance problems due to accounting overhead
I0911 03:36:31.696498 1611 command_runner.go:130] > # in the kernel. We recommend using cgroups to do container-local accounting.
I0911 03:36:31.696500 1611 command_runner.go:130] > LimitNOFILE=infinity
I0911 03:36:31.696502 1611 command_runner.go:130] > LimitNPROC=infinity
I0911 03:36:31.696504 1611 command_runner.go:130] > LimitCORE=infinity
I0911 03:36:31.696507 1611 command_runner.go:130] > # Uncomment TasksMax if your systemd version supports it.
I0911 03:36:31.696510 1611 command_runner.go:130] > # Only systemd 226 and above support this version.
I0911 03:36:31.696512 1611 command_runner.go:130] > TasksMax=infinity
I0911 03:36:31.696514 1611 command_runner.go:130] > TimeoutStartSec=0
I0911 03:36:31.696519 1611 command_runner.go:130] > # set delegate yes so that systemd does not reset the cgroups of docker containers
I0911 03:36:31.696522 1611 command_runner.go:130] > Delegate=yes
I0911 03:36:31.696526 1611 command_runner.go:130] > # kill only the docker process, not all processes in the cgroup
I0911 03:36:31.696529 1611 command_runner.go:130] > KillMode=process
I0911 03:36:31.696532 1611 command_runner.go:130] > [Install]
I0911 03:36:31.696538 1611 command_runner.go:130] > WantedBy=multi-user.target
I0911 03:36:31.696790 1611 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0911 03:36:31.702289 1611 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0911 03:36:31.710209 1611 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0911 03:36:31.715242 1611 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0911 03:36:31.719720 1611 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0911 03:36:31.725004 1611 command_runner.go:130] > runtime-endpoint: unix:///var/run/cri-dockerd.sock
I0911 03:36:31.725154 1611 ssh_runner.go:195] Run: which cri-dockerd
I0911 03:36:31.726573 1611 command_runner.go:130] > /usr/bin/cri-dockerd
I0911 03:36:31.726657 1611 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0911 03:36:31.729350 1611 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
I0911 03:36:31.734558 1611 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0911 03:36:31.811857 1611 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0911 03:36:31.875774 1611 docker.go:535] configuring docker to use "cgroupfs" as cgroup driver...
I0911 03:36:31.875788 1611 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
I0911 03:36:31.881162 1611 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0911 03:36:31.947882 1611 ssh_runner.go:195] Run: sudo systemctl restart docker
I0911 03:38:30.822701 1611 command_runner.go:130] ! Job for docker.service failed because the control process exited with error code.
I0911 03:38:30.822769 1611 command_runner.go:130] ! See "systemctl status docker.service" and "journalctl -xe" for details.
I0911 03:38:30.823016 1611 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1m58.877016208s)
I0911 03:38:30.826965 1611 out.go:177]
W0911 03:38:30.831100 1611 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart docker: Process exited with status 1
stdout:
stderr:
Job for docker.service failed because the control process exited with error code.
See "systemctl status docker.service" and "journalctl -xe" for details.
X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart docker: Process exited with status 1
stdout:
stderr:
Job for docker.service failed because the control process exited with error code.
See "systemctl status docker.service" and "journalctl -xe" for details.
W0911 03:38:30.831135 1611 out.go:239] *
*
W0911 03:38:30.834008 1611 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0911 03:38:30.845008 1611 out.go:177]
** /stderr **
functional_test.go:657: failed to soft start minikube. args "out/minikube-darwin-arm64 start -p functional-942000 --alsologtostderr -v=8": exit status 90
functional_test.go:659: soft start took 2m0.098497458s for "functional-942000" cluster.
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-942000 -n functional-942000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-arm64 status --format={{.Host}} -p functional-942000 -n functional-942000: exit status 6 (112.876ms)
-- stdout --
Running
WARNING: Your kubectl is pointing to stale minikube-vm.
To fix the kubectl context, run `minikube update-context`
-- /stdout --
** stderr **
E0911 03:38:30.968941 1641 status.go:415] kubeconfig endpoint: extract IP: "functional-942000" does not appear in /Users/jenkins/minikube-integration/17225-951/kubeconfig
** /stderr **
helpers_test.go:239: status error: exit status 6 (may be ok)
helpers_test.go:241: "functional-942000" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")
--- FAIL: TestFunctional/serial/SoftStart (120.21s)