=== RUN TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run: out/minikube-linux-arm64 start -p calico-212797 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker --container-runtime=docker
E0929 14:02:50.246202 1127640 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/functional-085003/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
net_test.go:112: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p calico-212797 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker --container-runtime=docker: exit status 80 (4m48.834055994s)
-- stdout --
* [calico-212797] minikube v1.37.0 on Ubuntu 20.04 (arm64)
- MINIKUBE_LOCATION=21652
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- KUBECONFIG=/home/jenkins/minikube-integration/21652-1125775/kubeconfig
- MINIKUBE_HOME=/home/jenkins/minikube-integration/21652-1125775/.minikube
- MINIKUBE_BIN=out/minikube-linux-arm64
- MINIKUBE_FORCE_SYSTEMD=
* Using the docker driver based on user configuration
* Using Docker driver with root privileges
* Starting "calico-212797" primary control-plane node in "calico-212797" cluster
* Pulling base image v0.0.48 ...
* Configuring Calico (Container Networking Interface) ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
* Enabled addons: storage-provisioner, default-storageclass
-- /stdout --
** stderr **
I0929 14:02:39.946042 1443614 out.go:360] Setting OutFile to fd 1 ...
I0929 14:02:39.946214 1443614 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0929 14:02:39.946242 1443614 out.go:374] Setting ErrFile to fd 2...
I0929 14:02:39.946263 1443614 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0929 14:02:39.946517 1443614 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21652-1125775/.minikube/bin
I0929 14:02:39.946974 1443614 out.go:368] Setting JSON to false
I0929 14:02:39.947981 1443614 start.go:130] hostinfo: {"hostname":"ip-172-31-30-239","uptime":20712,"bootTime":1759133848,"procs":188,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1084-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0929 14:02:39.948079 1443614 start.go:140] virtualization:
I0929 14:02:39.953627 1443614 out.go:179] * [calico-212797] minikube v1.37.0 on Ubuntu 20.04 (arm64)
I0929 14:02:39.956916 1443614 out.go:179] - MINIKUBE_LOCATION=21652
I0929 14:02:39.956994 1443614 notify.go:220] Checking for updates...
I0929 14:02:39.963199 1443614 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0929 14:02:39.966241 1443614 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21652-1125775/kubeconfig
I0929 14:02:39.969370 1443614 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21652-1125775/.minikube
I0929 14:02:39.972298 1443614 out.go:179] - MINIKUBE_BIN=out/minikube-linux-arm64
I0929 14:02:39.975264 1443614 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I0929 14:02:39.978788 1443614 config.go:182] Loaded profile config "kubernetes-upgrade-710674": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.34.0
I0929 14:02:39.978908 1443614 driver.go:421] Setting default libvirt URI to qemu:///system
I0929 14:02:40.000169 1443614 docker.go:123] docker version: linux-28.1.1:Docker Engine - Community
I0929 14:02:40.000298 1443614 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0929 14:02:40.078180 1443614 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:36 OomKillDisable:true NGoroutines:52 SystemTime:2025-09-29 14:02:40.068249743 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1084-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:28.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx P
ath:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.23.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.35.1]] Warnings:<nil>}}
I0929 14:02:40.078299 1443614 docker.go:318] overlay module found
I0929 14:02:40.081441 1443614 out.go:179] * Using the docker driver based on user configuration
I0929 14:02:40.084269 1443614 start.go:304] selected driver: docker
I0929 14:02:40.084298 1443614 start.go:924] validating driver "docker" against <nil>
I0929 14:02:40.084315 1443614 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0929 14:02:40.085178 1443614 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0929 14:02:40.141479 1443614 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:36 OomKillDisable:true NGoroutines:52 SystemTime:2025-09-29 14:02:40.132235675 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1084-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:28.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx P
ath:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.23.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.35.1]] Warnings:<nil>}}
I0929 14:02:40.141629 1443614 start_flags.go:327] no existing cluster config was found, will generate one from the flags
I0929 14:02:40.141866 1443614 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0929 14:02:40.144728 1443614 out.go:179] * Using Docker driver with root privileges
I0929 14:02:40.147676 1443614 cni.go:84] Creating CNI manager for "calico"
I0929 14:02:40.147696 1443614 start_flags.go:336] Found "Calico" CNI - setting NetworkPlugin=cni
I0929 14:02:40.147788 1443614 start.go:348] cluster config:
{Name:calico-212797 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:calico-212797 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: Netwo
rkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInt
erval:1m0s}
I0929 14:02:40.151006 1443614 out.go:179] * Starting "calico-212797" primary control-plane node in "calico-212797" cluster
I0929 14:02:40.153946 1443614 cache.go:123] Beginning downloading kic base image for docker with docker
I0929 14:02:40.157010 1443614 out.go:179] * Pulling base image v0.0.48 ...
I0929 14:02:40.159993 1443614 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime docker
I0929 14:02:40.160080 1443614 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
I0929 14:02:40.160087 1443614 preload.go:146] Found local preload: /home/jenkins/minikube-integration/21652-1125775/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-docker-overlay2-arm64.tar.lz4
I0929 14:02:40.160104 1443614 cache.go:58] Caching tarball of preloaded images
I0929 14:02:40.160205 1443614 preload.go:172] Found /home/jenkins/minikube-integration/21652-1125775/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I0929 14:02:40.160215 1443614 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on docker
I0929 14:02:40.160333 1443614 profile.go:143] Saving config to /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/config.json ...
I0929 14:02:40.160364 1443614 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/config.json: {Name:mk30ec96a8c632922bbc56eab89fb2766db859cf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0929 14:02:40.179570 1443614 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
I0929 14:02:40.179607 1443614 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
I0929 14:02:40.179628 1443614 cache.go:232] Successfully downloaded all kic artifacts
I0929 14:02:40.179660 1443614 start.go:360] acquireMachinesLock for calico-212797: {Name:mkf80555d9b5c926f3c37d7a0a0185b66c5f030f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0929 14:02:40.179782 1443614 start.go:364] duration metric: took 99.455µs to acquireMachinesLock for "calico-212797"
I0929 14:02:40.179813 1443614 start.go:93] Provisioning new machine with config: &{Name:calico-212797 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:calico-212797 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[
] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetCl
ientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0929 14:02:40.179882 1443614 start.go:125] createHost starting for "" (driver="docker")
I0929 14:02:40.183194 1443614 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
I0929 14:02:40.183452 1443614 start.go:159] libmachine.API.Create for "calico-212797" (driver="docker")
I0929 14:02:40.183488 1443614 client.go:168] LocalClient.Create starting
I0929 14:02:40.183564 1443614 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21652-1125775/.minikube/certs/ca.pem
I0929 14:02:40.183606 1443614 main.go:141] libmachine: Decoding PEM data...
I0929 14:02:40.183625 1443614 main.go:141] libmachine: Parsing certificate...
I0929 14:02:40.183693 1443614 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/21652-1125775/.minikube/certs/cert.pem
I0929 14:02:40.183713 1443614 main.go:141] libmachine: Decoding PEM data...
I0929 14:02:40.183729 1443614 main.go:141] libmachine: Parsing certificate...
I0929 14:02:40.184100 1443614 cli_runner.go:164] Run: docker network inspect calico-212797 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0929 14:02:40.201227 1443614 cli_runner.go:211] docker network inspect calico-212797 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0929 14:02:40.201313 1443614 network_create.go:284] running [docker network inspect calico-212797] to gather additional debugging logs...
I0929 14:02:40.201334 1443614 cli_runner.go:164] Run: docker network inspect calico-212797
W0929 14:02:40.217207 1443614 cli_runner.go:211] docker network inspect calico-212797 returned with exit code 1
I0929 14:02:40.217238 1443614 network_create.go:287] error running [docker network inspect calico-212797]: docker network inspect calico-212797: exit status 1
stdout:
[]
stderr:
Error response from daemon: network calico-212797 not found
I0929 14:02:40.217253 1443614 network_create.go:289] output of [docker network inspect calico-212797]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network calico-212797 not found
** /stderr **
I0929 14:02:40.217352 1443614 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0929 14:02:40.235330 1443614 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-85cc826cc833 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:e6:9d:b6:86:22:ad} reservation:<nil>}
I0929 14:02:40.235613 1443614 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-aee8219e46ea IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:26:48:5c:79:e0:92} reservation:<nil>}
I0929 14:02:40.235866 1443614 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-415857c413ae IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:ba:0e:aa:55:e2:18} reservation:<nil>}
I0929 14:02:40.236318 1443614 network.go:206] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40018b23c0}
I0929 14:02:40.236342 1443614 network_create.go:124] attempt to create docker network calico-212797 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
I0929 14:02:40.236404 1443614 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=calico-212797 calico-212797
I0929 14:02:40.299658 1443614 network_create.go:108] docker network calico-212797 192.168.76.0/24 created
I0929 14:02:40.299693 1443614 kic.go:121] calculated static IP "192.168.76.2" for the "calico-212797" container
I0929 14:02:40.299776 1443614 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0929 14:02:40.316115 1443614 cli_runner.go:164] Run: docker volume create calico-212797 --label name.minikube.sigs.k8s.io=calico-212797 --label created_by.minikube.sigs.k8s.io=true
I0929 14:02:40.335300 1443614 oci.go:103] Successfully created a docker volume calico-212797
I0929 14:02:40.335397 1443614 cli_runner.go:164] Run: docker run --rm --name calico-212797-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=calico-212797 --entrypoint /usr/bin/test -v calico-212797:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
I0929 14:02:40.939124 1443614 oci.go:107] Successfully prepared a docker volume calico-212797
I0929 14:02:40.939171 1443614 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime docker
I0929 14:02:40.939192 1443614 kic.go:194] Starting extracting preloaded images to volume ...
I0929 14:02:40.939266 1443614 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21652-1125775/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v calico-212797:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
I0929 14:02:44.927222 1443614 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/21652-1125775/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v calico-212797:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (3.987921026s)
I0929 14:02:44.927264 1443614 kic.go:203] duration metric: took 3.988067333s to extract preloaded images to volume ...
W0929 14:02:44.927412 1443614 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0929 14:02:44.927528 1443614 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0929 14:02:44.996886 1443614 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname calico-212797 --name calico-212797 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=calico-212797 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=calico-212797 --network calico-212797 --ip 192.168.76.2 --volume calico-212797:/var --security-opt apparmor=unconfined --memory=3072mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
I0929 14:02:45.480923 1443614 cli_runner.go:164] Run: docker container inspect calico-212797 --format={{.State.Running}}
I0929 14:02:45.502242 1443614 cli_runner.go:164] Run: docker container inspect calico-212797 --format={{.State.Status}}
I0929 14:02:45.526500 1443614 cli_runner.go:164] Run: docker exec calico-212797 stat /var/lib/dpkg/alternatives/iptables
I0929 14:02:45.576004 1443614 oci.go:144] the created container "calico-212797" has a running status.
I0929 14:02:45.576044 1443614 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/21652-1125775/.minikube/machines/calico-212797/id_rsa...
I0929 14:02:47.156859 1443614 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/21652-1125775/.minikube/machines/calico-212797/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0929 14:02:47.178392 1443614 cli_runner.go:164] Run: docker container inspect calico-212797 --format={{.State.Status}}
I0929 14:02:47.203171 1443614 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0929 14:02:47.203191 1443614 kic_runner.go:114] Args: [docker exec --privileged calico-212797 chown docker:docker /home/docker/.ssh/authorized_keys]
I0929 14:02:47.251119 1443614 cli_runner.go:164] Run: docker container inspect calico-212797 --format={{.State.Status}}
I0929 14:02:47.274049 1443614 machine.go:93] provisionDockerMachine start ...
I0929 14:02:47.274142 1443614 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-212797
I0929 14:02:47.300668 1443614 main.go:141] libmachine: Using SSH client type: native
I0929 14:02:47.301000 1443614 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ef1e0] 0x3f19a0 <nil> [] 0s} 127.0.0.1 34238 <nil> <nil>}
I0929 14:02:47.301010 1443614 main.go:141] libmachine: About to run SSH command:
hostname
I0929 14:02:47.444231 1443614 main.go:141] libmachine: SSH cmd err, output: <nil>: calico-212797
I0929 14:02:47.444256 1443614 ubuntu.go:182] provisioning hostname "calico-212797"
I0929 14:02:47.444328 1443614 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-212797
I0929 14:02:47.466862 1443614 main.go:141] libmachine: Using SSH client type: native
I0929 14:02:47.467169 1443614 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ef1e0] 0x3f19a0 <nil> [] 0s} 127.0.0.1 34238 <nil> <nil>}
I0929 14:02:47.467186 1443614 main.go:141] libmachine: About to run SSH command:
sudo hostname calico-212797 && echo "calico-212797" | sudo tee /etc/hostname
I0929 14:02:47.631553 1443614 main.go:141] libmachine: SSH cmd err, output: <nil>: calico-212797
I0929 14:02:47.631638 1443614 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-212797
I0929 14:02:47.661918 1443614 main.go:141] libmachine: Using SSH client type: native
I0929 14:02:47.662217 1443614 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ef1e0] 0x3f19a0 <nil> [] 0s} 127.0.0.1 34238 <nil> <nil>}
I0929 14:02:47.662234 1443614 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\scalico-212797' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 calico-212797/g' /etc/hosts;
else
echo '127.0.1.1 calico-212797' | sudo tee -a /etc/hosts;
fi
fi
I0929 14:02:47.818092 1443614 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0929 14:02:47.818121 1443614 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21652-1125775/.minikube CaCertPath:/home/jenkins/minikube-integration/21652-1125775/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21652-1125775/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21652-1125775/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21652-1125775/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21652-1125775/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21652-1125775/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21652-1125775/.minikube}
I0929 14:02:47.818175 1443614 ubuntu.go:190] setting up certificates
I0929 14:02:47.818192 1443614 provision.go:84] configureAuth start
I0929 14:02:47.818269 1443614 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" calico-212797
I0929 14:02:47.841681 1443614 provision.go:143] copyHostCerts
I0929 14:02:47.841757 1443614 exec_runner.go:144] found /home/jenkins/minikube-integration/21652-1125775/.minikube/key.pem, removing ...
I0929 14:02:47.841772 1443614 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21652-1125775/.minikube/key.pem
I0929 14:02:47.841853 1443614 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21652-1125775/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21652-1125775/.minikube/key.pem (1671 bytes)
I0929 14:02:47.841952 1443614 exec_runner.go:144] found /home/jenkins/minikube-integration/21652-1125775/.minikube/ca.pem, removing ...
I0929 14:02:47.841964 1443614 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21652-1125775/.minikube/ca.pem
I0929 14:02:47.841993 1443614 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21652-1125775/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21652-1125775/.minikube/ca.pem (1078 bytes)
I0929 14:02:47.842051 1443614 exec_runner.go:144] found /home/jenkins/minikube-integration/21652-1125775/.minikube/cert.pem, removing ...
I0929 14:02:47.842060 1443614 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21652-1125775/.minikube/cert.pem
I0929 14:02:47.842085 1443614 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21652-1125775/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21652-1125775/.minikube/cert.pem (1123 bytes)
I0929 14:02:47.842134 1443614 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21652-1125775/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21652-1125775/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21652-1125775/.minikube/certs/ca-key.pem org=jenkins.calico-212797 san=[127.0.0.1 192.168.76.2 calico-212797 localhost minikube]
I0929 14:02:48.744233 1443614 provision.go:177] copyRemoteCerts
I0929 14:02:48.744305 1443614 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0929 14:02:48.744356 1443614 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-212797
I0929 14:02:48.760828 1443614 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34238 SSHKeyPath:/home/jenkins/minikube-integration/21652-1125775/.minikube/machines/calico-212797/id_rsa Username:docker}
I0929 14:02:48.861639 1443614 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21652-1125775/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0929 14:02:48.885776 1443614 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21652-1125775/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0929 14:02:48.910442 1443614 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21652-1125775/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0929 14:02:48.934678 1443614 provision.go:87] duration metric: took 1.116470609s to configureAuth
I0929 14:02:48.934748 1443614 ubuntu.go:206] setting minikube options for container-runtime
I0929 14:02:48.934955 1443614 config.go:182] Loaded profile config "calico-212797": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.34.0
I0929 14:02:48.935013 1443614 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-212797
I0929 14:02:48.951918 1443614 main.go:141] libmachine: Using SSH client type: native
I0929 14:02:48.952220 1443614 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ef1e0] 0x3f19a0 <nil> [] 0s} 127.0.0.1 34238 <nil> <nil>}
I0929 14:02:48.952239 1443614 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0929 14:02:49.097011 1443614 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0929 14:02:49.097030 1443614 ubuntu.go:71] root file system type: overlay
I0929 14:02:49.097150 1443614 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0929 14:02:49.097219 1443614 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-212797
I0929 14:02:49.114927 1443614 main.go:141] libmachine: Using SSH client type: native
I0929 14:02:49.115237 1443614 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ef1e0] 0x3f19a0 <nil> [] 0s} 127.0.0.1 34238 <nil> <nil>}
I0929 14:02:49.115327 1443614 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target
Wants=network-online.target containerd.service
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=always
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 \
-H fd:// --containerd=/run/containerd/containerd.sock \
-H unix:///var/run/docker.sock \
--default-ulimit=nofile=1048576:1048576 \
--tlsverify \
--tlscacert /etc/docker/ca.pem \
--tlscert /etc/docker/server.pem \
--tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0929 14:02:49.268805 1443614 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network-online.target nss-lookup.target docker.socket firewalld.service containerd.service time-set.target
Wants=network-online.target containerd.service
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=always
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H fd:// --containerd=/run/containerd/containerd.sock -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
I0929 14:02:49.268888 1443614 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-212797
I0929 14:02:49.288232 1443614 main.go:141] libmachine: Using SSH client type: native
I0929 14:02:49.288550 1443614 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3ef1e0] 0x3f19a0 <nil> [] 0s} 127.0.0.1 34238 <nil> <nil>}
I0929 14:02:49.288573 1443614 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0929 14:02:50.156196 1443614 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2025-09-03 20:57:01.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2025-09-29 14:02:49.260777386 +0000
@@ -9,23 +9,34 @@
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutStartSec=0
-RestartSec=2
Restart=always
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H fd:// --containerd=/run/containerd/containerd.sock -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
+
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
+LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0929 14:02:50.156289 1443614 machine.go:96] duration metric: took 2.882220549s to provisionDockerMachine
I0929 14:02:50.156315 1443614 client.go:171] duration metric: took 9.972819746s to LocalClient.Create
I0929 14:02:50.156366 1443614 start.go:167] duration metric: took 9.972915648s to libmachine.API.Create "calico-212797"
I0929 14:02:50.156393 1443614 start.go:293] postStartSetup for "calico-212797" (driver="docker")
I0929 14:02:50.156418 1443614 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0929 14:02:50.156604 1443614 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0929 14:02:50.156673 1443614 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-212797
I0929 14:02:50.173809 1443614 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34238 SSHKeyPath:/home/jenkins/minikube-integration/21652-1125775/.minikube/machines/calico-212797/id_rsa Username:docker}
I0929 14:02:50.273504 1443614 ssh_runner.go:195] Run: cat /etc/os-release
I0929 14:02:50.276568 1443614 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0929 14:02:50.276599 1443614 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0929 14:02:50.276653 1443614 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0929 14:02:50.276658 1443614 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0929 14:02:50.276669 1443614 filesync.go:126] Scanning /home/jenkins/minikube-integration/21652-1125775/.minikube/addons for local assets ...
I0929 14:02:50.276721 1443614 filesync.go:126] Scanning /home/jenkins/minikube-integration/21652-1125775/.minikube/files for local assets ...
I0929 14:02:50.276798 1443614 filesync.go:149] local asset: /home/jenkins/minikube-integration/21652-1125775/.minikube/files/etc/ssl/certs/11276402.pem -> 11276402.pem in /etc/ssl/certs
I0929 14:02:50.276895 1443614 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0929 14:02:50.285425 1443614 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21652-1125775/.minikube/files/etc/ssl/certs/11276402.pem --> /etc/ssl/certs/11276402.pem (1708 bytes)
I0929 14:02:50.309210 1443614 start.go:296] duration metric: took 152.78256ms for postStartSetup
I0929 14:02:50.309565 1443614 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" calico-212797
I0929 14:02:50.336002 1443614 profile.go:143] Saving config to /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/config.json ...
I0929 14:02:50.336262 1443614 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0929 14:02:50.336302 1443614 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-212797
I0929 14:02:50.355800 1443614 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34238 SSHKeyPath:/home/jenkins/minikube-integration/21652-1125775/.minikube/machines/calico-212797/id_rsa Username:docker}
I0929 14:02:50.453549 1443614 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0929 14:02:50.458342 1443614 start.go:128] duration metric: took 10.278443244s to createHost
I0929 14:02:50.458364 1443614 start.go:83] releasing machines lock for "calico-212797", held for 10.278569998s
I0929 14:02:50.458440 1443614 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" calico-212797
I0929 14:02:50.475205 1443614 ssh_runner.go:195] Run: cat /version.json
I0929 14:02:50.475268 1443614 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-212797
I0929 14:02:50.475575 1443614 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0929 14:02:50.475646 1443614 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-212797
I0929 14:02:50.496124 1443614 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34238 SSHKeyPath:/home/jenkins/minikube-integration/21652-1125775/.minikube/machines/calico-212797/id_rsa Username:docker}
I0929 14:02:50.516020 1443614 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34238 SSHKeyPath:/home/jenkins/minikube-integration/21652-1125775/.minikube/machines/calico-212797/id_rsa Username:docker}
I0929 14:02:50.596064 1443614 ssh_runner.go:195] Run: systemctl --version
I0929 14:02:50.721518 1443614 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0929 14:02:50.726048 1443614 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0929 14:02:50.752819 1443614 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0929 14:02:50.752895 1443614 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0929 14:02:50.785459 1443614 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0929 14:02:50.785487 1443614 start.go:495] detecting cgroup driver to use...
I0929 14:02:50.785520 1443614 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0929 14:02:50.785624 1443614 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0929 14:02:50.803252 1443614 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10.1"|' /etc/containerd/config.toml"
I0929 14:02:50.813693 1443614 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0929 14:02:50.826385 1443614 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0929 14:02:50.826462 1443614 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0929 14:02:50.837466 1443614 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0929 14:02:50.848223 1443614 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0929 14:02:50.858715 1443614 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0929 14:02:50.869681 1443614 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0929 14:02:50.879034 1443614 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0929 14:02:50.889716 1443614 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0929 14:02:50.899700 1443614 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0929 14:02:50.910288 1443614 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0929 14:02:50.919074 1443614 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0929 14:02:50.927791 1443614 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0929 14:02:51.042039 1443614 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0929 14:02:51.178538 1443614 start.go:495] detecting cgroup driver to use...
I0929 14:02:51.178585 1443614 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0929 14:02:51.178691 1443614 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0929 14:02:51.199837 1443614 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0929 14:02:51.214470 1443614 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I0929 14:02:51.256160 1443614 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I0929 14:02:51.273161 1443614 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0929 14:02:51.291869 1443614 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0929 14:02:51.314109 1443614 ssh_runner.go:195] Run: which cri-dockerd
I0929 14:02:51.318152 1443614 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0929 14:02:51.337165 1443614 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (192 bytes)
I0929 14:02:51.359755 1443614 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0929 14:02:51.469595 1443614 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0929 14:02:51.571529 1443614 docker.go:575] configuring docker to use "cgroupfs" as cgroup driver...
I0929 14:02:51.571650 1443614 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0929 14:02:51.599413 1443614 ssh_runner.go:195] Run: sudo systemctl reset-failed docker
I0929 14:02:51.613005 1443614 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0929 14:02:51.720548 1443614 ssh_runner.go:195] Run: sudo systemctl restart docker
I0929 14:02:52.238093 1443614 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0929 14:02:52.251122 1443614 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
I0929 14:02:52.264821 1443614 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0929 14:02:52.278263 1443614 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0929 14:02:52.392021 1443614 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0929 14:02:52.503467 1443614 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0929 14:02:52.620444 1443614 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0929 14:02:52.639689 1443614 ssh_runner.go:195] Run: sudo systemctl reset-failed cri-docker.service
I0929 14:02:52.652803 1443614 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0929 14:02:52.762391 1443614 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
I0929 14:02:52.867120 1443614 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0929 14:02:52.883105 1443614 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0929 14:02:52.883295 1443614 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0929 14:02:52.890377 1443614 start.go:563] Will wait 60s for crictl version
I0929 14:02:52.890512 1443614 ssh_runner.go:195] Run: which crictl
I0929 14:02:52.894487 1443614 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0929 14:02:52.950325 1443614 start.go:579] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 28.4.0
RuntimeApiVersion: v1
I0929 14:02:52.950464 1443614 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0929 14:02:52.991760 1443614 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0929 14:02:53.024994 1443614 out.go:252] * Preparing Kubernetes v1.34.0 on Docker 28.4.0 ...
I0929 14:02:53.025104 1443614 cli_runner.go:164] Run: docker network inspect calico-212797 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0929 14:02:53.041843 1443614 ssh_runner.go:195] Run: grep 192.168.76.1 host.minikube.internal$ /etc/hosts
I0929 14:02:53.046087 1443614 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.76.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0929 14:02:53.061099 1443614 kubeadm.go:875] updating cluster {Name:calico-212797 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:calico-212797 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] D
NSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPat
h: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0929 14:02:53.061220 1443614 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime docker
I0929 14:02:53.061289 1443614 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0929 14:02:53.082914 1443614 docker.go:691] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.34.0
registry.k8s.io/kube-controller-manager:v1.34.0
registry.k8s.io/kube-scheduler:v1.34.0
registry.k8s.io/kube-proxy:v1.34.0
registry.k8s.io/etcd:3.6.4-0
registry.k8s.io/pause:3.10.1
registry.k8s.io/coredns/coredns:v1.12.1
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0929 14:02:53.082938 1443614 docker.go:621] Images already preloaded, skipping extraction
I0929 14:02:53.083008 1443614 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0929 14:02:53.103773 1443614 docker.go:691] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.34.0
registry.k8s.io/kube-controller-manager:v1.34.0
registry.k8s.io/kube-scheduler:v1.34.0
registry.k8s.io/kube-proxy:v1.34.0
registry.k8s.io/etcd:3.6.4-0
registry.k8s.io/pause:3.10.1
registry.k8s.io/coredns/coredns:v1.12.1
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0929 14:02:53.103797 1443614 cache_images.go:85] Images are preloaded, skipping loading
I0929 14:02:53.103808 1443614 kubeadm.go:926] updating node { 192.168.76.2 8443 v1.34.0 docker true true} ...
I0929 14:02:53.103906 1443614 kubeadm.go:938] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=calico-212797 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.76.2
[Install]
config:
{KubernetesVersion:v1.34.0 ClusterName:calico-212797 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico}
I0929 14:02:53.103979 1443614 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0929 14:02:53.198082 1443614 cni.go:84] Creating CNI manager for "calico"
I0929 14:02:53.198107 1443614 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0929 14:02:53.198130 1443614 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.76.2 APIServerPort:8443 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:calico-212797 NodeName:calico-212797 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.76.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.76.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuber
netes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0929 14:02:53.198265 1443614 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.76.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/cri-dockerd.sock
name: "calico-212797"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.76.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.76.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0929 14:02:53.198336 1443614 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
I0929 14:02:53.208622 1443614 binaries.go:44] Found k8s binaries, skipping transfer
I0929 14:02:53.208696 1443614 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0929 14:02:53.218741 1443614 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)
I0929 14:02:53.240668 1443614 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0929 14:02:53.261209 1443614 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2214 bytes)
I0929 14:02:53.281281 1443614 ssh_runner.go:195] Run: grep 192.168.76.2 control-plane.minikube.internal$ /etc/hosts
I0929 14:02:53.285068 1443614 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.76.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0929 14:02:53.296715 1443614 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0929 14:02:53.413070 1443614 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0929 14:02:53.429528 1443614 certs.go:68] Setting up /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797 for IP: 192.168.76.2
I0929 14:02:53.429551 1443614 certs.go:194] generating shared ca certs ...
I0929 14:02:53.429568 1443614 certs.go:226] acquiring lock for ca certs: {Name:mk2ca206c678438cc443e63fe0260ecc893c1d98 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0929 14:02:53.429694 1443614 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21652-1125775/.minikube/ca.key
I0929 14:02:53.429741 1443614 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21652-1125775/.minikube/proxy-client-ca.key
I0929 14:02:53.429752 1443614 certs.go:256] generating profile certs ...
I0929 14:02:53.429807 1443614 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/client.key
I0929 14:02:53.429823 1443614 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/client.crt with IP's: []
I0929 14:02:53.772979 1443614 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/client.crt ...
I0929 14:02:53.773011 1443614 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/client.crt: {Name:mk892e255ef668961bd62d7c2dd2ebdadb9de8bc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0929 14:02:53.773239 1443614 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/client.key ...
I0929 14:02:53.773254 1443614 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/client.key: {Name:mk818ea7079873b68e5ad05b603355fe039f9903 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0929 14:02:53.773362 1443614 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/apiserver.key.e8d2d263
I0929 14:02:53.773381 1443614 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/apiserver.crt.e8d2d263 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.76.2]
I0929 14:02:54.542258 1443614 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/apiserver.crt.e8d2d263 ...
I0929 14:02:54.542294 1443614 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/apiserver.crt.e8d2d263: {Name:mk54be09cdd6a947c73d1ab0e7f39829b99d586b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0929 14:02:54.542465 1443614 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/apiserver.key.e8d2d263 ...
I0929 14:02:54.542482 1443614 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/apiserver.key.e8d2d263: {Name:mk6639f1299dfbc6f44599c553122d3de27a3765 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0929 14:02:54.542557 1443614 certs.go:381] copying /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/apiserver.crt.e8d2d263 -> /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/apiserver.crt
I0929 14:02:54.542646 1443614 certs.go:385] copying /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/apiserver.key.e8d2d263 -> /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/apiserver.key
I0929 14:02:54.542706 1443614 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/proxy-client.key
I0929 14:02:54.542726 1443614 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/proxy-client.crt with IP's: []
I0929 14:02:55.393654 1443614 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/proxy-client.crt ...
I0929 14:02:55.393684 1443614 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/proxy-client.crt: {Name:mk18f72a335f24229414688a0cba8cd0a289882c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0929 14:02:55.393896 1443614 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/proxy-client.key ...
I0929 14:02:55.393912 1443614 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/proxy-client.key: {Name:mk4b1f27eb6a56877e26ffe89f563a6990bed0a7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0929 14:02:55.394111 1443614 certs.go:484] found cert: /home/jenkins/minikube-integration/21652-1125775/.minikube/certs/1127640.pem (1338 bytes)
W0929 14:02:55.394147 1443614 certs.go:480] ignoring /home/jenkins/minikube-integration/21652-1125775/.minikube/certs/1127640_empty.pem, impossibly tiny 0 bytes
I0929 14:02:55.394156 1443614 certs.go:484] found cert: /home/jenkins/minikube-integration/21652-1125775/.minikube/certs/ca-key.pem (1675 bytes)
I0929 14:02:55.394182 1443614 certs.go:484] found cert: /home/jenkins/minikube-integration/21652-1125775/.minikube/certs/ca.pem (1078 bytes)
I0929 14:02:55.394204 1443614 certs.go:484] found cert: /home/jenkins/minikube-integration/21652-1125775/.minikube/certs/cert.pem (1123 bytes)
I0929 14:02:55.394234 1443614 certs.go:484] found cert: /home/jenkins/minikube-integration/21652-1125775/.minikube/certs/key.pem (1671 bytes)
I0929 14:02:55.394274 1443614 certs.go:484] found cert: /home/jenkins/minikube-integration/21652-1125775/.minikube/files/etc/ssl/certs/11276402.pem (1708 bytes)
I0929 14:02:55.405822 1443614 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21652-1125775/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0929 14:02:55.431894 1443614 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21652-1125775/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0929 14:02:55.469879 1443614 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21652-1125775/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0929 14:02:55.504968 1443614 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21652-1125775/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0929 14:02:55.539835 1443614 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0929 14:02:55.575324 1443614 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0929 14:02:55.602944 1443614 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0929 14:02:55.628217 1443614 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21652-1125775/.minikube/profiles/calico-212797/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0929 14:02:55.660881 1443614 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21652-1125775/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0929 14:02:55.686169 1443614 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21652-1125775/.minikube/certs/1127640.pem --> /usr/share/ca-certificates/1127640.pem (1338 bytes)
I0929 14:02:55.711549 1443614 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21652-1125775/.minikube/files/etc/ssl/certs/11276402.pem --> /usr/share/ca-certificates/11276402.pem (1708 bytes)
I0929 14:02:55.735937 1443614 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0929 14:02:55.754338 1443614 ssh_runner.go:195] Run: openssl version
I0929 14:02:55.760631 1443614 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0929 14:02:55.770628 1443614 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0929 14:02:55.774965 1443614 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 29 13:02 /usr/share/ca-certificates/minikubeCA.pem
I0929 14:02:55.775085 1443614 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0929 14:02:55.782950 1443614 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0929 14:02:55.793774 1443614 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1127640.pem && ln -fs /usr/share/ca-certificates/1127640.pem /etc/ssl/certs/1127640.pem"
I0929 14:02:55.810435 1443614 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1127640.pem
I0929 14:02:55.814645 1443614 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 29 13:09 /usr/share/ca-certificates/1127640.pem
I0929 14:02:55.814733 1443614 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1127640.pem
I0929 14:02:55.822196 1443614 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1127640.pem /etc/ssl/certs/51391683.0"
I0929 14:02:55.835419 1443614 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11276402.pem && ln -fs /usr/share/ca-certificates/11276402.pem /etc/ssl/certs/11276402.pem"
I0929 14:02:55.844886 1443614 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11276402.pem
I0929 14:02:55.848884 1443614 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 29 13:09 /usr/share/ca-certificates/11276402.pem
I0929 14:02:55.848974 1443614 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11276402.pem
I0929 14:02:55.856467 1443614 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/11276402.pem /etc/ssl/certs/3ec20f2e.0"
I0929 14:02:55.865793 1443614 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0929 14:02:55.870333 1443614 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0929 14:02:55.870412 1443614 kubeadm.go:392] StartCluster: {Name:calico-212797 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:calico-212797 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSD
omain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath:
SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0929 14:02:55.870569 1443614 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0929 14:02:55.888843 1443614 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0929 14:02:55.899540 1443614 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0929 14:02:55.908482 1443614 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0929 14:02:55.908587 1443614 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0929 14:02:55.919996 1443614 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0929 14:02:55.920018 1443614 kubeadm.go:157] found existing configuration files:
I0929 14:02:55.920098 1443614 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0929 14:02:55.929625 1443614 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0929 14:02:55.929710 1443614 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0929 14:02:55.938633 1443614 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0929 14:02:55.948611 1443614 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0929 14:02:55.948730 1443614 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0929 14:02:55.958490 1443614 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0929 14:02:55.968612 1443614 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0929 14:02:55.968680 1443614 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0929 14:02:55.977818 1443614 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0929 14:02:55.987653 1443614 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0929 14:02:55.987715 1443614 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0929 14:02:55.997761 1443614 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0929 14:02:56.051893 1443614 kubeadm.go:310] [init] Using Kubernetes version: v1.34.0
I0929 14:02:56.052056 1443614 kubeadm.go:310] [preflight] Running pre-flight checks
I0929 14:02:56.099085 1443614 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0929 14:02:56.099177 1443614 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1084-aws[0m
I0929 14:02:56.099238 1443614 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0929 14:02:56.099304 1443614 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0929 14:02:56.099368 1443614 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0929 14:02:56.099435 1443614 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0929 14:02:56.099497 1443614 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0929 14:02:56.099560 1443614 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0929 14:02:56.099629 1443614 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0929 14:02:56.099681 1443614 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0929 14:02:56.099754 1443614 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0929 14:02:56.099818 1443614 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0929 14:02:56.206481 1443614 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0929 14:02:56.206602 1443614 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0929 14:02:56.206705 1443614 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0929 14:02:56.220552 1443614 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0929 14:02:56.226580 1443614 out.go:252] - Generating certificates and keys ...
I0929 14:02:56.226677 1443614 kubeadm.go:310] [certs] Using existing ca certificate authority
I0929 14:02:56.226751 1443614 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0929 14:02:56.457087 1443614 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0929 14:02:56.704937 1443614 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0929 14:02:56.990815 1443614 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0929 14:02:57.149019 1443614 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0929 14:02:57.562553 1443614 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0929 14:02:57.563229 1443614 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [calico-212797 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0929 14:02:59.164834 1443614 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0929 14:02:59.164976 1443614 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [calico-212797 localhost] and IPs [192.168.76.2 127.0.0.1 ::1]
I0929 14:02:59.300854 1443614 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0929 14:03:00.371585 1443614 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0929 14:03:00.784837 1443614 kubeadm.go:310] [certs] Generating "sa" key and public key
I0929 14:03:00.788765 1443614 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0929 14:03:01.000934 1443614 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0929 14:03:01.590697 1443614 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0929 14:03:03.060252 1443614 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0929 14:03:03.618937 1443614 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0929 14:03:04.005629 1443614 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0929 14:03:04.006894 1443614 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0929 14:03:04.010297 1443614 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0929 14:03:04.013579 1443614 out.go:252] - Booting up control plane ...
I0929 14:03:04.013692 1443614 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0929 14:03:04.015652 1443614 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0929 14:03:04.017642 1443614 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0929 14:03:04.034030 1443614 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0929 14:03:04.034144 1443614 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
I0929 14:03:04.043596 1443614 kubeadm.go:310] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
I0929 14:03:04.043701 1443614 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0929 14:03:04.043743 1443614 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0929 14:03:04.189951 1443614 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0929 14:03:04.190080 1443614 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0929 14:03:06.192030 1443614 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 2.001308324s
I0929 14:03:06.195861 1443614 kubeadm.go:310] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
I0929 14:03:06.195962 1443614 kubeadm.go:310] [control-plane-check] Checking kube-apiserver at https://192.168.76.2:8443/livez
I0929 14:03:06.196281 1443614 kubeadm.go:310] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
I0929 14:03:06.196372 1443614 kubeadm.go:310] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
I0929 14:03:16.496216 1443614 kubeadm.go:310] [control-plane-check] kube-controller-manager is healthy after 10.299818575s
I0929 14:03:17.573194 1443614 kubeadm.go:310] [control-plane-check] kube-scheduler is healthy after 11.377243611s
I0929 14:03:19.706426 1443614 kubeadm.go:310] [control-plane-check] kube-apiserver is healthy after 13.510519996s
I0929 14:03:19.730953 1443614 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0929 14:03:19.745684 1443614 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0929 14:03:19.761761 1443614 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0929 14:03:19.761974 1443614 kubeadm.go:310] [mark-control-plane] Marking the node calico-212797 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0929 14:03:19.777921 1443614 kubeadm.go:310] [bootstrap-token] Using token: nr1h96.wrjlx40ue3y357er
I0929 14:03:19.780864 1443614 out.go:252] - Configuring RBAC rules ...
I0929 14:03:19.780997 1443614 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0929 14:03:19.785389 1443614 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0929 14:03:19.794652 1443614 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0929 14:03:19.799507 1443614 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0929 14:03:19.804571 1443614 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0929 14:03:19.810910 1443614 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0929 14:03:20.115882 1443614 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0929 14:03:20.553210 1443614 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0929 14:03:21.114150 1443614 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0929 14:03:21.115637 1443614 kubeadm.go:310]
I0929 14:03:21.115739 1443614 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0929 14:03:21.115755 1443614 kubeadm.go:310]
I0929 14:03:21.115845 1443614 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0929 14:03:21.115855 1443614 kubeadm.go:310]
I0929 14:03:21.115888 1443614 kubeadm.go:310] mkdir -p $HOME/.kube
I0929 14:03:21.115954 1443614 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0929 14:03:21.116011 1443614 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0929 14:03:21.116020 1443614 kubeadm.go:310]
I0929 14:03:21.116076 1443614 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0929 14:03:21.116085 1443614 kubeadm.go:310]
I0929 14:03:21.116136 1443614 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0929 14:03:21.116144 1443614 kubeadm.go:310]
I0929 14:03:21.116200 1443614 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0929 14:03:21.116282 1443614 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0929 14:03:21.116357 1443614 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0929 14:03:21.116366 1443614 kubeadm.go:310]
I0929 14:03:21.116454 1443614 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0929 14:03:21.116577 1443614 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0929 14:03:21.116591 1443614 kubeadm.go:310]
I0929 14:03:21.116679 1443614 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token nr1h96.wrjlx40ue3y357er \
I0929 14:03:21.116791 1443614 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:0ab4ad05387d2b551732906ec22c7c0fb9e787b40623069ae285559494ddfa4b \
I0929 14:03:21.116817 1443614 kubeadm.go:310] --control-plane
I0929 14:03:21.116825 1443614 kubeadm.go:310]
I0929 14:03:21.116914 1443614 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0929 14:03:21.116922 1443614 kubeadm.go:310]
I0929 14:03:21.117008 1443614 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token nr1h96.wrjlx40ue3y357er \
I0929 14:03:21.117117 1443614 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:0ab4ad05387d2b551732906ec22c7c0fb9e787b40623069ae285559494ddfa4b
I0929 14:03:21.121177 1443614 kubeadm.go:310] [WARNING SystemVerification]: cgroups v1 support is in maintenance mode, please migrate to cgroups v2
I0929 14:03:21.121428 1443614 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1084-aws\n", err: exit status 1
I0929 14:03:21.121542 1443614 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0929 14:03:21.121566 1443614 cni.go:84] Creating CNI manager for "calico"
I0929 14:03:21.125025 1443614 out.go:179] * Configuring Calico (Container Networking Interface) ...
I0929 14:03:21.128071 1443614 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.0/kubectl ...
I0929 14:03:21.128101 1443614 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (539470 bytes)
I0929 14:03:21.153027 1443614 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0929 14:03:22.980484 1443614 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.34.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: (1.827422987s)
I0929 14:03:22.980565 1443614 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0929 14:03:22.980687 1443614 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0929 14:03:22.980699 1443614 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes calico-212797 minikube.k8s.io/updated_at=2025_09_29T14_03_22_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=aad2f46d67652a73456765446faac83429b43d5e minikube.k8s.io/name=calico-212797 minikube.k8s.io/primary=true
I0929 14:03:23.168634 1443614 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0929 14:03:23.168699 1443614 ops.go:34] apiserver oom_adj: -16
I0929 14:03:23.669373 1443614 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0929 14:03:24.169388 1443614 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0929 14:03:24.669738 1443614 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0929 14:03:25.169557 1443614 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0929 14:03:25.668896 1443614 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0929 14:03:25.852618 1443614 kubeadm.go:1105] duration metric: took 2.87200744s to wait for elevateKubeSystemPrivileges
I0929 14:03:25.852646 1443614 kubeadm.go:394] duration metric: took 29.982238819s to StartCluster
I0929 14:03:25.852663 1443614 settings.go:142] acquiring lock: {Name:mk249a9fcafe0b1d8a711271fd58963fceaa93e7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0929 14:03:25.852724 1443614 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21652-1125775/kubeconfig
I0929 14:03:25.853667 1443614 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21652-1125775/kubeconfig: {Name:mk597cf1ee15868b03242d28b30b65f8e0e5d009 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0929 14:03:25.853873 1443614 start.go:235] Will wait 15m0s for node &{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0929 14:03:25.854022 1443614 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0929 14:03:25.854283 1443614 config.go:182] Loaded profile config "calico-212797": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.34.0
I0929 14:03:25.854326 1443614 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I0929 14:03:25.854388 1443614 addons.go:69] Setting storage-provisioner=true in profile "calico-212797"
I0929 14:03:25.854403 1443614 addons.go:238] Setting addon storage-provisioner=true in "calico-212797"
I0929 14:03:25.854424 1443614 host.go:66] Checking if "calico-212797" exists ...
I0929 14:03:25.854916 1443614 cli_runner.go:164] Run: docker container inspect calico-212797 --format={{.State.Status}}
I0929 14:03:25.855869 1443614 addons.go:69] Setting default-storageclass=true in profile "calico-212797"
I0929 14:03:25.855893 1443614 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "calico-212797"
I0929 14:03:25.856186 1443614 cli_runner.go:164] Run: docker container inspect calico-212797 --format={{.State.Status}}
I0929 14:03:25.857677 1443614 out.go:179] * Verifying Kubernetes components...
I0929 14:03:25.861502 1443614 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0929 14:03:25.917320 1443614 out.go:179] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0929 14:03:25.917899 1443614 addons.go:238] Setting addon default-storageclass=true in "calico-212797"
I0929 14:03:25.917938 1443614 host.go:66] Checking if "calico-212797" exists ...
I0929 14:03:25.918350 1443614 cli_runner.go:164] Run: docker container inspect calico-212797 --format={{.State.Status}}
I0929 14:03:25.920492 1443614 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0929 14:03:25.920523 1443614 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0929 14:03:25.920585 1443614 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-212797
I0929 14:03:25.964992 1443614 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
I0929 14:03:25.965014 1443614 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0929 14:03:25.965075 1443614 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" calico-212797
I0929 14:03:25.977587 1443614 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34238 SSHKeyPath:/home/jenkins/minikube-integration/21652-1125775/.minikube/machines/calico-212797/id_rsa Username:docker}
I0929 14:03:26.007093 1443614 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34238 SSHKeyPath:/home/jenkins/minikube-integration/21652-1125775/.minikube/machines/calico-212797/id_rsa Username:docker}
I0929 14:03:26.195668 1443614 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.76.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0929 14:03:26.195800 1443614 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0929 14:03:26.257817 1443614 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0929 14:03:26.303901 1443614 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0929 14:03:27.589622 1443614 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (1.393799063s)
I0929 14:03:27.590681 1443614 node_ready.go:35] waiting up to 15m0s for node "calico-212797" to be "Ready" ...
I0929 14:03:27.591125 1443614 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.76.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.395425243s)
I0929 14:03:27.591162 1443614 start.go:976] {"host.minikube.internal": 192.168.76.1} host record injected into CoreDNS's ConfigMap
I0929 14:03:27.637450 1443614 node_ready.go:49] node "calico-212797" is "Ready"
I0929 14:03:27.637528 1443614 node_ready.go:38] duration metric: took 46.787836ms for node "calico-212797" to be "Ready" ...
I0929 14:03:27.637559 1443614 api_server.go:52] waiting for apiserver process to appear ...
I0929 14:03:27.637649 1443614 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0929 14:03:28.003094 1443614 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.745237826s)
I0929 14:03:28.003184 1443614 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.699214076s)
I0929 14:03:28.003485 1443614 api_server.go:72] duration metric: took 2.149585696s to wait for apiserver process to appear ...
I0929 14:03:28.003505 1443614 api_server.go:88] waiting for apiserver healthz status ...
I0929 14:03:28.003526 1443614 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
I0929 14:03:28.027212 1443614 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
ok
I0929 14:03:28.028699 1443614 api_server.go:141] control plane version: v1.34.0
I0929 14:03:28.028735 1443614 api_server.go:131] duration metric: took 25.222619ms to wait for apiserver health ...
I0929 14:03:28.028745 1443614 system_pods.go:43] waiting for kube-system pods to appear ...
I0929 14:03:28.036081 1443614 system_pods.go:59] 10 kube-system pods found
I0929 14:03:28.036126 1443614 system_pods.go:61] "calico-kube-controllers-59556d9b4c-zmjl5" [6eb0da5b-0c69-46c9-a600-4404a3b9b9d2] Pending / Ready:ContainersNotReady (containers with unready status: [calico-kube-controllers]) / ContainersReady:ContainersNotReady (containers with unready status: [calico-kube-controllers])
I0929 14:03:28.036137 1443614 system_pods.go:61] "calico-node-gdclv" [c3b760c9-294a-4405-8868-bb0f92072326] Pending / Initialized:ContainersNotInitialized (containers with incomplete status: [upgrade-ipam install-cni mount-bpffs]) / Ready:ContainersNotReady (containers with unready status: [calico-node]) / ContainersReady:ContainersNotReady (containers with unready status: [calico-node])
I0929 14:03:28.036148 1443614 system_pods.go:61] "coredns-66bc5c9577-dtx77" [2bc59934-92af-4922-b611-33e8e48fc6ba] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0929 14:03:28.036156 1443614 system_pods.go:61] "coredns-66bc5c9577-h2v7h" [350216d3-c01e-4300-9df5-c78fd19ba429] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0929 14:03:28.036161 1443614 system_pods.go:61] "etcd-calico-212797" [39d7c3e7-991f-4447-9c23-60b46f63a128] Running
I0929 14:03:28.036167 1443614 system_pods.go:61] "kube-apiserver-calico-212797" [11e6dfd0-7b98-4d6a-93eb-abf6dc6c55fa] Running
I0929 14:03:28.036175 1443614 system_pods.go:61] "kube-controller-manager-calico-212797" [973ada77-667a-42fa-be15-dbcaa1dfec1d] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0929 14:03:28.036181 1443614 system_pods.go:61] "kube-proxy-q2pqh" [2f541a0a-a431-4db5-9e21-6af570318f7a] Pending / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0929 14:03:28.036189 1443614 system_pods.go:61] "kube-scheduler-calico-212797" [28d64b8e-cb58-4949-aeb7-de18e21cfe7e] Running
I0929 14:03:28.036194 1443614 system_pods.go:61] "storage-provisioner" [bd294ad1-3d5f-4e4d-bcbb-b2cdbd1b9aef] Pending
I0929 14:03:28.036208 1443614 system_pods.go:74] duration metric: took 7.455744ms to wait for pod list to return data ...
I0929 14:03:28.036217 1443614 default_sa.go:34] waiting for default service account to be created ...
I0929 14:03:28.036469 1443614 out.go:179] * Enabled addons: storage-provisioner, default-storageclass
I0929 14:03:28.039664 1443614 addons.go:514] duration metric: took 2.185311718s for enable addons: enabled=[storage-provisioner default-storageclass]
I0929 14:03:28.051053 1443614 default_sa.go:45] found service account: "default"
I0929 14:03:28.051076 1443614 default_sa.go:55] duration metric: took 14.848712ms for default service account to be created ...
I0929 14:03:28.051086 1443614 system_pods.go:116] waiting for k8s-apps to be running ...
I0929 14:03:28.059300 1443614 system_pods.go:86] 10 kube-system pods found
I0929 14:03:28.059338 1443614 system_pods.go:89] "calico-kube-controllers-59556d9b4c-zmjl5" [6eb0da5b-0c69-46c9-a600-4404a3b9b9d2] Pending / Ready:ContainersNotReady (containers with unready status: [calico-kube-controllers]) / ContainersReady:ContainersNotReady (containers with unready status: [calico-kube-controllers])
I0929 14:03:28.059348 1443614 system_pods.go:89] "calico-node-gdclv" [c3b760c9-294a-4405-8868-bb0f92072326] Pending / Initialized:ContainersNotInitialized (containers with incomplete status: [upgrade-ipam install-cni mount-bpffs]) / Ready:ContainersNotReady (containers with unready status: [calico-node]) / ContainersReady:ContainersNotReady (containers with unready status: [calico-node])
I0929 14:03:28.059358 1443614 system_pods.go:89] "coredns-66bc5c9577-dtx77" [2bc59934-92af-4922-b611-33e8e48fc6ba] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0929 14:03:28.059369 1443614 system_pods.go:89] "coredns-66bc5c9577-h2v7h" [350216d3-c01e-4300-9df5-c78fd19ba429] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0929 14:03:28.059377 1443614 system_pods.go:89] "etcd-calico-212797" [39d7c3e7-991f-4447-9c23-60b46f63a128] Running
I0929 14:03:28.059382 1443614 system_pods.go:89] "kube-apiserver-calico-212797" [11e6dfd0-7b98-4d6a-93eb-abf6dc6c55fa] Running
I0929 14:03:28.059393 1443614 system_pods.go:89] "kube-controller-manager-calico-212797" [973ada77-667a-42fa-be15-dbcaa1dfec1d] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0929 14:03:28.059402 1443614 system_pods.go:89] "kube-proxy-q2pqh" [2f541a0a-a431-4db5-9e21-6af570318f7a] Pending / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0929 14:03:28.059408 1443614 system_pods.go:89] "kube-scheduler-calico-212797" [28d64b8e-cb58-4949-aeb7-de18e21cfe7e] Running
I0929 14:03:28.059412 1443614 system_pods.go:89] "storage-provisioner" [bd294ad1-3d5f-4e4d-bcbb-b2cdbd1b9aef] Pending
I0929 14:03:28.059441 1443614 retry.go:31] will retry after 283.737622ms: missing components: kube-proxy
I0929 14:03:28.095618 1443614 kapi.go:214] "coredns" deployment in "kube-system" namespace and "calico-212797" context rescaled to 1 replicas
I0929 14:03:28.348606 1443614 system_pods.go:86] 10 kube-system pods found
I0929 14:03:28.348644 1443614 system_pods.go:89] "calico-kube-controllers-59556d9b4c-zmjl5" [6eb0da5b-0c69-46c9-a600-4404a3b9b9d2] Pending / Ready:ContainersNotReady (containers with unready status: [calico-kube-controllers]) / ContainersReady:ContainersNotReady (containers with unready status: [calico-kube-controllers])
I0929 14:03:28.348654 1443614 system_pods.go:89] "calico-node-gdclv" [c3b760c9-294a-4405-8868-bb0f92072326] Pending / Initialized:ContainersNotInitialized (containers with incomplete status: [upgrade-ipam install-cni mount-bpffs]) / Ready:ContainersNotReady (containers with unready status: [calico-node]) / ContainersReady:ContainersNotReady (containers with unready status: [calico-node])
I0929 14:03:28.348661 1443614 system_pods.go:89] "coredns-66bc5c9577-dtx77" [2bc59934-92af-4922-b611-33e8e48fc6ba] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0929 14:03:28.348670 1443614 system_pods.go:89] "coredns-66bc5c9577-h2v7h" [350216d3-c01e-4300-9df5-c78fd19ba429] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0929 14:03:28.348675 1443614 system_pods.go:89] "etcd-calico-212797" [39d7c3e7-991f-4447-9c23-60b46f63a128] Running
I0929 14:03:28.348680 1443614 system_pods.go:89] "kube-apiserver-calico-212797" [11e6dfd0-7b98-4d6a-93eb-abf6dc6c55fa] Running
I0929 14:03:28.348692 1443614 system_pods.go:89] "kube-controller-manager-calico-212797" [973ada77-667a-42fa-be15-dbcaa1dfec1d] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
I0929 14:03:28.348702 1443614 system_pods.go:89] "kube-proxy-q2pqh" [2f541a0a-a431-4db5-9e21-6af570318f7a] Pending / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0929 14:03:28.348707 1443614 system_pods.go:89] "kube-scheduler-calico-212797" [28d64b8e-cb58-4949-aeb7-de18e21cfe7e] Running
I0929 14:03:28.348713 1443614 system_pods.go:89] "storage-provisioner" [bd294ad1-3d5f-4e4d-bcbb-b2cdbd1b9aef] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0929 14:03:28.348737 1443614 retry.go:31] will retry after 324.735519ms: missing components: kube-proxy
I0929 14:03:28.677774 1443614 system_pods.go:86] 10 kube-system pods found
I0929 14:03:28.677855 1443614 system_pods.go:89] "calico-kube-controllers-59556d9b4c-zmjl5" [6eb0da5b-0c69-46c9-a600-4404a3b9b9d2] Pending / Ready:ContainersNotReady (containers with unready status: [calico-kube-controllers]) / ContainersReady:ContainersNotReady (containers with unready status: [calico-kube-controllers])
I0929 14:03:28.677898 1443614 system_pods.go:89] "calico-node-gdclv" [c3b760c9-294a-4405-8868-bb0f92072326] Pending / Initialized:ContainersNotInitialized (containers with incomplete status: [upgrade-ipam install-cni mount-bpffs]) / Ready:ContainersNotReady (containers with unready status: [calico-node]) / ContainersReady:ContainersNotReady (containers with unready status: [calico-node])
I0929 14:03:28.677920 1443614 system_pods.go:89] "coredns-66bc5c9577-dtx77" [2bc59934-92af-4922-b611-33e8e48fc6ba] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0929 14:03:28.677956 1443614 system_pods.go:89] "coredns-66bc5c9577-h2v7h" [350216d3-c01e-4300-9df5-c78fd19ba429] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0929 14:03:28.677978 1443614 system_pods.go:89] "etcd-calico-212797" [39d7c3e7-991f-4447-9c23-60b46f63a128] Running
I0929 14:03:28.677997 1443614 system_pods.go:89] "kube-apiserver-calico-212797" [11e6dfd0-7b98-4d6a-93eb-abf6dc6c55fa] Running
I0929 14:03:28.678029 1443614 system_pods.go:89] "kube-controller-manager-calico-212797" [973ada77-667a-42fa-be15-dbcaa1dfec1d] Running
I0929 14:03:28.678051 1443614 system_pods.go:89] "kube-proxy-q2pqh" [2f541a0a-a431-4db5-9e21-6af570318f7a] Running
I0929 14:03:28.678068 1443614 system_pods.go:89] "kube-scheduler-calico-212797" [28d64b8e-cb58-4949-aeb7-de18e21cfe7e] Running
I0929 14:03:28.678087 1443614 system_pods.go:89] "storage-provisioner" [bd294ad1-3d5f-4e4d-bcbb-b2cdbd1b9aef] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0929 14:03:28.678120 1443614 system_pods.go:126] duration metric: took 627.026386ms to wait for k8s-apps to be running ...
I0929 14:03:28.678145 1443614 system_svc.go:44] waiting for kubelet service to be running ....
I0929 14:03:28.678231 1443614 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0929 14:03:28.693535 1443614 system_svc.go:56] duration metric: took 15.380228ms WaitForService to wait for kubelet
I0929 14:03:28.693608 1443614 kubeadm.go:578] duration metric: took 2.839711288s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0929 14:03:28.693643 1443614 node_conditions.go:102] verifying NodePressure condition ...
I0929 14:03:28.697487 1443614 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0929 14:03:28.697568 1443614 node_conditions.go:123] node cpu capacity is 2
I0929 14:03:28.697595 1443614 node_conditions.go:105] duration metric: took 3.931177ms to run NodePressure ...
I0929 14:03:28.697619 1443614 start.go:241] waiting for startup goroutines ...
I0929 14:03:28.697652 1443614 start.go:246] waiting for cluster config update ...
I0929 14:03:28.697681 1443614 start.go:255] writing updated cluster config ...
I0929 14:03:28.698004 1443614 ssh_runner.go:195] Run: rm -f paused
I0929 14:03:28.702079 1443614 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I0929 14:03:28.706880 1443614 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-dtx77" in "kube-system" namespace to be "Ready" or be gone ...
W0929 14:03:30.713408 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-dtx77" is not "Ready", error: <nil>
W0929 14:03:32.724482 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-dtx77" is not "Ready", error: <nil>
W0929 14:03:35.216064 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-dtx77" is not "Ready", error: <nil>
W0929 14:03:37.227032 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-dtx77" is not "Ready", error: <nil>
W0929 14:03:39.716485 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-dtx77" is not "Ready", error: <nil>
W0929 14:03:42.214897 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-dtx77" is not "Ready", error: <nil>
W0929 14:03:44.713500 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-dtx77" is not "Ready", error: <nil>
W0929 14:03:46.722039 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-dtx77" is not "Ready", error: <nil>
W0929 14:03:49.229702 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-dtx77" is not "Ready", error: <nil>
W0929 14:03:51.230492 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-dtx77" is not "Ready", error: <nil>
W0929 14:03:53.232367 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-dtx77" is not "Ready", error: <nil>
W0929 14:03:55.284331 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-dtx77" is not "Ready", error: <nil>
I0929 14:03:56.213202 1443614 pod_ready.go:99] pod "coredns-66bc5c9577-dtx77" in "kube-system" namespace is gone: getting pod "coredns-66bc5c9577-dtx77" in "kube-system" namespace (will retry): pods "coredns-66bc5c9577-dtx77" not found
I0929 14:03:56.213231 1443614 pod_ready.go:86] duration metric: took 27.506279803s for pod "coredns-66bc5c9577-dtx77" in "kube-system" namespace to be "Ready" or be gone ...
I0929 14:03:56.213242 1443614 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-h2v7h" in "kube-system" namespace to be "Ready" or be gone ...
W0929 14:03:58.219291 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:00.257774 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:02.722464 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:05.223787 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:07.719796 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:09.727494 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:12.218796 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:14.218891 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:16.240834 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:18.731130 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:20.736948 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:23.224038 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:25.719686 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:27.719753 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:29.719917 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:32.223125 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:34.722191 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:37.224391 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:39.719137 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:41.721330 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:44.220570 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:46.221131 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:48.720277 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:50.724792 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:52.749745 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:55.224226 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:57.236714 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:04:59.721926 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:02.218503 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:04.219144 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:06.224971 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:08.719104 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:11.218587 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:13.220925 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:15.721831 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:18.219940 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:20.718759 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:22.721588 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:25.226897 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:27.722216 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:29.725486 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:32.222512 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:34.226345 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:36.721303 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:38.721348 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:41.232061 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:43.727458 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:46.238724 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:48.722236 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:51.222984 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:53.719841 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:56.219566 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:05:58.220124 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:00.226836 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:02.721044 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:04.722282 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:06.722747 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:09.218442 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:11.218904 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:13.227873 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:15.720088 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:18.221021 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:20.719358 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:22.720730 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:25.219714 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:27.221546 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:29.719202 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:31.719441 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:34.218645 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:36.219890 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:38.720195 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:41.220786 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:43.719242 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:45.719462 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:48.218499 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:50.219638 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:52.722933 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:55.218844 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:06:57.718913 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:07:00.242284 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:07:02.721565 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:07:04.727174 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:07:07.221759 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:07:09.719699 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:07:12.219638 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:07:14.221528 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:07:16.718274 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:07:18.720660 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:07:20.732828 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:07:23.223988 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:07:25.740733 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
W0929 14:07:28.225121 1443614 pod_ready.go:104] pod "coredns-66bc5c9577-h2v7h" is not "Ready", error: <nil>
I0929 14:07:28.702351 1443614 pod_ready.go:86] duration metric: took 3m32.489093122s for pod "coredns-66bc5c9577-h2v7h" in "kube-system" namespace to be "Ready" or be gone ...
W0929 14:07:28.702379 1443614 pod_ready.go:65] not all pods in "kube-system" namespace with "k8s-app=kube-dns" label are "Ready", will retry: waitPodCondition: context deadline exceeded
I0929 14:07:28.702393 1443614 pod_ready.go:40] duration metric: took 4m0.00024189s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
I0929 14:07:28.706721 1443614 out.go:203]
W0929 14:07:28.709949 1443614 out.go:285] X Exiting due to GUEST_START: extra waiting: WaitExtra: context deadline exceeded
X Exiting due to GUEST_START: extra waiting: WaitExtra: context deadline exceeded
I0929 14:07:28.713278 1443614 out.go:203]
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/calico/Start (288.95s)