=== RUN TestNetworkPlugins/group/cilium/Start
net_test.go:99: (dbg) Run: out/minikube-windows-amd64.exe start -p cilium-20220329190230-1328 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker
=== CONT TestNetworkPlugins/group/cilium/Start
net_test.go:99: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p cilium-20220329190230-1328 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker: exit status 80 (15m30.8350215s)
-- stdout --
* [cilium-20220329190230-1328] minikube v1.25.2 on Microsoft Windows 10 Enterprise N 10.0.19042 Build 19042
- KUBECONFIG=C:\Users\jenkins.minikube8\minikube-integration\kubeconfig
- MINIKUBE_HOME=C:\Users\jenkins.minikube8\minikube-integration\.minikube
- MINIKUBE_LOCATION=13730
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
* Using the docker driver based on user configuration
* Starting control plane node cilium-20220329190230-1328 in cluster cilium-20220329190230-1328
* Pulling base image ...
* Creating docker container (CPUs=2, Memory=2048MB) ...
* docker "cilium-20220329190230-1328" container is missing, will recreate.
* Creating docker container (CPUs=2, Memory=2048MB) ...
* Preparing Kubernetes v1.23.5 on Docker 20.10.13 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Configuring RBAC rules ...
* Configuring Cilium (Container Networking Interface) ...
* Verifying Kubernetes components...
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
* Enabled addons: default-storageclass, storage-provisioner
-- /stdout --
** stderr **
I0329 19:13:20.329538 8332 out.go:297] Setting OutFile to fd 1952 ...
I0329 19:13:20.407084 8332 out.go:344] TERM=,COLORTERM=, which probably does not support color
I0329 19:13:20.407084 8332 out.go:310] Setting ErrFile to fd 1956...
I0329 19:13:20.407084 8332 out.go:344] TERM=,COLORTERM=, which probably does not support color
I0329 19:13:20.418084 8332 out.go:304] Setting JSON to false
I0329 19:13:20.433072 8332 start.go:114] hostinfo: {"hostname":"minikube8","uptime":8397,"bootTime":1648572803,"procs":155,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19042 Build 19042","kernelVersion":"10.0.19042 Build 19042","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"907a2b8c-8800-4f4e-912a-028cf331db55"}
W0329 19:13:20.433072 8332 start.go:122] gopshost.Virtualization returned error: not implemented yet
I0329 19:13:20.439072 8332 out.go:176] * [cilium-20220329190230-1328] minikube v1.25.2 on Microsoft Windows 10 Enterprise N 10.0.19042 Build 19042
I0329 19:13:20.439072 8332 notify.go:193] Checking for updates...
I0329 19:13:20.447085 8332 out.go:176] - KUBECONFIG=C:\Users\jenkins.minikube8\minikube-integration\kubeconfig
I0329 19:13:20.453072 8332 out.go:176] - MINIKUBE_HOME=C:\Users\jenkins.minikube8\minikube-integration\.minikube
I0329 19:13:20.456069 8332 out.go:176] - MINIKUBE_LOCATION=13730
I0329 19:13:20.459071 8332 out.go:176] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0329 19:13:20.460080 8332 config.go:176] Loaded profile config "auto-20220329190226-1328": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.5
I0329 19:13:20.460080 8332 config.go:176] Loaded profile config "cert-expiration-20220329190729-1328": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.5
I0329 19:13:20.462071 8332 config.go:176] Loaded profile config "force-systemd-env-20220329190726-1328": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.5
I0329 19:13:20.462071 8332 driver.go:346] Setting default libvirt URI to qemu:///system
I0329 19:13:22.802095 8332 docker.go:137] docker version: linux-20.10.13
I0329 19:13:22.811013 8332 cli_runner.go:133] Run: docker system info --format "{{json .}}"
I0329 19:13:23.572130 8332 info.go:263] docker info: {ID:EWJC:D32H:QDOV:Q37U:7NCG:FSEF:BHRI:5KZE:BNL5:7NRS:WK2R:WXHN Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:75 OomKillDisable:true NGoroutines:55 SystemTime:2022-03-29 19:13:23.1952777 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_
64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.13 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2a1d4dbdb2a1030dc5b01e96fb110a9d9f150ecc Expected:2a1d4dbdb2a1030dc5b01e96fb110a9d9f150ecc} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,
profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.0] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.3.3] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0329 19:13:23.866992 8332 out.go:176] * Using the docker driver based on user configuration
I0329 19:13:23.867137 8332 start.go:283] selected driver: docker
I0329 19:13:23.867137 8332 start.go:800] validating driver "docker" against <nil>
I0329 19:13:23.867206 8332 start.go:811] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0329 19:13:24.000841 8332 cli_runner.go:133] Run: docker system info --format "{{json .}}"
I0329 19:13:24.747440 8332 info.go:263] docker info: {ID:EWJC:D32H:QDOV:Q37U:7NCG:FSEF:BHRI:5KZE:BNL5:7NRS:WK2R:WXHN Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:75 OomKillDisable:true NGoroutines:55 SystemTime:2022-03-29 19:13:24.3531151 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_
64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.13 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2a1d4dbdb2a1030dc5b01e96fb110a9d9f150ecc Expected:2a1d4dbdb2a1030dc5b01e96fb110a9d9f150ecc} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,
profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.0] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.3.3] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0329 19:13:24.747440 8332 start_flags.go:292] no existing cluster config was found, will generate one from the flags
I0329 19:13:24.748731 8332 start_flags.go:837] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0329 19:13:24.748731 8332 cni.go:93] Creating CNI manager for "cilium"
I0329 19:13:24.748731 8332 start_flags.go:301] Found "Cilium" CNI - setting NetworkPlugin=cni
I0329 19:13:24.748731 8332 start_flags.go:306] config:
{Name:cilium-20220329190230-1328 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.5 ClusterName:cilium-20220329190230-1328 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntim
e:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube8:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}
I0329 19:13:24.754435 8332 out.go:176] * Starting control plane node cilium-20220329190230-1328 in cluster cilium-20220329190230-1328
I0329 19:13:24.754435 8332 cache.go:120] Beginning downloading kic base image for docker with docker
I0329 19:13:24.758742 8332 out.go:176] * Pulling base image ...
I0329 19:13:24.758742 8332 preload.go:132] Checking if preload exists for k8s version v1.23.5 and runtime docker
I0329 19:13:24.758742 8332 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 in local docker daemon
I0329 19:13:24.758742 8332 preload.go:148] Found local preload: C:\Users\jenkins.minikube8\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v17-v1.23.5-docker-overlay2-amd64.tar.lz4
I0329 19:13:24.758742 8332 cache.go:57] Caching tarball of preloaded images
I0329 19:13:24.759439 8332 preload.go:174] Found C:\Users\jenkins.minikube8\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v17-v1.23.5-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0329 19:13:24.759439 8332 cache.go:60] Finished verifying existence of preloaded tar for v1.23.5 on docker
I0329 19:13:24.759439 8332 profile.go:148] Saving config to C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\config.json ...
I0329 19:13:24.759439 8332 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\config.json: {Name:mkda0bb1e0c9f1f765c93dfe294b192747c3f86a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 19:13:25.224346 8332 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 in local docker daemon, skipping pull
I0329 19:13:25.224346 8332 cache.go:142] gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 exists in daemon, skipping load
I0329 19:13:25.224346 8332 cache.go:208] Successfully downloaded all kic artifacts
I0329 19:13:25.224346 8332 start.go:348] acquiring machines lock for cilium-20220329190230-1328: {Name:mk08cde73fc530b56f1c9b9e81f20c149672fd7f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0329 19:13:25.224346 8332 start.go:352] acquired machines lock for "cilium-20220329190230-1328" in 0s
I0329 19:13:25.224346 8332 start.go:90] Provisioning new machine with config: &{Name:cilium-20220329190230-1328 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.5 ClusterName:cilium-20220329190230-1328 Namespace:default APIServerName:mi
nikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.23.5 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube8:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizati
ons:false DisableMetrics:false} &{Name: IP: Port:8443 KubernetesVersion:v1.23.5 ContainerRuntime:docker ControlPlane:true Worker:true}
I0329 19:13:25.224346 8332 start.go:127] createHost starting for "" (driver="docker")
I0329 19:13:25.230387 8332 out.go:203] * Creating docker container (CPUs=2, Memory=2048MB) ...
I0329 19:13:25.230387 8332 start.go:161] libmachine.API.Create for "cilium-20220329190230-1328" (driver="docker")
I0329 19:13:25.230387 8332 client.go:168] LocalClient.Create starting
I0329 19:13:25.231350 8332 main.go:130] libmachine: Reading certificate data from C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca.pem
I0329 19:13:25.231350 8332 main.go:130] libmachine: Decoding PEM data...
I0329 19:13:25.231350 8332 main.go:130] libmachine: Parsing certificate...
I0329 19:13:25.231350 8332 main.go:130] libmachine: Reading certificate data from C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\cert.pem
I0329 19:13:25.231350 8332 main.go:130] libmachine: Decoding PEM data...
I0329 19:13:25.231350 8332 main.go:130] libmachine: Parsing certificate...
I0329 19:13:25.240352 8332 cli_runner.go:133] Run: docker network inspect cilium-20220329190230-1328 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0329 19:13:25.749343 8332 cli_runner.go:180] docker network inspect cilium-20220329190230-1328 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0329 19:13:25.756354 8332 network_create.go:262] running [docker network inspect cilium-20220329190230-1328] to gather additional debugging logs...
I0329 19:13:25.756354 8332 cli_runner.go:133] Run: docker network inspect cilium-20220329190230-1328
W0329 19:13:26.254088 8332 cli_runner.go:180] docker network inspect cilium-20220329190230-1328 returned with exit code 1
I0329 19:13:26.254088 8332 network_create.go:265] error running [docker network inspect cilium-20220329190230-1328]: docker network inspect cilium-20220329190230-1328: exit status 1
stdout:
[]
stderr:
Error: No such network: cilium-20220329190230-1328
I0329 19:13:26.254088 8332 network_create.go:267] output of [docker network inspect cilium-20220329190230-1328]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: cilium-20220329190230-1328
** /stderr **
I0329 19:13:26.263853 8332 cli_runner.go:133] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0329 19:13:26.784896 8332 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc000614168] misses:0}
I0329 19:13:26.784896 8332 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0329 19:13:26.784896 8332 network_create.go:114] attempt to create docker network cilium-20220329190230-1328 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0329 19:13:26.791904 8332 cli_runner.go:133] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true cilium-20220329190230-1328
I0329 19:13:27.438778 8332 network_create.go:98] docker network cilium-20220329190230-1328 192.168.49.0/24 created
I0329 19:13:27.438778 8332 kic.go:106] calculated static IP "192.168.49.2" for the "cilium-20220329190230-1328" container
I0329 19:13:27.452766 8332 cli_runner.go:133] Run: docker ps -a --format {{.Names}}
I0329 19:13:27.948967 8332 cli_runner.go:133] Run: docker volume create cilium-20220329190230-1328 --label name.minikube.sigs.k8s.io=cilium-20220329190230-1328 --label created_by.minikube.sigs.k8s.io=true
I0329 19:13:28.453353 8332 oci.go:102] Successfully created a docker volume cilium-20220329190230-1328
I0329 19:13:28.459356 8332 cli_runner.go:133] Run: docker run --rm --name cilium-20220329190230-1328-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220329190230-1328 --entrypoint /usr/bin/test -v cilium-20220329190230-1328:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -d /var/lib
I0329 19:13:32.039742 8332 cli_runner.go:186] Completed: docker run --rm --name cilium-20220329190230-1328-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220329190230-1328 --entrypoint /usr/bin/test -v cilium-20220329190230-1328:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -d /var/lib: (3.5793041s)
I0329 19:13:32.039823 8332 oci.go:106] Successfully prepared a docker volume cilium-20220329190230-1328
I0329 19:13:32.039823 8332 preload.go:132] Checking if preload exists for k8s version v1.23.5 and runtime docker
I0329 19:13:32.039886 8332 kic.go:179] Starting extracting preloaded images to volume ...
I0329 19:13:32.049239 8332 cli_runner.go:133] Run: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube8\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v17-v1.23.5-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v cilium-20220329190230-1328:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -I lz4 -xf /preloaded.tar -C /extractDir
I0329 19:14:12.749715 8332 cli_runner.go:186] Completed: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube8\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v17-v1.23.5-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v cilium-20220329190230-1328:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -I lz4 -xf /preloaded.tar -C /extractDir: (40.7002342s)
I0329 19:14:12.749715 8332 kic.go:188] duration metric: took 40.709587 seconds to extract preloaded images to volume
I0329 19:14:12.756712 8332 cli_runner.go:133] Run: docker system info --format "{{json .}}"
I0329 19:14:13.495778 8332 info.go:263] docker info: {ID:EWJC:D32H:QDOV:Q37U:7NCG:FSEF:BHRI:5KZE:BNL5:7NRS:WK2R:WXHN Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:57 OomKillDisable:true NGoroutines:50 SystemTime:2022-03-29 19:14:13.1249753 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_
64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.13 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2a1d4dbdb2a1030dc5b01e96fb110a9d9f150ecc Expected:2a1d4dbdb2a1030dc5b01e96fb110a9d9f150ecc} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,
profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.0] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.3.3] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0329 19:14:13.503752 8332 cli_runner.go:133] Run: docker info --format "'{{json .SecurityOptions}}'"
I0329 19:14:14.226348 8332 cli_runner.go:133] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname cilium-20220329190230-1328 --name cilium-20220329190230-1328 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220329190230-1328 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=cilium-20220329190230-1328 --network cilium-20220329190230-1328 --ip 192.168.49.2 --volume cilium-20220329190230-1328:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5
W0329 19:14:15.647360 8332 cli_runner.go:180] docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname cilium-20220329190230-1328 --name cilium-20220329190230-1328 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220329190230-1328 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=cilium-20220329190230-1328 --network cilium-20220329190230-1328 --ip 192.168.49.2 --volume cilium-20220329190230-1328:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 returned with exit code 125
I0329 19:14:15.647502 8332 cli_runner.go:186] Completed: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname cilium-20220329190230-1328 --name cilium-20220329190230-1328 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220329190230-1328 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=cilium-20220329190230-1328 --network cilium-20220329190230-1328 --ip 192.168.49.2 --volume cilium-20220329190230-1328:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5: (1.42091s)
I0329 19:14:15.647502 8332 client.go:171] LocalClient.Create took 50.4168154s
I0329 19:14:17.675948 8332 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0329 19:14:17.683242 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
W0329 19:14:18.192245 8332 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328 returned with exit code 1
I0329 19:14:18.192245 8332 retry.go:31] will retry after 276.165072ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
I0329 19:14:18.481672 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
W0329 19:14:18.930753 8332 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328 returned with exit code 1
I0329 19:14:18.930810 8332 retry.go:31] will retry after 540.190908ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
I0329 19:14:19.480676 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
W0329 19:14:19.958041 8332 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328 returned with exit code 1
W0329 19:14:19.958041 8332 start.go:277] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
W0329 19:14:19.958041 8332 start.go:244] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
I0329 19:14:19.967041 8332 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0329 19:14:19.973050 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
W0329 19:14:20.431288 8332 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328 returned with exit code 1
I0329 19:14:20.431573 8332 retry.go:31] will retry after 234.428547ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
I0329 19:14:20.681952 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
W0329 19:14:21.132225 8332 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328 returned with exit code 1
I0329 19:14:21.132225 8332 retry.go:31] will retry after 346.739061ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
I0329 19:14:21.496610 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
W0329 19:14:21.976903 8332 cli_runner.go:180] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328 returned with exit code 1
W0329 19:14:21.976903 8332 start.go:292] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
W0329 19:14:21.976903 8332 start.go:249] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
I0329 19:14:21.976903 8332 start.go:130] duration metric: createHost completed in 56.7522201s
I0329 19:14:21.976903 8332 start.go:81] releasing machines lock for "cilium-20220329190230-1328", held for 56.7522201s
W0329 19:14:21.976903 8332 start.go:570] error starting host: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname cilium-20220329190230-1328 --name cilium-20220329190230-1328 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220329190230-1328 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=cilium-20220329190230-1328 --network cilium-20220329190230-1328 --ip 192.168.49.2 --volume cilium-20220329190230-1328:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5: exit status 1
25
stdout:
c4107637dd3b7afc7bc72f7ccceb100bd4d5d976f19a845635c733b299834bef
stderr:
docker: Error response from daemon: network cilium-20220329190230-1328 not found.
I0329 19:14:21.993889 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
W0329 19:14:22.496523 8332 start.go:575] delete host: Docker machine "cilium-20220329190230-1328" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
W0329 19:14:22.496523 8332 out.go:241] ! StartHost failed, but will try again: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname cilium-20220329190230-1328 --name cilium-20220329190230-1328 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220329190230-1328 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=cilium-20220329190230-1328 --network cilium-20220329190230-1328 --ip 192.168.49.2 --volume cilium-20220329190230-1328:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347
b5: exit status 125
stdout:
c4107637dd3b7afc7bc72f7ccceb100bd4d5d976f19a845635c733b299834bef
stderr:
docker: Error response from daemon: network cilium-20220329190230-1328 not found.
! StartHost failed, but will try again: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname cilium-20220329190230-1328 --name cilium-20220329190230-1328 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220329190230-1328 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=cilium-20220329190230-1328 --network cilium-20220329190230-1328 --ip 192.168.49.2 --volume cilium-20220329190230-1328:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5: exit status 125
stdout:
c4107637dd3b7afc7bc72f7ccceb100bd4d5d976f19a845635c733b299834bef
stderr:
docker: Error response from daemon: network cilium-20220329190230-1328 not found.
I0329 19:14:22.496523 8332 start.go:585] Will try again in 5 seconds ...
I0329 19:14:27.501533 8332 start.go:348] acquiring machines lock for cilium-20220329190230-1328: {Name:mk08cde73fc530b56f1c9b9e81f20c149672fd7f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0329 19:14:27.501916 8332 start.go:352] acquired machines lock for "cilium-20220329190230-1328" in 127µs
I0329 19:14:27.502212 8332 start.go:94] Skipping create...Using existing machine configuration
I0329 19:14:27.502212 8332 fix.go:55] fixHost starting:
I0329 19:14:27.519219 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:14:27.974851 8332 fix.go:108] recreateIfNeeded on cilium-20220329190230-1328: state= err=<nil>
I0329 19:14:27.975281 8332 fix.go:113] machineExists: false. err=machine does not exist
I0329 19:14:27.978605 8332 out.go:176] * docker "cilium-20220329190230-1328" container is missing, will recreate.
I0329 19:14:27.979597 8332 delete.go:124] DEMOLISHING cilium-20220329190230-1328 ...
I0329 19:14:28.006174 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:14:28.495492 8332 stop.go:79] host is in state
I0329 19:14:28.495809 8332 main.go:130] libmachine: Stopping "cilium-20220329190230-1328"...
I0329 19:14:28.511813 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:14:29.007429 8332 kic_runner.go:93] Run: systemctl --version
I0329 19:14:29.007429 8332 kic_runner.go:114] Args: [docker exec --privileged cilium-20220329190230-1328 systemctl --version]
I0329 19:14:29.611531 8332 kic_runner.go:93] Run: sudo service kubelet stop
I0329 19:14:29.611531 8332 kic_runner.go:114] Args: [docker exec --privileged cilium-20220329190230-1328 sudo service kubelet stop]
I0329 19:14:30.237449 8332 openrc.go:165] stop output:
** stderr **
Error response from daemon: Container c4107637dd3b7afc7bc72f7ccceb100bd4d5d976f19a845635c733b299834bef is not running
** /stderr **
W0329 19:14:30.237597 8332 kic.go:443] couldn't stop kubelet. will continue with stop anyways: sudo service kubelet stop: exit status 1
stdout:
stderr:
Error response from daemon: Container c4107637dd3b7afc7bc72f7ccceb100bd4d5d976f19a845635c733b299834bef is not running
I0329 19:14:30.255017 8332 kic_runner.go:93] Run: sudo service kubelet stop
I0329 19:14:30.255017 8332 kic_runner.go:114] Args: [docker exec --privileged cilium-20220329190230-1328 sudo service kubelet stop]
I0329 19:14:30.907393 8332 openrc.go:165] stop output:
** stderr **
Error response from daemon: Container c4107637dd3b7afc7bc72f7ccceb100bd4d5d976f19a845635c733b299834bef is not running
** /stderr **
W0329 19:14:30.907393 8332 kic.go:445] couldn't force stop kubelet. will continue with stop anyways: sudo service kubelet stop: exit status 1
stdout:
stderr:
Error response from daemon: Container c4107637dd3b7afc7bc72f7ccceb100bd4d5d976f19a845635c733b299834bef is not running
I0329 19:14:30.924393 8332 kic_runner.go:93] Run: docker ps -a --filter=name=k8s_.*_(kube-system|kubernetes-dashboard|storage-gluster|istio-operator)_ --format={{.ID}}
I0329 19:14:30.924393 8332 kic_runner.go:114] Args: [docker exec --privileged cilium-20220329190230-1328 docker ps -a --filter=name=k8s_.*_(kube-system|kubernetes-dashboard|storage-gluster|istio-operator)_ --format={{.ID}}]
I0329 19:14:31.573499 8332 kic.go:456] unable list containers : docker: docker ps -a --filter=name=k8s_.*_(kube-system|kubernetes-dashboard|storage-gluster|istio-operator)_ --format={{.ID}}: exit status 1
stdout:
stderr:
Error response from daemon: Container c4107637dd3b7afc7bc72f7ccceb100bd4d5d976f19a845635c733b299834bef is not running
I0329 19:14:31.573499 8332 kic.go:466] successfully stopped kubernetes!
I0329 19:14:31.592504 8332 kic_runner.go:93] Run: pgrep kube-apiserver
I0329 19:14:31.592504 8332 kic_runner.go:114] Args: [docker exec --privileged cilium-20220329190230-1328 pgrep kube-apiserver]
I0329 19:14:32.806350 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:14:36.321474 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:14:39.821599 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:14:43.327423 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:14:46.812356 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:14:50.279659 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:14:53.784031 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:14:57.323769 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:00.865625 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:04.364257 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:07.843377 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:11.374112 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:14.833984 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:18.346018 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:21.839831 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:25.303663 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:28.762213 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:32.264160 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:35.729405 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:39.512291 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:42.979358 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:46.477279 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:49.989991 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:53.479504 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:15:56.948193 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:00.417681 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:03.909234 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:07.395226 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:10.901920 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:14.374872 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:17.851221 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:21.328880 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:24.809421 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:28.320009 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:31.816793 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:35.333832 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:38.824194 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:42.307731 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:45.807089 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:49.305718 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:52.798922 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:56.313890 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:16:59.836322 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:03.403038 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:06.904873 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:10.479959 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:14.082879 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:17.624185 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:21.136015 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:24.685013 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:28.213734 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:31.714399 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:35.233330 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:38.843325 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:42.402551 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:45.938694 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:49.454870 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:52.986902 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:17:56.489353 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:18:00.021135 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:18:03.507172 8332 stop.go:59] stop err: Maximum number of retries (60) exceeded
I0329 19:18:03.507172 8332 delete.go:129] stophost failed (probably ok): Temporary Error: stop: Maximum number of retries (60) exceeded
I0329 19:18:03.533496 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
W0329 19:18:04.069962 8332 delete.go:135] deletehost failed: Docker machine "cilium-20220329190230-1328" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
I0329 19:18:04.077704 8332 cli_runner.go:133] Run: docker container inspect -f {{.Id}} cilium-20220329190230-1328
I0329 19:18:04.600810 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:18:05.090393 8332 cli_runner.go:133] Run: docker exec --privileged -t cilium-20220329190230-1328 /bin/bash -c "sudo init 0"
W0329 19:18:05.672679 8332 cli_runner.go:180] docker exec --privileged -t cilium-20220329190230-1328 /bin/bash -c "sudo init 0" returned with exit code 1
I0329 19:18:05.672781 8332 oci.go:656] error shutdown cilium-20220329190230-1328: docker exec --privileged -t cilium-20220329190230-1328 /bin/bash -c "sudo init 0": exit status 1
stdout:
stderr:
Error response from daemon: Container c4107637dd3b7afc7bc72f7ccceb100bd4d5d976f19a845635c733b299834bef is not running
I0329 19:18:06.681210 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:18:07.181772 8332 oci.go:670] temporary error: container cilium-20220329190230-1328 status is but expect it to be exited
I0329 19:18:07.181772 8332 oci.go:676] Successfully shutdown container cilium-20220329190230-1328
I0329 19:18:07.188781 8332 cli_runner.go:133] Run: docker rm -f -v cilium-20220329190230-1328
I0329 19:18:16.145751 8332 cli_runner.go:186] Completed: docker rm -f -v cilium-20220329190230-1328: (8.9569192s)
I0329 19:18:16.153565 8332 cli_runner.go:133] Run: docker container inspect -f {{.Id}} cilium-20220329190230-1328
W0329 19:18:16.627733 8332 cli_runner.go:180] docker container inspect -f {{.Id}} cilium-20220329190230-1328 returned with exit code 1
I0329 19:18:16.634737 8332 cli_runner.go:133] Run: docker network inspect cilium-20220329190230-1328 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0329 19:18:17.107264 8332 cli_runner.go:180] docker network inspect cilium-20220329190230-1328 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0329 19:18:17.119693 8332 network_create.go:262] running [docker network inspect cilium-20220329190230-1328] to gather additional debugging logs...
I0329 19:18:17.119693 8332 cli_runner.go:133] Run: docker network inspect cilium-20220329190230-1328
W0329 19:18:17.583398 8332 cli_runner.go:180] docker network inspect cilium-20220329190230-1328 returned with exit code 1
I0329 19:18:17.583398 8332 network_create.go:265] error running [docker network inspect cilium-20220329190230-1328]: docker network inspect cilium-20220329190230-1328: exit status 1
stdout:
[]
stderr:
Error: No such network: cilium-20220329190230-1328
I0329 19:18:17.583398 8332 network_create.go:267] output of [docker network inspect cilium-20220329190230-1328]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: cilium-20220329190230-1328
** /stderr **
W0329 19:18:17.584615 8332 delete.go:139] delete failed (probably ok) <nil>
I0329 19:18:17.584615 8332 fix.go:120] Sleeping 1 second for extra luck!
I0329 19:18:18.590842 8332 start.go:127] createHost starting for "" (driver="docker")
I0329 19:18:18.596546 8332 out.go:203] * Creating docker container (CPUs=2, Memory=2048MB) ...
I0329 19:18:18.596546 8332 start.go:161] libmachine.API.Create for "cilium-20220329190230-1328" (driver="docker")
I0329 19:18:18.596546 8332 client.go:168] LocalClient.Create starting
I0329 19:18:18.597645 8332 main.go:130] libmachine: Reading certificate data from C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca.pem
I0329 19:18:18.597849 8332 main.go:130] libmachine: Decoding PEM data...
I0329 19:18:18.597932 8332 main.go:130] libmachine: Parsing certificate...
I0329 19:18:18.598120 8332 main.go:130] libmachine: Reading certificate data from C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\cert.pem
I0329 19:18:18.598331 8332 main.go:130] libmachine: Decoding PEM data...
I0329 19:18:18.598424 8332 main.go:130] libmachine: Parsing certificate...
I0329 19:18:18.609504 8332 cli_runner.go:133] Run: docker network inspect cilium-20220329190230-1328 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0329 19:18:19.076239 8332 cli_runner.go:180] docker network inspect cilium-20220329190230-1328 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0329 19:18:19.084550 8332 network_create.go:262] running [docker network inspect cilium-20220329190230-1328] to gather additional debugging logs...
I0329 19:18:19.084550 8332 cli_runner.go:133] Run: docker network inspect cilium-20220329190230-1328
W0329 19:18:19.541824 8332 cli_runner.go:180] docker network inspect cilium-20220329190230-1328 returned with exit code 1
I0329 19:18:19.542006 8332 network_create.go:265] error running [docker network inspect cilium-20220329190230-1328]: docker network inspect cilium-20220329190230-1328: exit status 1
stdout:
[]
stderr:
Error: No such network: cilium-20220329190230-1328
I0329 19:18:19.542006 8332 network_create.go:267] output of [docker network inspect cilium-20220329190230-1328]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: cilium-20220329190230-1328
** /stderr **
I0329 19:18:19.549704 8332 cli_runner.go:133] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0329 19:18:20.011150 8332 network.go:284] reusing subnet 192.168.49.0 that has expired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000614168] amended:false}} dirty:map[] misses:0}
I0329 19:18:20.011150 8332 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0329 19:18:20.011150 8332 network_create.go:114] attempt to create docker network cilium-20220329190230-1328 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0329 19:18:20.019847 8332 cli_runner.go:133] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true cilium-20220329190230-1328
W0329 19:18:20.471587 8332 cli_runner.go:180] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true cilium-20220329190230-1328 returned with exit code 1
W0329 19:18:20.471665 8332 network_create.go:106] failed to create docker network cilium-20220329190230-1328 192.168.49.0/24, will retry: subnet is taken
I0329 19:18:20.492607 8332 network.go:279] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000614168] amended:false}} dirty:map[] misses:0}
I0329 19:18:20.492607 8332 network.go:238] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0329 19:18:20.508171 8332 network.go:288] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000614168] amended:true}} dirty:map[192.168.49.0:0xc000614168 192.168.58.0:0xc000bc2398] misses:0}
I0329 19:18:20.508171 8332 network.go:235] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0329 19:18:20.508171 8332 network_create.go:114] attempt to create docker network cilium-20220329190230-1328 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I0329 19:18:20.516904 8332 cli_runner.go:133] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true cilium-20220329190230-1328
I0329 19:18:21.124271 8332 network_create.go:98] docker network cilium-20220329190230-1328 192.168.58.0/24 created
I0329 19:18:21.124915 8332 kic.go:106] calculated static IP "192.168.58.2" for the "cilium-20220329190230-1328" container
I0329 19:18:21.140451 8332 cli_runner.go:133] Run: docker ps -a --format {{.Names}}
I0329 19:18:21.596633 8332 cli_runner.go:133] Run: docker volume create cilium-20220329190230-1328 --label name.minikube.sigs.k8s.io=cilium-20220329190230-1328 --label created_by.minikube.sigs.k8s.io=true
I0329 19:18:22.028222 8332 oci.go:102] Successfully created a docker volume cilium-20220329190230-1328
I0329 19:18:22.036356 8332 cli_runner.go:133] Run: docker run --rm --name cilium-20220329190230-1328-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220329190230-1328 --entrypoint /usr/bin/test -v cilium-20220329190230-1328:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -d /var/lib
I0329 19:18:25.709447 8332 cli_runner.go:186] Completed: docker run --rm --name cilium-20220329190230-1328-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220329190230-1328 --entrypoint /usr/bin/test -v cilium-20220329190230-1328:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -d /var/lib: (3.6730707s)
I0329 19:18:25.709447 8332 oci.go:106] Successfully prepared a docker volume cilium-20220329190230-1328
I0329 19:18:25.709447 8332 preload.go:132] Checking if preload exists for k8s version v1.23.5 and runtime docker
I0329 19:18:25.709447 8332 kic.go:179] Starting extracting preloaded images to volume ...
I0329 19:18:25.716493 8332 cli_runner.go:133] Run: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube8\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v17-v1.23.5-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v cilium-20220329190230-1328:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -I lz4 -xf /preloaded.tar -C /extractDir
I0329 19:19:14.723792 8332 cli_runner.go:186] Completed: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube8\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v17-v1.23.5-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v cilium-20220329190230-1328:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -I lz4 -xf /preloaded.tar -C /extractDir: (49.0070193s)
I0329 19:19:14.723792 8332 kic.go:188] duration metric: took 49.014065 seconds to extract preloaded images to volume
I0329 19:19:14.731786 8332 cli_runner.go:133] Run: docker system info --format "{{json .}}"
I0329 19:19:15.431510 8332 info.go:263] docker info: {ID:EWJC:D32H:QDOV:Q37U:7NCG:FSEF:BHRI:5KZE:BNL5:7NRS:WK2R:WXHN Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:47 OomKillDisable:true NGoroutines:46 SystemTime:2022-03-29 19:19:15.0545074 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:2 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_
64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.13 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:2a1d4dbdb2a1030dc5b01e96fb110a9d9f150ecc Expected:2a1d4dbdb2a1030dc5b01e96fb110a9d9f150ecc} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,
profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.0] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.3.3] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}
I0329 19:19:15.440710 8332 cli_runner.go:133] Run: docker info --format "'{{json .SecurityOptions}}'"
I0329 19:19:16.136168 8332 cli_runner.go:133] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname cilium-20220329190230-1328 --name cilium-20220329190230-1328 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220329190230-1328 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=cilium-20220329190230-1328 --network cilium-20220329190230-1328 --ip 192.168.58.2 --volume cilium-20220329190230-1328:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5
I0329 19:19:18.620607 8332 cli_runner.go:186] Completed: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname cilium-20220329190230-1328 --name cilium-20220329190230-1328 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220329190230-1328 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=cilium-20220329190230-1328 --network cilium-20220329190230-1328 --ip 192.168.58.2 --volume cilium-20220329190230-1328:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5: (2.4838713s)
I0329 19:19:18.631599 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Running}}
I0329 19:19:19.157414 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:19:19.685402 8332 cli_runner.go:133] Run: docker exec cilium-20220329190230-1328 stat /var/lib/dpkg/alternatives/iptables
I0329 19:19:20.628970 8332 oci.go:278] the created container "cilium-20220329190230-1328" has a running status.
I0329 19:19:20.628970 8332 kic.go:210] Creating ssh key for kic: C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\cilium-20220329190230-1328\id_rsa...
I0329 19:19:20.812276 8332 kic_runner.go:191] docker (temp): C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\cilium-20220329190230-1328\id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0329 19:19:21.444349 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:19:21.914512 8332 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0329 19:19:21.914567 8332 kic_runner.go:114] Args: [docker exec --privileged cilium-20220329190230-1328 chown docker:docker /home/docker/.ssh/authorized_keys]
I0329 19:19:22.808600 8332 kic.go:250] ensuring only current user has permissions to key file located at : C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\cilium-20220329190230-1328\id_rsa...
I0329 19:19:23.342913 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:19:23.830758 8332 machine.go:88] provisioning docker machine ...
I0329 19:19:23.830866 8332 ubuntu.go:169] provisioning hostname "cilium-20220329190230-1328"
I0329 19:19:23.845256 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:24.365320 8332 main.go:130] libmachine: Using SSH client type: native
I0329 19:19:24.371889 8332 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x766c80] 0x769b40 <nil> [] 0s} 127.0.0.1 57409 <nil> <nil>}
I0329 19:19:24.371889 8332 main.go:130] libmachine: About to run SSH command:
sudo hostname cilium-20220329190230-1328 && echo "cilium-20220329190230-1328" | sudo tee /etc/hostname
I0329 19:19:24.614965 8332 main.go:130] libmachine: SSH cmd err, output: <nil>: cilium-20220329190230-1328
I0329 19:19:24.625245 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:25.139008 8332 main.go:130] libmachine: Using SSH client type: native
I0329 19:19:25.139525 8332 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x766c80] 0x769b40 <nil> [] 0s} 127.0.0.1 57409 <nil> <nil>}
I0329 19:19:25.139619 8332 main.go:130] libmachine: About to run SSH command:
if ! grep -xq '.*\scilium-20220329190230-1328' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 cilium-20220329190230-1328/g' /etc/hosts;
else
echo '127.0.1.1 cilium-20220329190230-1328' | sudo tee -a /etc/hosts;
fi
fi
I0329 19:19:25.343527 8332 main.go:130] libmachine: SSH cmd err, output: <nil>:
I0329 19:19:25.343527 8332 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube8\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube8\minikube-integration\.minikube}
I0329 19:19:25.343527 8332 ubuntu.go:177] setting up certificates
I0329 19:19:25.343527 8332 provision.go:83] configureAuth start
I0329 19:19:25.353673 8332 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cilium-20220329190230-1328
I0329 19:19:25.871901 8332 provision.go:138] copyHostCerts
I0329 19:19:25.871901 8332 exec_runner.go:144] found C:\Users\jenkins.minikube8\minikube-integration\.minikube/ca.pem, removing ...
I0329 19:19:25.871901 8332 exec_runner.go:207] rm: C:\Users\jenkins.minikube8\minikube-integration\.minikube\ca.pem
I0329 19:19:25.871901 8332 exec_runner.go:151] cp: C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube8\minikube-integration\.minikube/ca.pem (1078 bytes)
I0329 19:19:25.873140 8332 exec_runner.go:144] found C:\Users\jenkins.minikube8\minikube-integration\.minikube/cert.pem, removing ...
I0329 19:19:25.873140 8332 exec_runner.go:207] rm: C:\Users\jenkins.minikube8\minikube-integration\.minikube\cert.pem
I0329 19:19:25.873904 8332 exec_runner.go:151] cp: C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube8\minikube-integration\.minikube/cert.pem (1123 bytes)
I0329 19:19:25.874942 8332 exec_runner.go:144] found C:\Users\jenkins.minikube8\minikube-integration\.minikube/key.pem, removing ...
I0329 19:19:25.874942 8332 exec_runner.go:207] rm: C:\Users\jenkins.minikube8\minikube-integration\.minikube\key.pem
I0329 19:19:25.874942 8332 exec_runner.go:151] cp: C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube8\minikube-integration\.minikube/key.pem (1679 bytes)
I0329 19:19:25.876182 8332 provision.go:112] generating server cert: C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.cilium-20220329190230-1328 san=[192.168.58.2 127.0.0.1 localhost 127.0.0.1 minikube cilium-20220329190230-1328]
I0329 19:19:26.026809 8332 provision.go:172] copyRemoteCerts
I0329 19:19:26.037349 8332 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0329 19:19:26.047077 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:26.543365 8332 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57409 SSHKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\cilium-20220329190230-1328\id_rsa Username:docker}
I0329 19:19:26.687346 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0329 19:19:26.752287 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1249 bytes)
I0329 19:19:26.808001 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0329 19:19:26.868657 8332 provision.go:86] duration metric: configureAuth took 1.5251217s
I0329 19:19:26.868657 8332 ubuntu.go:193] setting minikube options for container-runtime
I0329 19:19:26.869912 8332 config.go:176] Loaded profile config "cilium-20220329190230-1328": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.5
I0329 19:19:26.881179 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:27.434652 8332 main.go:130] libmachine: Using SSH client type: native
I0329 19:19:27.434652 8332 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x766c80] 0x769b40 <nil> [] 0s} 127.0.0.1 57409 <nil> <nil>}
I0329 19:19:27.434652 8332 main.go:130] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0329 19:19:27.654714 8332 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay
I0329 19:19:27.655706 8332 ubuntu.go:71] root file system type: overlay
I0329 19:19:27.655706 8332 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0329 19:19:27.663716 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:28.153787 8332 main.go:130] libmachine: Using SSH client type: native
I0329 19:19:28.153787 8332 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x766c80] 0x769b40 <nil> [] 0s} 127.0.0.1 57409 <nil> <nil>}
I0329 19:19:28.154569 8332 main.go:130] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0329 19:19:28.391952 8332 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0329 19:19:28.403494 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:28.907052 8332 main.go:130] libmachine: Using SSH client type: native
I0329 19:19:28.907459 8332 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x766c80] 0x769b40 <nil> [] 0s} 127.0.0.1 57409 <nil> <nil>}
I0329 19:19:28.907459 8332 main.go:130] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0329 19:19:34.193728 8332 main.go:130] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2022-03-10 14:05:44.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2022-03-29 19:19:28.342870100 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0329 19:19:34.193728 8332 machine.go:91] provisioned docker machine in 10.3628582s
I0329 19:19:34.193728 8332 client.go:171] LocalClient.Create took 1m15.5961307s
I0329 19:19:34.193728 8332 start.go:169] duration metric: libmachine.API.Create for "cilium-20220329190230-1328" took 1m15.5967512s
I0329 19:19:34.193728 8332 start.go:302] post-start starting for "cilium-20220329190230-1328" (driver="docker")
I0329 19:19:34.193728 8332 start.go:312] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0329 19:19:34.215864 8332 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0329 19:19:34.227648 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:34.730662 8332 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57409 SSHKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\cilium-20220329190230-1328\id_rsa Username:docker}
I0329 19:19:34.894630 8332 ssh_runner.go:195] Run: cat /etc/os-release
I0329 19:19:34.910461 8332 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0329 19:19:34.910544 8332 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0329 19:19:34.910544 8332 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0329 19:19:34.910544 8332 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0329 19:19:34.910587 8332 filesync.go:126] Scanning C:\Users\jenkins.minikube8\minikube-integration\.minikube\addons for local assets ...
I0329 19:19:34.910899 8332 filesync.go:126] Scanning C:\Users\jenkins.minikube8\minikube-integration\.minikube\files for local assets ...
I0329 19:19:34.911723 8332 filesync.go:149] local asset: C:\Users\jenkins.minikube8\minikube-integration\.minikube\files\etc\ssl\certs\13282.pem -> 13282.pem in /etc/ssl/certs
I0329 19:19:34.924241 8332 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0329 19:19:34.951665 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\files\etc\ssl\certs\13282.pem --> /etc/ssl/certs/13282.pem (1708 bytes)
I0329 19:19:35.011396 8332 start.go:305] post-start completed in 817.6627ms
I0329 19:19:35.030197 8332 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cilium-20220329190230-1328
I0329 19:19:35.511234 8332 profile.go:148] Saving config to C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\config.json ...
I0329 19:19:35.525978 8332 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0329 19:19:35.534982 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:36.011105 8332 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57409 SSHKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\cilium-20220329190230-1328\id_rsa Username:docker}
I0329 19:19:36.184048 8332 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0329 19:19:36.197845 8332 start.go:130] duration metric: createHost completed in 1m17.6065605s
I0329 19:19:36.220051 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
W0329 19:19:36.740805 8332 fix.go:134] unexpected machine state, will restart: <nil>
I0329 19:19:36.740934 8332 machine.go:88] provisioning docker machine ...
I0329 19:19:36.740934 8332 ubuntu.go:169] provisioning hostname "cilium-20220329190230-1328"
I0329 19:19:36.749899 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:37.230689 8332 main.go:130] libmachine: Using SSH client type: native
I0329 19:19:37.231857 8332 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x766c80] 0x769b40 <nil> [] 0s} 127.0.0.1 57409 <nil> <nil>}
I0329 19:19:37.231910 8332 main.go:130] libmachine: About to run SSH command:
sudo hostname cilium-20220329190230-1328 && echo "cilium-20220329190230-1328" | sudo tee /etc/hostname
I0329 19:19:37.461908 8332 main.go:130] libmachine: SSH cmd err, output: <nil>: cilium-20220329190230-1328
I0329 19:19:37.470917 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:37.970356 8332 main.go:130] libmachine: Using SSH client type: native
I0329 19:19:37.971351 8332 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x766c80] 0x769b40 <nil> [] 0s} 127.0.0.1 57409 <nil> <nil>}
I0329 19:19:37.971351 8332 main.go:130] libmachine: About to run SSH command:
if ! grep -xq '.*\scilium-20220329190230-1328' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 cilium-20220329190230-1328/g' /etc/hosts;
else
echo '127.0.1.1 cilium-20220329190230-1328' | sudo tee -a /etc/hosts;
fi
fi
I0329 19:19:38.184901 8332 main.go:130] libmachine: SSH cmd err, output: <nil>:
I0329 19:19:38.184901 8332 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube8\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube8\minikube-integration\.minikube}
I0329 19:19:38.184901 8332 ubuntu.go:177] setting up certificates
I0329 19:19:38.184901 8332 provision.go:83] configureAuth start
I0329 19:19:38.194406 8332 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cilium-20220329190230-1328
I0329 19:19:38.679857 8332 provision.go:138] copyHostCerts
I0329 19:19:38.680147 8332 exec_runner.go:144] found C:\Users\jenkins.minikube8\minikube-integration\.minikube/key.pem, removing ...
I0329 19:19:38.680245 8332 exec_runner.go:207] rm: C:\Users\jenkins.minikube8\minikube-integration\.minikube\key.pem
I0329 19:19:38.680834 8332 exec_runner.go:151] cp: C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube8\minikube-integration\.minikube/key.pem (1679 bytes)
I0329 19:19:38.681233 8332 exec_runner.go:144] found C:\Users\jenkins.minikube8\minikube-integration\.minikube/ca.pem, removing ...
I0329 19:19:38.681988 8332 exec_runner.go:207] rm: C:\Users\jenkins.minikube8\minikube-integration\.minikube\ca.pem
I0329 19:19:38.682405 8332 exec_runner.go:151] cp: C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube8\minikube-integration\.minikube/ca.pem (1078 bytes)
I0329 19:19:38.683928 8332 exec_runner.go:144] found C:\Users\jenkins.minikube8\minikube-integration\.minikube/cert.pem, removing ...
I0329 19:19:38.683986 8332 exec_runner.go:207] rm: C:\Users\jenkins.minikube8\minikube-integration\.minikube\cert.pem
I0329 19:19:38.684445 8332 exec_runner.go:151] cp: C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube8\minikube-integration\.minikube/cert.pem (1123 bytes)
I0329 19:19:38.685549 8332 provision.go:112] generating server cert: C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.cilium-20220329190230-1328 san=[192.168.58.2 127.0.0.1 localhost 127.0.0.1 minikube cilium-20220329190230-1328]
I0329 19:19:38.868878 8332 provision.go:172] copyRemoteCerts
I0329 19:19:38.879304 8332 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0329 19:19:38.887305 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:39.357570 8332 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57409 SSHKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\cilium-20220329190230-1328\id_rsa Username:docker}
I0329 19:19:39.527199 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0329 19:19:39.598034 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1253 bytes)
I0329 19:19:39.679743 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0329 19:19:39.748285 8332 provision.go:86] duration metric: configureAuth took 1.5633748s
I0329 19:19:39.748285 8332 ubuntu.go:193] setting minikube options for container-runtime
I0329 19:19:39.748285 8332 config.go:176] Loaded profile config "cilium-20220329190230-1328": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.5
I0329 19:19:39.756277 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:40.230826 8332 main.go:130] libmachine: Using SSH client type: native
I0329 19:19:40.231783 8332 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x766c80] 0x769b40 <nil> [] 0s} 127.0.0.1 57409 <nil> <nil>}
I0329 19:19:40.231783 8332 main.go:130] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0329 19:19:40.438547 8332 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay
I0329 19:19:40.438547 8332 ubuntu.go:71] root file system type: overlay
I0329 19:19:40.438547 8332 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0329 19:19:40.448188 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:40.949460 8332 main.go:130] libmachine: Using SSH client type: native
I0329 19:19:40.949524 8332 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x766c80] 0x769b40 <nil> [] 0s} 127.0.0.1 57409 <nil> <nil>}
I0329 19:19:40.949524 8332 main.go:130] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0329 19:19:41.201611 8332 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0329 19:19:41.211128 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:41.731813 8332 main.go:130] libmachine: Using SSH client type: native
I0329 19:19:41.732381 8332 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x766c80] 0x769b40 <nil> [] 0s} 127.0.0.1 57409 <nil> <nil>}
I0329 19:19:41.732431 8332 main.go:130] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0329 19:19:41.920488 8332 main.go:130] libmachine: SSH cmd err, output: <nil>:
I0329 19:19:41.920488 8332 machine.go:91] provisioned docker machine in 5.1795251s
I0329 19:19:41.920488 8332 start.go:302] post-start starting for "cilium-20220329190230-1328" (driver="docker")
I0329 19:19:41.920488 8332 start.go:312] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0329 19:19:41.930493 8332 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0329 19:19:41.937489 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:42.441022 8332 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57409 SSHKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\cilium-20220329190230-1328\id_rsa Username:docker}
I0329 19:19:42.604656 8332 ssh_runner.go:195] Run: cat /etc/os-release
I0329 19:19:42.619574 8332 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0329 19:19:42.619574 8332 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0329 19:19:42.619574 8332 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0329 19:19:42.619574 8332 info.go:137] Remote host: Ubuntu 20.04.4 LTS
I0329 19:19:42.619574 8332 filesync.go:126] Scanning C:\Users\jenkins.minikube8\minikube-integration\.minikube\addons for local assets ...
I0329 19:19:42.620472 8332 filesync.go:126] Scanning C:\Users\jenkins.minikube8\minikube-integration\.minikube\files for local assets ...
I0329 19:19:42.620472 8332 filesync.go:149] local asset: C:\Users\jenkins.minikube8\minikube-integration\.minikube\files\etc\ssl\certs\13282.pem -> 13282.pem in /etc/ssl/certs
I0329 19:19:42.631465 8332 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I0329 19:19:42.655072 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\files\etc\ssl\certs\13282.pem --> /etc/ssl/certs/13282.pem (1708 bytes)
I0329 19:19:42.715779 8332 start.go:305] post-start completed in 795.2861ms
I0329 19:19:42.734219 8332 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0329 19:19:42.745729 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:43.243654 8332 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57409 SSHKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\cilium-20220329190230-1328\id_rsa Username:docker}
I0329 19:19:43.403948 8332 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0329 19:19:43.422014 8332 fix.go:57] fixHost completed within 5m15.9179961s
I0329 19:19:43.422014 8332 start.go:81] releasing machines lock for "cilium-20220329190230-1328", held for 5m15.9182923s
I0329 19:19:43.435710 8332 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cilium-20220329190230-1328
I0329 19:19:43.914492 8332 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/
I0329 19:19:43.921495 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:43.922503 8332 ssh_runner.go:195] Run: sudo service containerd status
I0329 19:19:43.929487 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:44.410858 8332 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57409 SSHKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\cilium-20220329190230-1328\id_rsa Username:docker}
I0329 19:19:44.432940 8332 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57409 SSHKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\cilium-20220329190230-1328\id_rsa Username:docker}
I0329 19:19:44.657384 8332 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0329 19:19:44.693232 8332 cruntime.go:273] skipping containerd shutdown because we are bound to it
I0329 19:19:44.705229 8332 ssh_runner.go:195] Run: sudo service crio status
I0329 19:19:44.756254 8332 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0329 19:19:44.821443 8332 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0329 19:19:44.856962 8332 ssh_runner.go:195] Run: sudo service docker status
I0329 19:19:44.916464 8332 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0329 19:19:45.046926 8332 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0329 19:19:45.189833 8332 out.go:203] * Preparing Kubernetes v1.23.5 on Docker 20.10.13 ...
I0329 19:19:45.198815 8332 cli_runner.go:133] Run: docker exec -t cilium-20220329190230-1328 dig +short host.docker.internal
I0329 19:19:46.108107 8332 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0329 19:19:46.118589 8332 ssh_runner.go:195] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0329 19:19:46.135863 8332 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0329 19:19:46.174564 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:19:46.665450 8332 preload.go:132] Checking if preload exists for k8s version v1.23.5 and runtime docker
I0329 19:19:46.674281 8332 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0329 19:19:46.772235 8332 docker.go:606] Got preloaded images: -- stdout --
k8s.gcr.io/kube-apiserver:v1.23.5
k8s.gcr.io/kube-proxy:v1.23.5
k8s.gcr.io/kube-scheduler:v1.23.5
k8s.gcr.io/kube-controller-manager:v1.23.5
k8s.gcr.io/etcd:3.5.1-0
k8s.gcr.io/coredns/coredns:v1.8.6
k8s.gcr.io/pause:3.6
kubernetesui/dashboard:v2.3.1
kubernetesui/metrics-scraper:v1.0.7
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0329 19:19:46.772235 8332 docker.go:537] Images already preloaded, skipping extraction
I0329 19:19:46.781327 8332 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0329 19:19:46.870308 8332 docker.go:606] Got preloaded images: -- stdout --
k8s.gcr.io/kube-apiserver:v1.23.5
k8s.gcr.io/kube-proxy:v1.23.5
k8s.gcr.io/kube-controller-manager:v1.23.5
k8s.gcr.io/kube-scheduler:v1.23.5
k8s.gcr.io/etcd:3.5.1-0
k8s.gcr.io/coredns/coredns:v1.8.6
k8s.gcr.io/pause:3.6
kubernetesui/dashboard:v2.3.1
kubernetesui/metrics-scraper:v1.0.7
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0329 19:19:46.870308 8332 cache_images.go:84] Images are preloaded, skipping loading
I0329 19:19:46.879631 8332 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0329 19:19:47.078123 8332 cni.go:93] Creating CNI manager for "cilium"
I0329 19:19:47.078123 8332 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0329 19:19:47.078123 8332 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.58.2 APIServerPort:8443 KubernetesVersion:v1.23.5 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:cilium-20220329190230-1328 NodeName:cilium-20220329190230-1328 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.58.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.58.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/mi
nikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
I0329 19:19:47.078123 8332 kubeadm.go:162] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.58.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "cilium-20220329190230-1328"
kubeletExtraArgs:
node-ip: 192.168.58.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.58.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.23.5
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0329 19:19:47.079338 8332 kubeadm.go:936] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.23.5/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=cilium-20220329190230-1328 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.58.2
[Install]
config:
{KubernetesVersion:v1.23.5 ClusterName:cilium-20220329190230-1328 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium NodeIP: NodePort:8443 NodeName:}
I0329 19:19:47.092655 8332 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.23.5
I0329 19:19:47.117803 8332 binaries.go:44] Found k8s binaries, skipping transfer
I0329 19:19:47.129545 8332 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /var/lib/minikube /etc/init.d
I0329 19:19:47.179229 8332 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (373 bytes)
I0329 19:19:47.218651 8332 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0329 19:19:47.256827 8332 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2048 bytes)
I0329 19:19:47.311934 8332 ssh_runner.go:362] scp memory --> /var/lib/minikube/openrc-restart-wrapper.sh (233 bytes)
I0329 19:19:47.358584 8332 ssh_runner.go:362] scp memory --> /etc/init.d/kubelet (839 bytes)
I0329 19:19:47.416492 8332 ssh_runner.go:195] Run: grep 192.168.58.2 control-plane.minikube.internal$ /etc/hosts
I0329 19:19:47.432749 8332 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.58.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0329 19:19:47.469404 8332 certs.go:54] Setting up C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328 for IP: 192.168.58.2
I0329 19:19:47.470247 8332 certs.go:182] skipping minikubeCA CA generation: C:\Users\jenkins.minikube8\minikube-integration\.minikube\ca.key
I0329 19:19:47.470563 8332 certs.go:182] skipping proxyClientCA CA generation: C:\Users\jenkins.minikube8\minikube-integration\.minikube\proxy-client-ca.key
I0329 19:19:47.471126 8332 certs.go:302] generating minikube-user signed cert: C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\client.key
I0329 19:19:47.471324 8332 crypto.go:68] Generating cert C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\client.crt with IP's: []
I0329 19:19:47.631378 8332 crypto.go:156] Writing cert to C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\client.crt ...
I0329 19:19:47.631910 8332 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\client.crt: {Name:mk0121c5054c22ee4ecac5c346da90ec9272c3a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 19:19:47.633197 8332 crypto.go:164] Writing key to C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\client.key ...
I0329 19:19:47.633197 8332 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\client.key: {Name:mk765f600c6b023aaf11e219135fd4e84de92523 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 19:19:47.633525 8332 certs.go:302] generating minikube signed cert: C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\apiserver.key.cee25041
I0329 19:19:47.634659 8332 crypto.go:68] Generating cert C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\apiserver.crt.cee25041 with IP's: [192.168.58.2 10.96.0.1 127.0.0.1 10.0.0.1]
I0329 19:19:47.988896 8332 crypto.go:156] Writing cert to C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\apiserver.crt.cee25041 ...
I0329 19:19:47.988896 8332 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\apiserver.crt.cee25041: {Name:mk788b149cce69a004a1385b9d183c6c15b8ee4c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 19:19:47.989893 8332 crypto.go:164] Writing key to C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\apiserver.key.cee25041 ...
I0329 19:19:47.989893 8332 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\apiserver.key.cee25041: {Name:mk4517a8db3884964bec0b0088f5b3298611bcf8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 19:19:47.990897 8332 certs.go:320] copying C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\apiserver.crt.cee25041 -> C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\apiserver.crt
I0329 19:19:47.995895 8332 certs.go:324] copying C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\apiserver.key.cee25041 -> C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\apiserver.key
I0329 19:19:47.996896 8332 certs.go:302] generating aggregator signed cert: C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\proxy-client.key
I0329 19:19:47.996896 8332 crypto.go:68] Generating cert C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\proxy-client.crt with IP's: []
I0329 19:19:48.161611 8332 crypto.go:156] Writing cert to C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\proxy-client.crt ...
I0329 19:19:48.161611 8332 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\proxy-client.crt: {Name:mkbb9141e2da849b08a0859b7578ce368ae41e97 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 19:19:48.162602 8332 crypto.go:164] Writing key to C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\proxy-client.key ...
I0329 19:19:48.162602 8332 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\proxy-client.key: {Name:mk3551a9c4fc8db3f99dbd8ad4754b2f685dae0b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 19:19:48.171689 8332 certs.go:388] found cert: C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\1328.pem (1338 bytes)
W0329 19:19:48.172007 8332 certs.go:384] ignoring C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\1328_empty.pem, impossibly tiny 0 bytes
I0329 19:19:48.172007 8332 certs.go:388] found cert: C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca-key.pem (1679 bytes)
I0329 19:19:48.172007 8332 certs.go:388] found cert: C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\ca.pem (1078 bytes)
I0329 19:19:48.172007 8332 certs.go:388] found cert: C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\cert.pem (1123 bytes)
I0329 19:19:48.172693 8332 certs.go:388] found cert: C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\key.pem (1679 bytes)
I0329 19:19:48.172693 8332 certs.go:388] found cert: C:\Users\jenkins.minikube8\minikube-integration\.minikube\files\etc\ssl\certs\C:\Users\jenkins.minikube8\minikube-integration\.minikube\files\etc\ssl\certs\13282.pem (1708 bytes)
I0329 19:19:48.174378 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0329 19:19:48.250098 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0329 19:19:48.316727 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0329 19:19:48.374963 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\profiles\cilium-20220329190230-1328\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0329 19:19:48.440191 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0329 19:19:48.509191 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0329 19:19:48.591166 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0329 19:19:48.650365 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0329 19:19:48.696373 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\certs\1328.pem --> /usr/share/ca-certificates/1328.pem (1338 bytes)
I0329 19:19:48.755818 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\files\etc\ssl\certs\13282.pem --> /usr/share/ca-certificates/13282.pem (1708 bytes)
I0329 19:19:48.810590 8332 ssh_runner.go:362] scp C:\Users\jenkins.minikube8\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0329 19:19:48.855157 8332 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0329 19:19:48.899610 8332 ssh_runner.go:195] Run: openssl version
I0329 19:19:48.921603 8332 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1328.pem && ln -fs /usr/share/ca-certificates/1328.pem /etc/ssl/certs/1328.pem"
I0329 19:19:48.954211 8332 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1328.pem
I0329 19:19:48.968001 8332 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 Mar 29 17:29 /usr/share/ca-certificates/1328.pem
I0329 19:19:48.977291 8332 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1328.pem
I0329 19:19:49.002311 8332 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1328.pem /etc/ssl/certs/51391683.0"
I0329 19:19:49.035776 8332 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/13282.pem && ln -fs /usr/share/ca-certificates/13282.pem /etc/ssl/certs/13282.pem"
I0329 19:19:49.075770 8332 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/13282.pem
I0329 19:19:49.086573 8332 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 Mar 29 17:29 /usr/share/ca-certificates/13282.pem
I0329 19:19:49.095573 8332 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/13282.pem
I0329 19:19:49.121573 8332 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/13282.pem /etc/ssl/certs/3ec20f2e.0"
I0329 19:19:49.152649 8332 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0329 19:19:49.180652 8332 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0329 19:19:49.190646 8332 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Mar 29 17:18 /usr/share/ca-certificates/minikubeCA.pem
I0329 19:19:49.200652 8332 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0329 19:19:49.222641 8332 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0329 19:19:49.244509 8332 kubeadm.go:391] StartCluster: {Name:cilium-20220329190230-1328 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.5 ClusterName:cilium-20220329190230-1328 Namespace:default APIServerName:minikubeCA APIServerName
s:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.58.2 Port:8443 KubernetesVersion:v1.23.5 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube8:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false
DisableMetrics:false}
I0329 19:19:49.251645 8332 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0329 19:19:49.344543 8332 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0329 19:19:49.393950 8332 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0329 19:19:49.420738 8332 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver
I0329 19:19:49.432016 8332 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0329 19:19:49.464664 8332 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0329 19:19:49.464664 8332 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.5:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0329 19:20:21.086354 8332 out.go:203] - Generating certificates and keys ...
I0329 19:20:21.100608 8332 out.go:203] - Booting up control plane ...
I0329 19:20:21.110412 8332 out.go:203] - Configuring RBAC rules ...
I0329 19:20:21.116074 8332 cni.go:93] Creating CNI manager for "cilium"
I0329 19:20:21.124086 8332 out.go:176] * Configuring Cilium (Container Networking Interface) ...
I0329 19:20:21.133734 8332 ssh_runner.go:195] Run: sudo /bin/bash -c "grep 'bpffs /sys/fs/bpf' /proc/mounts || sudo mount bpffs -t bpf /sys/fs/bpf"
I0329 19:20:21.376507 8332 cilium.go:816] Using pod CIDR: 10.244.0.0/16
I0329 19:20:21.376507 8332 cilium.go:827] cilium options: {PodSubnet:10.244.0.0/16}
I0329 19:20:21.377507 8332 cilium.go:831] cilium config:
---
# Source: cilium/templates/cilium-agent-serviceaccount.yaml
apiVersion: v1
kind: ServiceAccount
metadata:
name: cilium
namespace: kube-system
---
# Source: cilium/templates/cilium-operator-serviceaccount.yaml
apiVersion: v1
kind: ServiceAccount
metadata:
name: cilium-operator
namespace: kube-system
---
# Source: cilium/templates/cilium-configmap.yaml
apiVersion: v1
kind: ConfigMap
metadata:
name: cilium-config
namespace: kube-system
data:
# Identity allocation mode selects how identities are shared between cilium
# nodes by setting how they are stored. The options are "crd" or "kvstore".
# - "crd" stores identities in kubernetes as CRDs (custom resource definition).
# These can be queried with:
# kubectl get ciliumid
# - "kvstore" stores identities in a kvstore, etcd or consul, that is
# configured below. Cilium versions before 1.6 supported only the kvstore
# backend. Upgrades from these older cilium versions should continue using
# the kvstore by commenting out the identity-allocation-mode below, or
# setting it to "kvstore".
identity-allocation-mode: crd
cilium-endpoint-gc-interval: "5m0s"
# If you want to run cilium in debug mode change this value to true
debug: "false"
# The agent can be put into the following three policy enforcement modes
# default, always and never.
# https://docs.cilium.io/en/latest/policy/intro/#policy-enforcement-modes
enable-policy: "default"
# Enable IPv4 addressing. If enabled, all endpoints are allocated an IPv4
# address.
enable-ipv4: "true"
# Enable IPv6 addressing. If enabled, all endpoints are allocated an IPv6
# address.
enable-ipv6: "false"
# Users who wish to specify their own custom CNI configuration file must set
# custom-cni-conf to "true", otherwise Cilium may overwrite the configuration.
custom-cni-conf: "false"
enable-bpf-clock-probe: "true"
# If you want cilium monitor to aggregate tracing for packets, set this level
# to "low", "medium", or "maximum". The higher the level, the less packets
# that will be seen in monitor output.
monitor-aggregation: medium
# The monitor aggregation interval governs the typical time between monitor
# notification events for each allowed connection.
#
# Only effective when monitor aggregation is set to "medium" or higher.
monitor-aggregation-interval: 5s
# The monitor aggregation flags determine which TCP flags which, upon the
# first observation, cause monitor notifications to be generated.
#
# Only effective when monitor aggregation is set to "medium" or higher.
monitor-aggregation-flags: all
# Specifies the ratio (0.0-1.0) of total system memory to use for dynamic
# sizing of the TCP CT, non-TCP CT, NAT and policy BPF maps.
bpf-map-dynamic-size-ratio: "0.0025"
# bpf-policy-map-max specifies the maximum number of entries in endpoint
# policy map (per endpoint)
bpf-policy-map-max: "16384"
# bpf-lb-map-max specifies the maximum number of entries in bpf lb service,
# backend and affinity maps.
bpf-lb-map-max: "65536"
# Pre-allocation of map entries allows per-packet latency to be reduced, at
# the expense of up-front memory allocation for the entries in the maps. The
# default value below will minimize memory usage in the default installation;
# users who are sensitive to latency may consider setting this to "true".
#
# This option was introduced in Cilium 1.4. Cilium 1.3 and earlier ignore
# this option and behave as though it is set to "true".
#
# If this value is modified, then during the next Cilium startup the restore
# of existing endpoints and tracking of ongoing connections may be disrupted.
# As a result, reply packets may be dropped and the load-balancing decisions
# for established connections may change.
#
# If this option is set to "false" during an upgrade from 1.3 or earlier to
# 1.4 or later, then it may cause one-time disruptions during the upgrade.
preallocate-bpf-maps: "false"
# Regular expression matching compatible Istio sidecar istio-proxy
# container image names
sidecar-istio-proxy-image: "cilium/istio_proxy"
# Name of the cluster. Only relevant when building a mesh of clusters.
cluster-name: default
# Unique ID of the cluster. Must be unique across all conneted clusters and
# in the range of 1 and 255. Only relevant when building a mesh of clusters.
cluster-id: ""
# Encapsulation mode for communication between nodes
# Possible values:
# - disabled
# - vxlan (default)
# - geneve
tunnel: vxlan
# Enables L7 proxy for L7 policy enforcement and visibility
enable-l7-proxy: "true"
# wait-bpf-mount makes init container wait until bpf filesystem is mounted
wait-bpf-mount: "false"
masquerade: "true"
enable-bpf-masquerade: "true"
enable-xt-socket-fallback: "true"
install-iptables-rules: "true"
auto-direct-node-routes: "false"
enable-bandwidth-manager: "false"
enable-local-redirect-policy: "false"
kube-proxy-replacement: "probe"
kube-proxy-replacement-healthz-bind-address: ""
enable-health-check-nodeport: "true"
node-port-bind-protection: "true"
enable-auto-protect-node-port-range: "true"
enable-session-affinity: "true"
k8s-require-ipv4-pod-cidr: "true"
k8s-require-ipv6-pod-cidr: "false"
enable-endpoint-health-checking: "true"
enable-health-checking: "true"
enable-well-known-identities: "false"
enable-remote-node-identity: "true"
operator-api-serve-addr: "127.0.0.1:9234"
# Enable Hubble gRPC service.
enable-hubble: "true"
# UNIX domain socket for Hubble server to listen to.
hubble-socket-path: "/var/run/cilium/hubble.sock"
# An additional address for Hubble server to listen to (e.g. ":4244").
hubble-listen-address: ":4244"
hubble-disable-tls: "false"
hubble-tls-cert-file: /var/lib/cilium/tls/hubble/server.crt
hubble-tls-key-file: /var/lib/cilium/tls/hubble/server.key
hubble-tls-client-ca-files: /var/lib/cilium/tls/hubble/client-ca.crt
ipam: "cluster-pool"
cluster-pool-ipv4-cidr: "10.244.0.0/16"
cluster-pool-ipv4-mask-size: "24"
disable-cnp-status-updates: "true"
cgroup-root: "/run/cilium/cgroupv2"
---
# Source: cilium/templates/cilium-agent-clusterrole.yaml
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
name: cilium
rules:
- apiGroups:
- networking.k8s.io
resources:
- networkpolicies
verbs:
- get
- list
- watch
- apiGroups:
- discovery.k8s.io
resources:
- endpointslices
verbs:
- get
- list
- watch
- apiGroups:
- ""
resources:
- namespaces
- services
- nodes
- endpoints
verbs:
- get
- list
- watch
- apiGroups:
- ""
resources:
- pods
- pods/finalizers
verbs:
- get
- list
- watch
- update
- delete
- apiGroups:
- ""
resources:
- nodes
verbs:
- get
- list
- watch
- update
- apiGroups:
- ""
resources:
- nodes
- nodes/status
verbs:
- patch
- apiGroups:
- apiextensions.k8s.io
resources:
- customresourcedefinitions
verbs:
# Deprecated for removal in v1.10
- create
- list
- watch
- update
# This is used when validating policies in preflight. This will need to stay
# until we figure out how to avoid "get" inside the preflight, and then
# should be removed ideally.
- get
- apiGroups:
- cilium.io
resources:
- ciliumnetworkpolicies
- ciliumnetworkpolicies/status
- ciliumnetworkpolicies/finalizers
- ciliumclusterwidenetworkpolicies
- ciliumclusterwidenetworkpolicies/status
- ciliumclusterwidenetworkpolicies/finalizers
- ciliumendpoints
- ciliumendpoints/status
- ciliumendpoints/finalizers
- ciliumnodes
- ciliumnodes/status
- ciliumnodes/finalizers
- ciliumidentities
- ciliumidentities/finalizers
- ciliumlocalredirectpolicies
- ciliumlocalredirectpolicies/status
- ciliumlocalredirectpolicies/finalizers
verbs:
- '*'
---
# Source: cilium/templates/cilium-operator-clusterrole.yaml
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
name: cilium-operator
rules:
- apiGroups:
- ""
resources:
# to automatically delete [core|kube]dns pods so that are starting to being
# managed by Cilium
- pods
verbs:
- get
- list
- watch
- delete
- apiGroups:
- discovery.k8s.io
resources:
- endpointslices
verbs:
- get
- list
- watch
- apiGroups:
- ""
resources:
# to perform the translation of a CNP that contains 'ToGroup' to its endpoints
- services
- endpoints
# to check apiserver connectivity
- namespaces
verbs:
- get
- list
- watch
- apiGroups:
- cilium.io
resources:
- ciliumnetworkpolicies
- ciliumnetworkpolicies/status
- ciliumnetworkpolicies/finalizers
- ciliumclusterwidenetworkpolicies
- ciliumclusterwidenetworkpolicies/status
- ciliumclusterwidenetworkpolicies/finalizers
- ciliumendpoints
- ciliumendpoints/status
- ciliumendpoints/finalizers
- ciliumnodes
- ciliumnodes/status
- ciliumnodes/finalizers
- ciliumidentities
- ciliumidentities/status
- ciliumidentities/finalizers
- ciliumlocalredirectpolicies
- ciliumlocalredirectpolicies/status
- ciliumlocalredirectpolicies/finalizers
verbs:
- '*'
- apiGroups:
- apiextensions.k8s.io
resources:
- customresourcedefinitions
verbs:
- create
- get
- list
- update
- watch
# For cilium-operator running in HA mode.
#
# Cilium operator running in HA mode requires the use of ResourceLock for Leader Election
# between multiple running instances.
# The preferred way of doing this is to use LeasesResourceLock as edits to Leases are less
# common and fewer objects in the cluster watch "all Leases".
# The support for leases was introduced in coordination.k8s.io/v1 during Kubernetes 1.14 release.
# In Cilium we currently don't support HA mode for K8s version < 1.14. This condition make sure
# that we only authorize access to leases resources in supported K8s versions.
- apiGroups:
- coordination.k8s.io
resources:
- leases
verbs:
- create
- get
- update
---
# Source: cilium/templates/cilium-agent-clusterrolebinding.yaml
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
metadata:
name: cilium
roleRef:
apiGroup: rbac.authorization.k8s.io
kind: ClusterRole
name: cilium
subjects:
- kind: ServiceAccount
name: cilium
namespace: kube-system
---
# Source: cilium/templates/cilium-operator-clusterrolebinding.yaml
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
metadata:
name: cilium-operator
roleRef:
apiGroup: rbac.authorization.k8s.io
kind: ClusterRole
name: cilium-operator
subjects:
- kind: ServiceAccount
name: cilium-operator
namespace: kube-system
---
# Source: cilium/templates/cilium-agent-daemonset.yaml
apiVersion: apps/v1
kind: DaemonSet
metadata:
labels:
k8s-app: cilium
name: cilium
namespace: kube-system
spec:
selector:
matchLabels:
k8s-app: cilium
updateStrategy:
rollingUpdate:
maxUnavailable: 2
type: RollingUpdate
template:
metadata:
annotations:
# This annotation plus the CriticalAddonsOnly toleration makes
# cilium to be a critical pod in the cluster, which ensures cilium
# gets priority scheduling.
# https://kubernetes.io/docs/tasks/administer-cluster/guaranteed-scheduling-critical-addon-pods/
scheduler.alpha.kubernetes.io/critical-pod: ""
labels:
k8s-app: cilium
spec:
affinity:
podAntiAffinity:
requiredDuringSchedulingIgnoredDuringExecution:
- labelSelector:
matchExpressions:
- key: k8s-app
operator: In
values:
- cilium
topologyKey: kubernetes.io/hostname
containers:
- args:
- --config-dir=/tmp/cilium/config-map
command:
- cilium-agent
livenessProbe:
httpGet:
host: '127.0.0.1'
path: /healthz
port: 9876
scheme: HTTP
httpHeaders:
- name: "brief"
value: "true"
failureThreshold: 10
# The initial delay for the liveness probe is intentionally large to
# avoid an endless kill & restart cycle if in the event that the initial
# bootstrapping takes longer than expected.
initialDelaySeconds: 120
periodSeconds: 30
successThreshold: 1
timeoutSeconds: 5
readinessProbe:
httpGet:
host: '127.0.0.1'
path: /healthz
port: 9876
scheme: HTTP
httpHeaders:
- name: "brief"
value: "true"
failureThreshold: 3
initialDelaySeconds: 5
periodSeconds: 30
successThreshold: 1
timeoutSeconds: 5
env:
- name: K8S_NODE_NAME
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: spec.nodeName
- name: CILIUM_K8S_NAMESPACE
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: metadata.namespace
- name: CILIUM_FLANNEL_MASTER_DEVICE
valueFrom:
configMapKeyRef:
key: flannel-master-device
name: cilium-config
optional: true
- name: CILIUM_FLANNEL_UNINSTALL_ON_EXIT
valueFrom:
configMapKeyRef:
key: flannel-uninstall-on-exit
name: cilium-config
optional: true
- name: CILIUM_CLUSTERMESH_CONFIG
value: /var/lib/cilium/clustermesh/
- name: CILIUM_CNI_CHAINING_MODE
valueFrom:
configMapKeyRef:
key: cni-chaining-mode
name: cilium-config
optional: true
- name: CILIUM_CUSTOM_CNI_CONF
valueFrom:
configMapKeyRef:
key: custom-cni-conf
name: cilium-config
optional: true
image: "quay.io/cilium/cilium:v1.9.9@sha256:a85d5cff13f8231c2e267d9fc3c6e43d24be4a75dac9f641c11ec46e7f17624d"
imagePullPolicy: IfNotPresent
lifecycle:
postStart:
exec:
command:
- "/cni-install.sh"
- "--enable-debug=false"
preStop:
exec:
command:
- /cni-uninstall.sh
name: cilium-agent
securityContext:
capabilities:
add:
- NET_ADMIN
- SYS_MODULE
privileged: true
volumeMounts:
- mountPath: /sys/fs/bpf
name: bpf-maps
- mountPath: /var/run/cilium
name: cilium-run
- mountPath: /host/opt/cni/bin
name: cni-path
- mountPath: /host/etc/cni/net.d
name: etc-cni-netd
- mountPath: /var/lib/cilium/clustermesh
name: clustermesh-secrets
readOnly: true
- mountPath: /tmp/cilium/config-map
name: cilium-config-path
readOnly: true
# Needed to be able to load kernel modules
- mountPath: /lib/modules
name: lib-modules
readOnly: true
- mountPath: /run/xtables.lock
name: xtables-lock
- mountPath: /var/lib/cilium/tls/hubble
name: hubble-tls
readOnly: true
hostNetwork: true
initContainers:
# Required to mount cgroup2 filesystem on the underlying Kubernetes node.
# We use nsenter command with host's cgroup and mount namespaces enabled.
- name: mount-cgroup
env:
- name: CGROUP_ROOT
value: /run/cilium/cgroupv2
- name: BIN_PATH
value: /opt/cni/bin
command:
- sh
- -c
# The statically linked Go program binary is invoked to avoid any
# dependency on utilities like sh and mount that can be missing on certain
# distros installed on the underlying host. Copy the binary to the
# same directory where we install cilium cni plugin so that exec permissions
# are available.
- 'cp /usr/bin/cilium-mount /hostbin/cilium-mount && nsenter --cgroup=/hostproc/1/ns/cgroup --mount=/hostproc/1/ns/mnt "${BIN_PATH}/cilium-mount" $CGROUP_ROOT; rm /hostbin/cilium-mount'
image: "quay.io/cilium/cilium:v1.9.9@sha256:a85d5cff13f8231c2e267d9fc3c6e43d24be4a75dac9f641c11ec46e7f17624d"
imagePullPolicy: IfNotPresent
volumeMounts:
- mountPath: /hostproc
name: hostproc
- mountPath: /hostbin
name: cni-path
securityContext:
privileged: true
- command:
- /init-container.sh
env:
- name: CILIUM_ALL_STATE
valueFrom:
configMapKeyRef:
key: clean-cilium-state
name: cilium-config
optional: true
- name: CILIUM_BPF_STATE
valueFrom:
configMapKeyRef:
key: clean-cilium-bpf-state
name: cilium-config
optional: true
- name: CILIUM_WAIT_BPF_MOUNT
valueFrom:
configMapKeyRef:
key: wait-bpf-mount
name: cilium-config
optional: true
image: "quay.io/cilium/cilium:v1.9.9@sha256:a85d5cff13f8231c2e267d9fc3c6e43d24be4a75dac9f641c11ec46e7f17624d"
imagePullPolicy: IfNotPresent
name: clean-cilium-state
securityContext:
capabilities:
add:
- NET_ADMIN
privileged: true
volumeMounts:
- mountPath: /sys/fs/bpf
name: bpf-maps
mountPropagation: HostToContainer
# Required to mount cgroup filesystem from the host to cilium agent pod
- mountPath: /run/cilium/cgroupv2
name: cilium-cgroup
mountPropagation: HostToContainer
- mountPath: /var/run/cilium
name: cilium-run
resources:
requests:
cpu: 100m
memory: 100Mi
restartPolicy: Always
priorityClassName: system-node-critical
serviceAccount: cilium
serviceAccountName: cilium
terminationGracePeriodSeconds: 1
tolerations:
- operator: Exists
volumes:
# To keep state between restarts / upgrades
- hostPath:
path: /var/run/cilium
type: DirectoryOrCreate
name: cilium-run
# To keep state between restarts / upgrades for bpf maps
- hostPath:
path: /sys/fs/bpf
type: DirectoryOrCreate
name: bpf-maps
# To mount cgroup2 filesystem on the host
- hostPath:
path: /proc
type: Directory
name: hostproc
# To keep state between restarts / upgrades for cgroup2 filesystem
- hostPath:
path: /run/cilium/cgroupv2
type: DirectoryOrCreate
name: cilium-cgroup
# To install cilium cni plugin in the host
- hostPath:
path: /opt/cni/bin
type: DirectoryOrCreate
name: cni-path
# To install cilium cni configuration in the host
- hostPath:
path: /etc/cni/net.d
type: DirectoryOrCreate
name: etc-cni-netd
# To be able to load kernel modules
- hostPath:
path: /lib/modules
name: lib-modules
# To access iptables concurrently with other processes (e.g. kube-proxy)
- hostPath:
path: /run/xtables.lock
type: FileOrCreate
name: xtables-lock
# To read the clustermesh configuration
- name: clustermesh-secrets
secret:
defaultMode: 420
optional: true
secretName: cilium-clustermesh
# To read the configuration from the config map
- configMap:
name: cilium-config
name: cilium-config-path
- name: hubble-tls
projected:
sources:
- secret:
name: hubble-server-certs
items:
- key: tls.crt
path: server.crt
- key: tls.key
path: server.key
optional: true
- configMap:
name: hubble-ca-cert
items:
- key: ca.crt
path: client-ca.crt
optional: true
---
# Source: cilium/templates/cilium-operator-deployment.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
labels:
io.cilium/app: operator
name: cilium-operator
name: cilium-operator
namespace: kube-system
spec:
# We support HA mode only for Kubernetes version > 1.14
# See docs on ServerCapabilities.LeasesResourceLock in file pkg/k8s/version/version.go
# for more details.
replicas: 1
selector:
matchLabels:
io.cilium/app: operator
name: cilium-operator
strategy:
rollingUpdate:
maxSurge: 1
maxUnavailable: 1
type: RollingUpdate
template:
metadata:
annotations:
labels:
io.cilium/app: operator
name: cilium-operator
spec:
# In HA mode, cilium-operator pods must not be scheduled on the same
# node as they will clash with each other.
affinity:
podAntiAffinity:
requiredDuringSchedulingIgnoredDuringExecution:
- labelSelector:
matchExpressions:
- key: io.cilium/app
operator: In
values:
- operator
topologyKey: kubernetes.io/hostname
containers:
- args:
- --config-dir=/tmp/cilium/config-map
- --debug=$(CILIUM_DEBUG)
command:
- cilium-operator-generic
env:
- name: K8S_NODE_NAME
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: spec.nodeName
- name: CILIUM_K8S_NAMESPACE
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: metadata.namespace
- name: CILIUM_DEBUG
valueFrom:
configMapKeyRef:
key: debug
name: cilium-config
optional: true
image: "quay.io/cilium/operator-generic:v1.9.9@sha256:3726a965cd960295ca3c5e7f2b543c02096c0912c6652eb8bbb9ce54bcaa99d8"
imagePullPolicy: IfNotPresent
name: cilium-operator
livenessProbe:
httpGet:
host: '127.0.0.1'
path: /healthz
port: 9234
scheme: HTTP
initialDelaySeconds: 60
periodSeconds: 10
timeoutSeconds: 3
volumeMounts:
- mountPath: /tmp/cilium/config-map
name: cilium-config-path
readOnly: true
hostNetwork: true
restartPolicy: Always
priorityClassName: system-cluster-critical
serviceAccount: cilium-operator
serviceAccountName: cilium-operator
tolerations:
- operator: Exists
volumes:
# To read the configuration from the config map
- configMap:
name: cilium-config
name: cilium-config-path
I0329 19:20:21.377507 8332 cni.go:187] applying CNI manifest using /var/lib/minikube/binaries/v1.23.5/kubectl ...
I0329 19:20:21.377507 8332 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (23204 bytes)
I0329 19:20:21.602086 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0329 19:20:26.380787 8332 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.23.5/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: (4.778674s)
I0329 19:20:26.380787 8332 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0329 19:20:26.394786 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl label nodes minikube.k8s.io/version=v1.25.2 minikube.k8s.io/commit=923781973407d6dc536f326caa216e4920fd75c3 minikube.k8s.io/name=cilium-20220329190230-1328 minikube.k8s.io/updated_at=2022_03_29T19_20_26_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:26.397801 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:26.399785 8332 ops.go:34] apiserver oom_adj: -16
I0329 19:20:26.725314 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:27.392175 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:27.885735 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:28.387733 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:28.889357 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:29.390832 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:29.904209 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:30.396046 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:30.889182 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:31.392712 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:31.893065 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:32.399978 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:32.888269 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:33.402293 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:34.593699 8332 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (1.1913993s)
I0329 19:20:34.882776 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:36.243290 8332 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (1.3605069s)
I0329 19:20:36.383584 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:39.570068 8332 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (3.1863556s)
I0329 19:20:39.898035 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:43.192418 8332 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (3.2943642s)
I0329 19:20:43.387804 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:43.898953 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:47.469231 8332 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (3.5702582s)
I0329 19:20:47.902352 8332 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.5/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0329 19:20:48.584049 8332 kubeadm.go:1020] duration metric: took 22.2031354s to wait for elevateKubeSystemPrivileges.
I0329 19:20:48.584049 8332 kubeadm.go:393] StartCluster complete in 59.3392021s
I0329 19:20:48.584049 8332 settings.go:142] acquiring lock: {Name:mkef8bbc389dbb185414693c85b2ca1f1524f773 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 19:20:48.584049 8332 settings.go:150] Updating kubeconfig: C:\Users\jenkins.minikube8\minikube-integration\kubeconfig
I0329 19:20:48.588281 8332 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube8\minikube-integration\kubeconfig: {Name:mkae4c781fbfb916db801be8b13665a6fdce8de8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0329 19:20:49.216228 8332 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "cilium-20220329190230-1328" rescaled to 1
I0329 19:20:49.216228 8332 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.5/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0329 19:20:49.216228 8332 start.go:208] Will wait 5m0s for node &{Name: IP:192.168.58.2 Port:8443 KubernetesVersion:v1.23.5 ContainerRuntime:docker ControlPlane:true Worker:true}
I0329 19:20:49.224218 8332 out.go:176] * Verifying Kubernetes components...
I0329 19:20:49.216228 8332 addons.go:415] enableAddons start: toEnable=map[], additional=[]
I0329 19:20:49.216228 8332 config.go:176] Loaded profile config "cilium-20220329190230-1328": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.5
I0329 19:20:49.224218 8332 addons.go:65] Setting storage-provisioner=true in profile "cilium-20220329190230-1328"
I0329 19:20:49.224218 8332 addons.go:153] Setting addon storage-provisioner=true in "cilium-20220329190230-1328"
W0329 19:20:49.224218 8332 addons.go:165] addon storage-provisioner should already be in state true
I0329 19:20:49.224218 8332 addons.go:65] Setting default-storageclass=true in profile "cilium-20220329190230-1328"
I0329 19:20:49.224218 8332 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "cilium-20220329190230-1328"
I0329 19:20:49.224218 8332 host.go:66] Checking if "cilium-20220329190230-1328" exists ...
I0329 19:20:49.237210 8332 ssh_runner.go:195] Run: sudo service kubelet status
I0329 19:20:49.243209 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:20:49.243209 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:20:49.855660 8332 out.go:176] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0329 19:20:49.855935 8332 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0329 19:20:49.855984 8332 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0329 19:20:49.871434 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:20:49.891903 8332 addons.go:153] Setting addon default-storageclass=true in "cilium-20220329190230-1328"
W0329 19:20:49.891903 8332 addons.go:165] addon default-storageclass should already be in state true
I0329 19:20:49.892047 8332 host.go:66] Checking if "cilium-20220329190230-1328" exists ...
I0329 19:20:49.914918 8332 cli_runner.go:133] Run: docker container inspect cilium-20220329190230-1328 --format={{.State.Status}}
I0329 19:20:49.978132 8332 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.5/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.2 host.minikube.internal\n fallthrough\n }' | sudo /var/lib/minikube/binaries/v1.23.5/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0329 19:20:50.000232 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:20:50.453364 8332 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57409 SSHKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\cilium-20220329190230-1328\id_rsa Username:docker}
I0329 19:20:50.533370 8332 addons.go:348] installing /etc/kubernetes/addons/storageclass.yaml
I0329 19:20:50.533370 8332 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0329 19:20:50.543352 8332 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220329190230-1328
I0329 19:20:50.594704 8332 node_ready.go:35] waiting up to 5m0s for node "cilium-20220329190230-1328" to be "Ready" ...
I0329 19:20:50.674695 8332 node_ready.go:49] node "cilium-20220329190230-1328" has status "Ready":"True"
I0329 19:20:50.674695 8332 node_ready.go:38] duration metric: took 79.9897ms waiting for node "cilium-20220329190230-1328" to be "Ready" ...
I0329 19:20:50.674695 8332 pod_ready.go:35] extra waiting up to 5m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0329 19:20:50.701705 8332 pod_ready.go:78] waiting up to 5m0s for pod "cilium-h9rtv" in "kube-system" namespace to be "Ready" ...
I0329 19:20:51.113113 8332 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.5/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0329 19:20:51.134115 8332 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57409 SSHKeyPath:C:\Users\jenkins.minikube8\minikube-integration\.minikube\machines\cilium-20220329190230-1328\id_rsa Username:docker}
I0329 19:20:51.187854 8332 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.5/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.2 host.minikube.internal\n fallthrough\n }' | sudo /var/lib/minikube/binaries/v1.23.5/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.2097153s)
I0329 19:20:51.187854 8332 start.go:777] {"host.minikube.internal": 192.168.65.2} host record injected into CoreDNS
I0329 19:20:51.819392 8332 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.5/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0329 19:20:53.001775 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:20:53.179999 8332 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.5/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.3605997s)
I0329 19:20:53.179999 8332 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.5/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.066874s)
I0329 19:20:53.185017 8332 out.go:176] * Enabled addons: default-storageclass, storage-provisioner
I0329 19:20:53.185017 8332 addons.go:417] enableAddons completed in 3.9687656s
I0329 19:20:55.328478 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:20:57.471583 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:20:59.484757 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:01.489640 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:03.884956 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:05.965780 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:08.373159 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:10.378846 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:12.684890 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:14.887205 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:17.319902 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:19.376275 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:21.390734 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:23.884578 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:26.385832 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:28.815953 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:30.837483 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:33.382450 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:35.813152 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:37.930361 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:40.575040 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:42.836906 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:47.926827 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:53.775674 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:56.168143 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:21:58.308282 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:00.317919 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:02.819857 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:05.325327 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:07.824415 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:10.313321 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:12.316811 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:14.394315 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:17.116058 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:19.312826 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:21.748883 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:23.885890 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:26.324064 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:30.369642 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:32.818984 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:35.947036 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:38.318447 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:46.775026 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:48.840678 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:51.313482 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:53.320212 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:55.871773 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:22:58.374680 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:00.812551 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:02.824265 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:05.314739 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:07.329195 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:09.820195 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:11.866048 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:14.317171 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:16.328696 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:18.813392 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:21.317076 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:23.672398 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:25.819577 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:28.326977 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:30.823383 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:33.321155 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:35.815437 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:37.816578 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:40.331022 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:42.825237 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:45.312779 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:47.320766 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:49.813537 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:51.818289 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:53.828440 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:56.370171 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:23:58.821317 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:00.822044 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:03.330710 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:05.819020 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:07.824231 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:10.316167 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:12.826496 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:14.828679 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:17.321009 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:19.811682 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:21.816907 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:23.820111 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:26.319136 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:28.814680 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:30.816465 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:32.827223 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:35.327667 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:37.358572 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:39.812052 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:42.329882 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:44.822526 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:47.319094 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:49.322335 8332 pod_ready.go:102] pod "cilium-h9rtv" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:50.831728 8332 pod_ready.go:81] duration metric: took 4m0.1276387s waiting for pod "cilium-h9rtv" in "kube-system" namespace to be "Ready" ...
E0329 19:24:50.831728 8332 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting for the condition
I0329 19:24:50.831728 8332 pod_ready.go:78] waiting up to 5m0s for pod "cilium-operator-78f49c47f-p5hs9" in "kube-system" namespace to be "Ready" ...
I0329 19:24:50.843716 8332 pod_ready.go:92] pod "cilium-operator-78f49c47f-p5hs9" in "kube-system" namespace has status "Ready":"True"
I0329 19:24:50.843716 8332 pod_ready.go:81] duration metric: took 11.9887ms waiting for pod "cilium-operator-78f49c47f-p5hs9" in "kube-system" namespace to be "Ready" ...
I0329 19:24:50.843716 8332 pod_ready.go:78] waiting up to 5m0s for pod "coredns-64897985d-kghld" in "kube-system" namespace to be "Ready" ...
I0329 19:24:50.849714 8332 pod_ready.go:97] error getting pod "coredns-64897985d-kghld" in "kube-system" namespace (skipping!): pods "coredns-64897985d-kghld" not found
I0329 19:24:50.849714 8332 pod_ready.go:81] duration metric: took 5.9979ms waiting for pod "coredns-64897985d-kghld" in "kube-system" namespace to be "Ready" ...
E0329 19:24:50.849714 8332 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-64897985d-kghld" in "kube-system" namespace (skipping!): pods "coredns-64897985d-kghld" not found
I0329 19:24:50.849714 8332 pod_ready.go:78] waiting up to 5m0s for pod "coredns-64897985d-shk4t" in "kube-system" namespace to be "Ready" ...
I0329 19:24:52.891456 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:54.906220 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:57.389630 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:24:59.394407 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:01.403532 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:03.895589 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:06.404765 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:08.888399 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:10.897500 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:13.388814 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:15.395186 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:17.396877 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:19.398615 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:21.888337 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:23.903676 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:26.417815 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:28.891833 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:30.894000 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:32.895550 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:35.401718 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:37.885470 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:39.889007 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:41.895203 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:44.386974 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:46.395910 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:48.892409 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:50.899341 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:53.396269 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:55.894351 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:25:57.899121 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:00.390699 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:02.396817 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:04.397426 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:06.897834 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:09.392250 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:11.894620 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:14.387627 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:16.401382 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:18.886655 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:20.899149 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:23.387137 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:25.387678 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:27.390403 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:29.410559 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:31.413827 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:33.893528 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:36.388299 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:38.390305 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:40.895399 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:43.393950 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:45.889062 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:47.889573 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:49.894019 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:52.391170 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:54.394405 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:56.890590 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:26:58.902909 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:01.388511 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:03.396915 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:05.888955 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:07.897710 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:10.401371 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:12.889683 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:14.899941 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:17.393874 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:19.901065 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:22.400204 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:24.894912 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:26.898572 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:29.395867 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:31.400568 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:33.885991 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:35.896873 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:37.898656 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:39.901336 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:42.391948 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:44.398401 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:46.398867 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:48.887265 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:50.899523 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:53.389626 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:55.890826 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:27:58.390965 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:00.393211 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:02.910203 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:05.397763 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:07.883638 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:10.394668 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:12.400708 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:14.888581 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:16.890344 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:19.120641 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:30.886454 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:32.889057 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:34.895083 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:36.900754 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:39.396248 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:41.397512 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:43.401627 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:45.885448 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:48.114392 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:50.205361 8332 pod_ready.go:102] pod "coredns-64897985d-shk4t" in "kube-system" namespace has status "Ready":"False"
I0329 19:28:50.886534 8332 pod_ready.go:81] duration metric: took 4m0.0355002s waiting for pod "coredns-64897985d-shk4t" in "kube-system" namespace to be "Ready" ...
E0329 19:28:50.886534 8332 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting for the condition
I0329 19:28:50.886534 8332 pod_ready.go:38] duration metric: took 8m0.2091457s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0329 19:28:50.900527 8332 out.go:176]
W0329 19:28:50.900527 8332 out.go:241] X Exiting due to GUEST_START: wait 5m0s for node: extra waiting: timed out waiting 5m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
X Exiting due to GUEST_START: wait 5m0s for node: extra waiting: timed out waiting 5m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
W0329 19:28:50.900527 8332 out.go:241] *
*
W0329 19:28:50.901839 8332 out.go:241] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ * If the above advice does not help, please let us know: │
│ https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │
│ │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0329 19:28:50.908858 8332 out.go:176]
** /stderr **
net_test.go:101: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/cilium/Start (931.55s)