=== RUN TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:241: (dbg) Run: out/minikube-windows-amd64.exe start -p old-k8s-version-20210915203352-22848 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.14.0
E0915 20:50:46.745201 22848 cert_rotation.go:168] key failed with : open C:\Users\jenkins\minikube-integration\.minikube\profiles\skaffold-20210915200110-22848\client.crt: The system cannot find the path specified.
=== CONT TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:241: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p old-k8s-version-20210915203352-22848 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.14.0: exit status 1 (13m33.8396494s)
-- stdout --
* [old-k8s-version-20210915203352-22848] minikube v1.23.0 on Microsoft Windows Server 2019 Datacenter 10.0.17763 Build 17763
- KUBECONFIG=C:\Users\jenkins\minikube-integration\kubeconfig
- MINIKUBE_HOME=C:\Users\jenkins\minikube-integration\.minikube
- MINIKUBE_LOCATION=12425
* Kubernetes 1.22.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.22.1
* Using the docker driver based on existing profile
* Starting control plane node old-k8s-version-20210915203352-22848 in cluster old-k8s-version-20210915203352-22848
* Pulling base image ...
* Restarting existing docker container for "old-k8s-version-20210915203352-22848" ...
* Preparing Kubernetes v1.14.0 on Docker 20.10.8 ...
- Generating certificates and keys ...
- Booting up control plane ...
- Configuring RBAC rules ...
* Verifying Kubernetes components...
- Using image kubernetesui/dashboard:v2.1.0
- Using image k8s.gcr.io/echoserver:1.4
- Using image gcr.io/k8s-minikube/storage-provisioner:v5
- Using image fake.domain/k8s.gcr.io/echoserver:1.4
* Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
-- /stdout --
** stderr **
I0915 20:50:19.019001 59380 out.go:298] Setting OutFile to fd 2384 ...
I0915 20:50:19.021105 59380 out.go:345] TERM=,COLORTERM=, which probably does not support color
I0915 20:50:19.021105 59380 out.go:311] Setting ErrFile to fd 2480...
I0915 20:50:19.021105 59380 out.go:345] TERM=,COLORTERM=, which probably does not support color
I0915 20:50:19.048304 59380 out.go:305] Setting JSON to false
I0915 20:50:19.056490 59380 start.go:111] hostinfo: {"hostname":"windows-server-1","uptime":9158492,"bootTime":1622580527,"procs":160,"os":"windows","platform":"Microsoft Windows Server 2019 Datacenter","platformFamily":"Server","platformVersion":"10.0.17763 Build 17763","kernelVersion":"10.0.17763 Build 17763","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"9879231f-6171-435d-bab4-5b366cc6391b"}
W0915 20:50:19.056490 59380 start.go:119] gopshost.Virtualization returned error: not implemented yet
I0915 20:50:19.069838 59380 out.go:177] * [old-k8s-version-20210915203352-22848] minikube v1.23.0 on Microsoft Windows Server 2019 Datacenter 10.0.17763 Build 17763
I0915 20:50:19.070368 59380 notify.go:169] Checking for updates...
I0915 20:50:19.073187 59380 out.go:177] - KUBECONFIG=C:\Users\jenkins\minikube-integration\kubeconfig
I0915 20:50:19.076201 59380 out.go:177] - MINIKUBE_HOME=C:\Users\jenkins\minikube-integration\.minikube
I0915 20:50:19.079528 59380 out.go:177] - MINIKUBE_LOCATION=12425
I0915 20:50:19.086352 59380 config.go:177] Loaded profile config "old-k8s-version-20210915203352-22848": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.14.0
I0915 20:50:19.092398 59380 out.go:177] * Kubernetes 1.22.1 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.22.1
I0915 20:50:19.093180 59380 driver.go:343] Setting default libvirt URI to qemu:///system
I0915 20:50:21.137642 59380 docker.go:132] docker version: linux-20.10.5
I0915 20:50:21.152466 59380 cli_runner.go:115] Run: docker system info --format "{{json .}}"
I0915 20:50:22.424565 59380 cli_runner.go:168] Completed: docker system info --format "{{json .}}": (1.2718958s)
I0915 20:50:22.425415 59380 info.go:263] docker info: {ID:AZM6:4F7P:D7J3:PGKE:EIYN:3OQU:SEA3:BB2T:P6VC:GKKH:UKSA:R2VX Containers:5 ContainersRunning:4 ContainersPaused:0 ContainersStopped:1 Images:7 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:78 OomKillDisable:true NGoroutines:74 SystemTime:2021-09-15 20:50:21.8427854 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:4 KernelVersion:4.19.121-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:https://inde
x.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:4 MemTotal:20973547520 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[]
ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:C:\ProgramData\Docker\cli-plugins\docker-app.exe SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:C:\ProgramData\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:scan Path:C:\ProgramData\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.5.0]] Warnings:<nil>}}
I0915 20:50:22.429874 59380 out.go:177] * Using the docker driver based on existing profile
I0915 20:50:22.430793 59380 start.go:278] selected driver: docker
I0915 20:50:22.430793 59380 start.go:751] validating driver "docker" against &{Name:old-k8s-version-20210915203352-22848 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.14.0 ClusterName:old-k8s-version-20210915203352-22848 Namespace:default
APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.1.0@sha256:7f80b5ba141bead69c4fee8661464857af300d7d7ed0274cf7beecedc00322e6 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Netw
ork: MultiNodeRequested:false ExtraDisks:0}
I0915 20:50:22.431061 59380 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}
I0915 20:50:22.571854 59380 cli_runner.go:115] Run: docker system info --format "{{json .}}"
I0915 20:50:23.838633 59380 cli_runner.go:168] Completed: docker system info --format "{{json .}}": (1.2665219s)
I0915 20:50:23.839558 59380 info.go:263] docker info: {ID:AZM6:4F7P:D7J3:PGKE:EIYN:3OQU:SEA3:BB2T:P6VC:GKKH:UKSA:R2VX Containers:5 ContainersRunning:4 ContainersPaused:0 ContainersStopped:1 Images:7 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:78 OomKillDisable:true NGoroutines:74 SystemTime:2021-09-15 20:50:23.3020414 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:4 KernelVersion:4.19.121-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:https://inde
x.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:4 MemTotal:20973547520 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[]
ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:C:\ProgramData\Docker\cli-plugins\docker-app.exe SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:C:\ProgramData\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:scan Path:C:\ProgramData\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.5.0]] Warnings:<nil>}}
I0915 20:50:23.840176 59380 start_flags.go:737] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0915 20:50:23.840176 59380 cni.go:93] Creating CNI manager for ""
I0915 20:50:23.840176 59380 cni.go:167] CNI unnecessary in this configuration, recommending no CNI
I0915 20:50:23.840383 59380 start_flags.go:278] config:
{Name:old-k8s-version-20210915203352-22848 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.14.0 ClusterName:old-k8s-version-20210915203352-22848 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.lo
cal ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.1.0@sha256:7f80b5ba141bead69c4fee8661464857af300d7d7ed0274cf7beecedc00322e6 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
I0915 20:50:23.842491 59380 out.go:177] * Starting control plane node old-k8s-version-20210915203352-22848 in cluster old-k8s-version-20210915203352-22848
I0915 20:50:23.842491 59380 cache.go:118] Beginning downloading kic base image for docker with docker
I0915 20:50:23.845491 59380 out.go:177] * Pulling base image ...
I0915 20:50:23.846007 59380 preload.go:131] Checking if preload exists for k8s version v1.14.0 and runtime docker
I0915 20:50:23.846007 59380 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon
I0915 20:50:23.846401 59380 preload.go:147] Found local preload: C:\Users\jenkins\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v12-v1.14.0-docker-overlay2-amd64.tar.lz4
I0915 20:50:23.846401 59380 cache.go:57] Caching tarball of preloaded images
I0915 20:50:23.846920 59380 preload.go:173] Found C:\Users\jenkins\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v12-v1.14.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0915 20:50:23.847686 59380 cache.go:60] Finished verifying existence of preloaded tar for v1.14.0 on docker
I0915 20:50:23.848133 59380 profile.go:148] Saving config to C:\Users\jenkins\minikube-integration\.minikube\profiles\old-k8s-version-20210915203352-22848\config.json ...
I0915 20:50:24.764703 59380 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon, skipping pull
I0915 20:50:24.765104 59380 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 exists in daemon, skipping load
I0915 20:50:24.765104 59380 cache.go:206] Successfully downloaded all kic artifacts
I0915 20:50:24.765690 59380 start.go:313] acquiring machines lock for old-k8s-version-20210915203352-22848: {Name:mkdf40fe6814eb846215b4f404333c923849772e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0915 20:50:24.765831 59380 start.go:317] acquired machines lock for "old-k8s-version-20210915203352-22848" in 0s
I0915 20:50:24.765831 59380 start.go:93] Skipping create...Using existing machine configuration
I0915 20:50:24.765831 59380 fix.go:55] fixHost starting:
I0915 20:50:24.832135 59380 cli_runner.go:115] Run: docker container inspect old-k8s-version-20210915203352-22848 --format={{.State.Status}}
I0915 20:50:25.799129 59380 fix.go:108] recreateIfNeeded on old-k8s-version-20210915203352-22848: state=Stopped err=<nil>
W0915 20:50:25.799406 59380 fix.go:134] unexpected machine state, will restart: <nil>
I0915 20:50:25.803457 59380 out.go:177] * Restarting existing docker container for "old-k8s-version-20210915203352-22848" ...
I0915 20:50:25.816664 59380 cli_runner.go:115] Run: docker start old-k8s-version-20210915203352-22848
I0915 20:50:29.686528 59380 cli_runner.go:168] Completed: docker start old-k8s-version-20210915203352-22848: (3.8698873s)
I0915 20:50:29.710614 59380 cli_runner.go:115] Run: docker container inspect old-k8s-version-20210915203352-22848 --format={{.State.Status}}
I0915 20:50:30.520615 59380 kic.go:420] container "old-k8s-version-20210915203352-22848" state is running.
I0915 20:50:30.549428 59380 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20210915203352-22848
I0915 20:50:31.393630 59380 profile.go:148] Saving config to C:\Users\jenkins\minikube-integration\.minikube\profiles\old-k8s-version-20210915203352-22848\config.json ...
I0915 20:50:31.397377 59380 machine.go:88] provisioning docker machine ...
I0915 20:50:31.397377 59380 ubuntu.go:169] provisioning hostname "old-k8s-version-20210915203352-22848"
I0915 20:50:31.421410 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 20:50:32.209847 59380 main.go:130] libmachine: Using SSH client type: native
I0915 20:50:32.211235 59380 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x11facc0] 0x11fdb80 <nil> [] 0s} 127.0.0.1 57811 <nil> <nil>}
I0915 20:50:32.211335 59380 main.go:130] libmachine: About to run SSH command:
sudo hostname old-k8s-version-20210915203352-22848 && echo "old-k8s-version-20210915203352-22848" | sudo tee /etc/hostname
I0915 20:50:32.238718 59380 main.go:130] libmachine: Error dialing TCP: ssh: handshake failed: EOF
I0915 20:50:36.054650 59380 main.go:130] libmachine: SSH cmd err, output: <nil>: old-k8s-version-20210915203352-22848
I0915 20:50:36.077646 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 20:50:36.844437 59380 main.go:130] libmachine: Using SSH client type: native
I0915 20:50:36.845038 59380 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x11facc0] 0x11fdb80 <nil> [] 0s} 127.0.0.1 57811 <nil> <nil>}
I0915 20:50:36.845038 59380 main.go:130] libmachine: About to run SSH command:
if ! grep -xq '.*\sold-k8s-version-20210915203352-22848' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 old-k8s-version-20210915203352-22848/g' /etc/hosts;
else
echo '127.0.1.1 old-k8s-version-20210915203352-22848' | sudo tee -a /etc/hosts;
fi
fi
I0915 20:50:37.367940 59380 main.go:130] libmachine: SSH cmd err, output: <nil>:
I0915 20:50:37.367940 59380 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins\minikube-integration\.minikube CaCertPath:C:\Users\jenkins\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins\minikube-integration\.minikube}
I0915 20:50:37.367940 59380 ubuntu.go:177] setting up certificates
I0915 20:50:37.367940 59380 provision.go:83] configureAuth start
I0915 20:50:37.389047 59380 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20210915203352-22848
I0915 20:50:38.155224 59380 provision.go:138] copyHostCerts
I0915 20:50:38.156223 59380 exec_runner.go:145] found C:\Users\jenkins\minikube-integration\.minikube/ca.pem, removing ...
I0915 20:50:38.156223 59380 exec_runner.go:208] rm: C:\Users\jenkins\minikube-integration\.minikube\ca.pem
I0915 20:50:38.156223 59380 exec_runner.go:152] cp: C:\Users\jenkins\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins\minikube-integration\.minikube/ca.pem (1078 bytes)
I0915 20:50:38.160579 59380 exec_runner.go:145] found C:\Users\jenkins\minikube-integration\.minikube/cert.pem, removing ...
I0915 20:50:38.160579 59380 exec_runner.go:208] rm: C:\Users\jenkins\minikube-integration\.minikube\cert.pem
I0915 20:50:38.161554 59380 exec_runner.go:152] cp: C:\Users\jenkins\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins\minikube-integration\.minikube/cert.pem (1123 bytes)
I0915 20:50:38.164613 59380 exec_runner.go:145] found C:\Users\jenkins\minikube-integration\.minikube/key.pem, removing ...
I0915 20:50:38.164846 59380 exec_runner.go:208] rm: C:\Users\jenkins\minikube-integration\.minikube\key.pem
I0915 20:50:38.165253 59380 exec_runner.go:152] cp: C:\Users\jenkins\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins\minikube-integration\.minikube/key.pem (1675 bytes)
I0915 20:50:38.167645 59380 provision.go:112] generating server cert: C:\Users\jenkins\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.old-k8s-version-20210915203352-22848 san=[192.168.85.2 127.0.0.1 localhost 127.0.0.1 minikube old-k8s-version-20210915203352-22848]
I0915 20:50:38.359335 59380 provision.go:172] copyRemoteCerts
I0915 20:50:38.375372 59380 ssh_runner.go:152] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0915 20:50:38.384388 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 20:50:39.212451 59380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57811 SSHKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\old-k8s-version-20210915203352-22848\id_rsa Username:docker}
I0915 20:50:39.618675 59380 ssh_runner.go:192] Completed: sudo mkdir -p /etc/docker /etc/docker /etc/docker: (1.2433104s)
I0915 20:50:39.619381 59380 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0915 20:50:39.919989 59380 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1281 bytes)
I0915 20:50:40.140173 59380 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0915 20:50:40.473316 59380 provision.go:86] duration metric: configureAuth took 3.1053946s
I0915 20:50:40.473316 59380 ubuntu.go:193] setting minikube options for container-runtime
I0915 20:50:40.473316 59380 config.go:177] Loaded profile config "old-k8s-version-20210915203352-22848": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.14.0
I0915 20:50:40.487030 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 20:50:41.278371 59380 main.go:130] libmachine: Using SSH client type: native
I0915 20:50:41.280603 59380 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x11facc0] 0x11fdb80 <nil> [] 0s} 127.0.0.1 57811 <nil> <nil>}
I0915 20:50:41.281140 59380 main.go:130] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0915 20:50:41.870131 59380 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay
I0915 20:50:41.870460 59380 ubuntu.go:71] root file system type: overlay
I0915 20:50:41.870748 59380 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0915 20:50:41.886233 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 20:50:42.691241 59380 main.go:130] libmachine: Using SSH client type: native
I0915 20:50:42.692081 59380 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x11facc0] 0x11fdb80 <nil> [] 0s} 127.0.0.1 57811 <nil> <nil>}
I0915 20:50:42.692081 59380 main.go:130] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0915 20:50:43.491557 59380 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0915 20:50:43.506402 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 20:50:44.338638 59380 main.go:130] libmachine: Using SSH client type: native
I0915 20:50:44.339359 59380 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x11facc0] 0x11fdb80 <nil> [] 0s} 127.0.0.1 57811 <nil> <nil>}
I0915 20:50:44.339359 59380 main.go:130] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0915 20:50:45.015825 59380 main.go:130] libmachine: SSH cmd err, output: <nil>:
I0915 20:50:45.015825 59380 machine.go:91] provisioned docker machine in 13.6185294s
I0915 20:50:45.015825 59380 start.go:267] post-start starting for "old-k8s-version-20210915203352-22848" (driver="docker")
I0915 20:50:45.015825 59380 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0915 20:50:45.035046 59380 ssh_runner.go:152] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0915 20:50:45.056647 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 20:50:45.784464 59380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57811 SSHKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\old-k8s-version-20210915203352-22848\id_rsa Username:docker}
I0915 20:50:46.055735 59380 ssh_runner.go:192] Completed: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs: (1.0206945s)
I0915 20:50:46.071647 59380 ssh_runner.go:152] Run: cat /etc/os-release
I0915 20:50:46.108489 59380 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0915 20:50:46.108700 59380 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0915 20:50:46.108700 59380 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0915 20:50:46.109179 59380 info.go:137] Remote host: Ubuntu 20.04.2 LTS
I0915 20:50:46.110141 59380 filesync.go:126] Scanning C:\Users\jenkins\minikube-integration\.minikube\addons for local assets ...
I0915 20:50:46.111515 59380 filesync.go:126] Scanning C:\Users\jenkins\minikube-integration\.minikube\files for local assets ...
I0915 20:50:46.114993 59380 filesync.go:149] local asset: C:\Users\jenkins\minikube-integration\.minikube\files\etc\ssl\certs\228482.pem -> 228482.pem in /etc/ssl/certs
I0915 20:50:46.137660 59380 ssh_runner.go:152] Run: sudo mkdir -p /etc/ssl/certs
I0915 20:50:46.247660 59380 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\files\etc\ssl\certs\228482.pem --> /etc/ssl/certs/228482.pem (1708 bytes)
I0915 20:50:46.421672 59380 start.go:270] post-start completed in 1.4058555s
I0915 20:50:46.429751 59380 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0915 20:50:46.444674 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 20:50:47.284656 59380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57811 SSHKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\old-k8s-version-20210915203352-22848\id_rsa Username:docker}
I0915 20:50:47.578039 59380 ssh_runner.go:192] Completed: sh -c "df -h /var | awk 'NR==2{print $5}'": (1.1481129s)
I0915 20:50:47.578179 59380 fix.go:57] fixHost completed within 22.8124833s
I0915 20:50:47.578179 59380 start.go:80] releasing machines lock for "old-k8s-version-20210915203352-22848", held for 22.8124833s
I0915 20:50:47.594692 59380 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" old-k8s-version-20210915203352-22848
I0915 20:50:48.350276 59380 ssh_runner.go:152] Run: curl -sS -m 2 https://k8s.gcr.io/
I0915 20:50:48.365172 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 20:50:48.365576 59380 ssh_runner.go:152] Run: systemctl --version
I0915 20:50:48.387045 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 20:50:49.254145 59380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57811 SSHKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\old-k8s-version-20210915203352-22848\id_rsa Username:docker}
I0915 20:50:49.259108 59380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57811 SSHKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\old-k8s-version-20210915203352-22848\id_rsa Username:docker}
I0915 20:50:49.580900 59380 ssh_runner.go:192] Completed: systemctl --version: (1.2153314s)
I0915 20:50:49.607404 59380 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service containerd
I0915 20:50:49.822327 59380 ssh_runner.go:192] Completed: curl -sS -m 2 https://k8s.gcr.io/: (1.4720596s)
I0915 20:50:49.840878 59380 ssh_runner.go:152] Run: sudo systemctl cat docker.service
I0915 20:50:49.941985 59380 cruntime.go:255] skipping containerd shutdown because we are bound to it
I0915 20:50:49.957886 59380 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service crio
I0915 20:50:50.032607 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0915 20:50:50.154084 59380 ssh_runner.go:152] Run: sudo systemctl unmask docker.service
I0915 20:50:50.786569 59380 ssh_runner.go:152] Run: sudo systemctl enable docker.socket
I0915 20:50:51.420071 59380 ssh_runner.go:152] Run: sudo systemctl cat docker.service
I0915 20:50:51.508000 59380 ssh_runner.go:152] Run: sudo systemctl daemon-reload
I0915 20:50:52.091017 59380 ssh_runner.go:152] Run: sudo systemctl start docker
I0915 20:50:52.231450 59380 ssh_runner.go:152] Run: docker version --format {{.Server.Version}}
I0915 20:50:52.632092 59380 ssh_runner.go:152] Run: docker version --format {{.Server.Version}}
I0915 20:50:52.966038 59380 out.go:204] * Preparing Kubernetes v1.14.0 on Docker 20.10.8 ...
I0915 20:50:52.986220 59380 cli_runner.go:115] Run: docker exec -t old-k8s-version-20210915203352-22848 dig +short host.docker.internal
I0915 20:50:54.820398 59380 cli_runner.go:168] Completed: docker exec -t old-k8s-version-20210915203352-22848 dig +short host.docker.internal: (1.8341886s)
I0915 20:50:54.820573 59380 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0915 20:50:54.851036 59380 ssh_runner.go:152] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0915 20:50:54.899948 59380 ssh_runner.go:152] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0915 20:50:55.205287 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 20:50:56.067949 59380 preload.go:131] Checking if preload exists for k8s version v1.14.0 and runtime docker
I0915 20:50:56.090483 59380 ssh_runner.go:152] Run: docker images --format {{.Repository}}:{{.Tag}}
I0915 20:50:56.469176 59380 docker.go:558] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
kubernetesui/dashboard:v2.1.0
kubernetesui/metrics-scraper:v1.0.4
k8s.gcr.io/kube-proxy:v1.14.0
k8s.gcr.io/kube-apiserver:v1.14.0
k8s.gcr.io/kube-controller-manager:v1.14.0
k8s.gcr.io/kube-scheduler:v1.14.0
k8s.gcr.io/coredns:1.3.1
k8s.gcr.io/etcd:3.3.10
busybox:1.28.4-glibc
k8s.gcr.io/pause:3.1
-- /stdout --
I0915 20:50:56.469176 59380 docker.go:489] Images already preloaded, skipping extraction
I0915 20:50:56.481951 59380 ssh_runner.go:152] Run: docker images --format {{.Repository}}:{{.Tag}}
I0915 20:50:56.819334 59380 docker.go:558] Got preloaded images: -- stdout --
gcr.io/k8s-minikube/storage-provisioner:v5
kubernetesui/dashboard:v2.1.0
kubernetesui/metrics-scraper:v1.0.4
k8s.gcr.io/kube-proxy:v1.14.0
k8s.gcr.io/kube-controller-manager:v1.14.0
k8s.gcr.io/kube-scheduler:v1.14.0
k8s.gcr.io/kube-apiserver:v1.14.0
k8s.gcr.io/coredns:1.3.1
k8s.gcr.io/etcd:3.3.10
busybox:1.28.4-glibc
k8s.gcr.io/pause:3.1
-- /stdout --
I0915 20:50:56.819334 59380 cache_images.go:78] Images are preloaded, skipping loading
I0915 20:50:56.835351 59380 ssh_runner.go:152] Run: docker info --format {{.CgroupDriver}}
I0915 20:50:57.905354 59380 ssh_runner.go:192] Completed: docker info --format {{.CgroupDriver}}: (1.069687s)
I0915 20:50:57.906004 59380 cni.go:93] Creating CNI manager for ""
I0915 20:50:57.906219 59380 cni.go:167] CNI unnecessary in this configuration, recommending no CNI
I0915 20:50:57.906375 59380 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I0915 20:50:57.906620 59380 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8443 KubernetesVersion:v1.14.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:old-k8s-version-20210915203352-22848 NodeName:old-k8s-version-20210915203352-22848 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.85.2 CgroupDriver:cgroupfs Clie
ntCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
I0915 20:50:57.906961 59380 kubeadm.go:157] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta1
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.85.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: /var/run/dockershim.sock
name: "old-k8s-version-20210915203352-22848"
kubeletExtraArgs:
node-ip: 192.168.85.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta1
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: old-k8s-version-20210915203352-22848
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
type: CoreDNS
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
listen-metrics-urls: http://127.0.0.1:2381,http://192.168.85.2:2381
kubernetesVersion: v1.14.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0915 20:50:57.907465 59380 kubeadm.go:909] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.14.0/kubelet --allow-privileged=true --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --client-ca-file=/var/lib/minikube/certs/ca.crt --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=old-k8s-version-20210915203352-22848 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
[Install]
config:
{KubernetesVersion:v1.14.0 ClusterName:old-k8s-version-20210915203352-22848 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I0915 20:50:57.926342 59380 ssh_runner.go:152] Run: sudo ls /var/lib/minikube/binaries/v1.14.0
I0915 20:50:58.015064 59380 binaries.go:44] Found k8s binaries, skipping transfer
I0915 20:50:58.028858 59380 ssh_runner.go:152] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0915 20:50:58.155715 59380 ssh_runner.go:319] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (434 bytes)
I0915 20:50:58.275723 59380 ssh_runner.go:319] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0915 20:50:58.460220 59380 ssh_runner.go:319] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2149 bytes)
I0915 20:50:58.665432 59380 ssh_runner.go:152] Run: grep 192.168.85.2 control-plane.minikube.internal$ /etc/hosts
I0915 20:50:58.704019 59380 ssh_runner.go:152] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0915 20:50:58.847795 59380 certs.go:52] Setting up C:\Users\jenkins\minikube-integration\.minikube\profiles\old-k8s-version-20210915203352-22848 for IP: 192.168.85.2
I0915 20:50:58.848546 59380 certs.go:179] skipping minikubeCA CA generation: C:\Users\jenkins\minikube-integration\.minikube\ca.key
I0915 20:50:58.848968 59380 certs.go:179] skipping proxyClientCA CA generation: C:\Users\jenkins\minikube-integration\.minikube\proxy-client-ca.key
I0915 20:50:58.849723 59380 certs.go:293] skipping minikube-user signed cert generation: C:\Users\jenkins\minikube-integration\.minikube\profiles\old-k8s-version-20210915203352-22848\client.key
I0915 20:50:58.850576 59380 certs.go:293] skipping minikube signed cert generation: C:\Users\jenkins\minikube-integration\.minikube\profiles\old-k8s-version-20210915203352-22848\apiserver.key.43b9df8c
I0915 20:50:58.850848 59380 certs.go:293] skipping aggregator signed cert generation: C:\Users\jenkins\minikube-integration\.minikube\profiles\old-k8s-version-20210915203352-22848\proxy-client.key
I0915 20:50:58.852858 59380 certs.go:376] found cert: C:\Users\jenkins\minikube-integration\.minikube\certs\C:\Users\jenkins\minikube-integration\.minikube\certs\22848.pem (1338 bytes)
W0915 20:50:58.853382 59380 certs.go:372] ignoring C:\Users\jenkins\minikube-integration\.minikube\certs\C:\Users\jenkins\minikube-integration\.minikube\certs\22848_empty.pem, impossibly tiny 0 bytes
I0915 20:50:58.853568 59380 certs.go:376] found cert: C:\Users\jenkins\minikube-integration\.minikube\certs\C:\Users\jenkins\minikube-integration\.minikube\certs\ca-key.pem (1679 bytes)
I0915 20:50:58.854070 59380 certs.go:376] found cert: C:\Users\jenkins\minikube-integration\.minikube\certs\C:\Users\jenkins\minikube-integration\.minikube\certs\ca.pem (1078 bytes)
I0915 20:50:58.854495 59380 certs.go:376] found cert: C:\Users\jenkins\minikube-integration\.minikube\certs\C:\Users\jenkins\minikube-integration\.minikube\certs\cert.pem (1123 bytes)
I0915 20:50:58.855055 59380 certs.go:376] found cert: C:\Users\jenkins\minikube-integration\.minikube\certs\C:\Users\jenkins\minikube-integration\.minikube\certs\key.pem (1675 bytes)
I0915 20:50:58.865137 59380 certs.go:376] found cert: C:\Users\jenkins\minikube-integration\.minikube\files\etc\ssl\certs\C:\Users\jenkins\minikube-integration\.minikube\files\etc\ssl\certs\228482.pem (1708 bytes)
I0915 20:50:58.870177 59380 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\profiles\old-k8s-version-20210915203352-22848\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
I0915 20:50:59.017619 59380 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\profiles\old-k8s-version-20210915203352-22848\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0915 20:50:59.192677 59380 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\profiles\old-k8s-version-20210915203352-22848\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0915 20:50:59.378016 59380 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\profiles\old-k8s-version-20210915203352-22848\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0915 20:50:59.519256 59380 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0915 20:50:59.678179 59380 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0915 20:50:59.915794 59380 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0915 20:51:00.106591 59380 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0915 20:51:00.314082 59380 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\files\etc\ssl\certs\228482.pem --> /usr/share/ca-certificates/228482.pem (1708 bytes)
I0915 20:51:00.449164 59380 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0915 20:51:00.587977 59380 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\certs\22848.pem --> /usr/share/ca-certificates/22848.pem (1338 bytes)
I0915 20:51:00.749821 59380 ssh_runner.go:319] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0915 20:51:00.912270 59380 ssh_runner.go:152] Run: openssl version
I0915 20:51:00.994817 59380 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/228482.pem && ln -fs /usr/share/ca-certificates/228482.pem /etc/ssl/certs/228482.pem"
I0915 20:51:01.085003 59380 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/228482.pem
I0915 20:51:01.138775 59380 certs.go:419] hashing: -rw-r--r-- 1 root root 1708 Sep 15 18:55 /usr/share/ca-certificates/228482.pem
I0915 20:51:01.168014 59380 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/228482.pem
I0915 20:51:01.233245 59380 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/228482.pem /etc/ssl/certs/3ec20f2e.0"
I0915 20:51:01.305535 59380 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0915 20:51:01.411409 59380 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0915 20:51:01.456111 59380 certs.go:419] hashing: -rw-r--r-- 1 root root 1111 Sep 15 18:34 /usr/share/ca-certificates/minikubeCA.pem
I0915 20:51:01.484259 59380 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0915 20:51:01.536569 59380 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0915 20:51:01.623857 59380 ssh_runner.go:152] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/22848.pem && ln -fs /usr/share/ca-certificates/22848.pem /etc/ssl/certs/22848.pem"
I0915 20:51:01.740760 59380 ssh_runner.go:152] Run: ls -la /usr/share/ca-certificates/22848.pem
I0915 20:51:01.775316 59380 certs.go:419] hashing: -rw-r--r-- 1 root root 1338 Sep 15 18:55 /usr/share/ca-certificates/22848.pem
I0915 20:51:01.794658 59380 ssh_runner.go:152] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/22848.pem
I0915 20:51:01.871995 59380 ssh_runner.go:152] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/22848.pem /etc/ssl/certs/51391683.0"
I0915 20:51:01.960664 59380 kubeadm.go:390] StartCluster: {Name:old-k8s-version-20210915203352-22848 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.14.0 ClusterName:old-k8s-version-20210915203352-22848 Namespace:default APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.1.0@sha256:7f80b5ba141bead69c4fee8661464857af300d7d7ed0274cf7beecedc00322e6 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeReques
ted:false ExtraDisks:0}
I0915 20:51:01.972520 59380 ssh_runner.go:152] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0915 20:51:02.270011 59380 ssh_runner.go:152] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0915 20:51:02.341808 59380 kubeadm.go:401] found existing configuration files, will attempt cluster restart
I0915 20:51:02.345324 59380 kubeadm.go:600] restartCluster start
I0915 20:51:02.376944 59380 ssh_runner.go:152] Run: sudo test -d /data/minikube
I0915 20:51:02.442171 59380 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I0915 20:51:02.456637 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 20:51:03.201303 59380 kubeconfig.go:117] verify returned: extract IP: "old-k8s-version-20210915203352-22848" does not appear in C:\Users\jenkins\minikube-integration\kubeconfig
I0915 20:51:03.202928 59380 kubeconfig.go:128] "old-k8s-version-20210915203352-22848" context is missing from C:\Users\jenkins\minikube-integration\kubeconfig - will repair!
I0915 20:51:03.205445 59380 lock.go:36] WriteFile acquiring C:\Users\jenkins\minikube-integration\kubeconfig: {Name:mk312e0248780fd448f3a83862df8ee597f47373 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 20:51:03.264106 59380 ssh_runner.go:152] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I0915 20:51:03.352176 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:03.367722 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:03.454674 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:03.655427 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:03.672146 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:03.756122 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:03.855916 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:03.877207 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:03.963802 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:04.058696 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:04.076310 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:04.185207 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:04.256758 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:04.273723 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:04.394739 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:04.455581 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:04.470530 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:04.559519 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:04.655428 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:04.668227 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:04.745180 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:04.856244 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:04.877763 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:04.980750 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:05.059908 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:05.076776 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:05.176351 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:05.255720 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:05.275914 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:05.417375 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:05.455846 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:05.478731 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:05.596342 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:05.656902 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:05.672402 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:05.770655 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:05.855178 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:05.886580 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:06.052438 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:06.055259 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:06.079971 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:06.200676 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:06.255708 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:06.272544 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:06.422330 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:06.455143 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:06.469648 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:06.647162 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:06.647162 59380 api_server.go:164] Checking apiserver status ...
I0915 20:51:06.660160 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W0915 20:51:06.819274 59380 api_server.go:168] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1
stdout:
stderr:
I0915 20:51:06.819274 59380 kubeadm.go:575] needs reconfigure: apiserver error: timed out waiting for the condition
I0915 20:51:06.819274 59380 kubeadm.go:1032] stopping kube-system containers ...
I0915 20:51:06.843295 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0915 20:51:07.463836 59380 docker.go:390] Stopping containers: [2e8024166c5f 028e632b2947 6725e46f9238 3b9130022485 379a838db2dd d108901bec10 e9654a15ffc5 53f543bce41d 08719ca43a1d 54fce4ae4236 d264b3e84f3f cdd4124f0db3 4b80283bd759 dd0d351f0d00 09a68128c04f 31222e7e4d55 793c21b00c62]
I0915 20:51:07.477079 59380 ssh_runner.go:152] Run: docker stop 2e8024166c5f 028e632b2947 6725e46f9238 3b9130022485 379a838db2dd d108901bec10 e9654a15ffc5 53f543bce41d 08719ca43a1d 54fce4ae4236 d264b3e84f3f cdd4124f0db3 4b80283bd759 dd0d351f0d00 09a68128c04f 31222e7e4d55 793c21b00c62
I0915 20:51:08.026849 59380 ssh_runner.go:152] Run: sudo systemctl stop kubelet
I0915 20:51:08.205321 59380 ssh_runner.go:152] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0915 20:51:08.355065 59380 kubeadm.go:154] found existing configuration files:
-rw------- 1 root root 5747 Sep 15 20:43 /etc/kubernetes/admin.conf
-rw------- 1 root root 5783 Sep 15 20:43 /etc/kubernetes/controller-manager.conf
-rw------- 1 root root 5935 Sep 15 20:43 /etc/kubernetes/kubelet.conf
-rw------- 1 root root 5731 Sep 15 20:43 /etc/kubernetes/scheduler.conf
I0915 20:51:08.374545 59380 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0915 20:51:08.485693 59380 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0915 20:51:08.582349 59380 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0915 20:51:08.688440 59380 ssh_runner.go:152] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0915 20:51:08.777056 59380 ssh_runner.go:152] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0915 20:51:08.853815 59380 kubeadm.go:676] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
I0915 20:51:08.853815 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.14.0:$PATH kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
I0915 20:51:10.058340 59380 ssh_runner.go:192] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.14.0:$PATH kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml": (1.2045321s)
I0915 20:51:10.058787 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.14.0:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
I0915 20:51:13.172892 59380 ssh_runner.go:192] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.14.0:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (3.1141241s)
I0915 20:51:13.172892 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.14.0:$PATH kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
I0915 20:51:15.322182 59380 ssh_runner.go:192] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.14.0:$PATH kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml": (2.1493022s)
I0915 20:51:15.322182 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.14.0:$PATH kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
I0915 20:51:15.801312 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.14.0:$PATH kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
I0915 20:51:16.159213 59380 api_server.go:50] waiting for apiserver process to appear ...
I0915 20:51:16.183842 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:16.942183 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:17.452196 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:17.954055 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:18.452594 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:18.954226 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:19.447346 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:19.947962 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:20.454240 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:20.954157 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:21.444601 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:21.953115 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:22.439832 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:22.941903 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:23.459660 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:23.951082 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:24.444646 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:24.938030 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:25.444303 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:25.941836 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:26.444681 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:26.956056 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:27.456741 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:27.953989 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:28.442249 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:28.940934 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:29.445051 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:29.948449 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:30.442541 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:30.942611 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:31.444759 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:31.946106 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:32.445762 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:32.944188 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:33.450796 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:33.943799 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:34.451407 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:34.942634 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:35.437475 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:35.951797 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:36.962913 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:37.940358 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:38.957033 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:39.435185 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 20:51:40.069090 59380 api_server.go:70] duration metric: took 23.9100213s to wait for apiserver process to appear ...
I0915 20:51:40.069280 59380 api_server.go:86] waiting for apiserver healthz status ...
I0915 20:51:40.069280 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:51:40.096979 59380 api_server.go:255] stopped: https://127.0.0.1:57815/healthz: Get "https://127.0.0.1:57815/healthz": EOF
I0915 20:51:40.597242 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:51:45.599023 59380 api_server.go:255] stopped: https://127.0.0.1:57815/healthz: Get "https://127.0.0.1:57815/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0915 20:51:46.101120 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:51:51.102079 59380 api_server.go:255] stopped: https://127.0.0.1:57815/healthz: Get "https://127.0.0.1:57815/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0915 20:51:51.597167 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:51:56.598617 59380 api_server.go:255] stopped: https://127.0.0.1:57815/healthz: Get "https://127.0.0.1:57815/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0915 20:51:57.098567 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:02.101726 59380 api_server.go:255] stopped: https://127.0.0.1:57815/healthz: Get "https://127.0.0.1:57815/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0915 20:52:02.597329 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:07.598604 59380 api_server.go:255] stopped: https://127.0.0.1:57815/healthz: Get "https://127.0.0.1:57815/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0915 20:52:08.098090 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:13.101077 59380 api_server.go:255] stopped: https://127.0.0.1:57815/healthz: Get "https://127.0.0.1:57815/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
I0915 20:52:13.605640 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:17.901897 59380 api_server.go:265] https://127.0.0.1:57815/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0915 20:52:17.901897 59380 api_server.go:101] status: https://127.0.0.1:57815/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0915 20:52:18.097030 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:18.575121 59380 api_server.go:265] https://127.0.0.1:57815/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0915 20:52:18.575121 59380 api_server.go:101] status: https://127.0.0.1:57815/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0915 20:52:18.597854 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:18.807643 59380 api_server.go:265] https://127.0.0.1:57815/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W0915 20:52:18.807884 59380 api_server.go:101] status: https://127.0.0.1:57815/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
I0915 20:52:19.097345 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:19.222325 59380 api_server.go:265] https://127.0.0.1:57815/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
W0915 20:52:19.222684 59380 api_server.go:101] status: https://127.0.0.1:57815/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[-]poststarthook/bootstrap-controller failed: reason withheld
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
I0915 20:52:19.598017 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:19.719343 59380 api_server.go:265] https://127.0.0.1:57815/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
W0915 20:52:19.719343 59380 api_server.go:101] status: https://127.0.0.1:57815/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
I0915 20:52:20.098665 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:22.159035 59380 api_server.go:265] https://127.0.0.1:57815/healthz returned 500:
[+]ping ok
[+]log ok
[-]etcd failed: reason withheld
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
W0915 20:52:22.159480 59380 api_server.go:101] status: https://127.0.0.1:57815/healthz returned error 500:
[+]ping ok
[+]log ok
[-]etcd failed: reason withheld
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
I0915 20:52:22.598490 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:23.468592 59380 api_server.go:265] https://127.0.0.1:57815/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
W0915 20:52:23.468788 59380 api_server.go:101] status: https://127.0.0.1:57815/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
I0915 20:52:23.597306 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:23.760928 59380 api_server.go:265] https://127.0.0.1:57815/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
W0915 20:52:23.761132 59380 api_server.go:101] status: https://127.0.0.1:57815/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
I0915 20:52:24.097784 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:24.732468 59380 api_server.go:265] https://127.0.0.1:57815/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
W0915 20:52:24.732830 59380 api_server.go:101] status: https://127.0.0.1:57815/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
I0915 20:52:25.099513 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:25.286447 59380 api_server.go:265] https://127.0.0.1:57815/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
W0915 20:52:25.286915 59380 api_server.go:101] status: https://127.0.0.1:57815/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
I0915 20:52:25.597539 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:25.946230 59380 api_server.go:265] https://127.0.0.1:57815/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
W0915 20:52:25.946844 59380 api_server.go:101] status: https://127.0.0.1:57815/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
I0915 20:52:26.098234 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:26.160786 59380 api_server.go:265] https://127.0.0.1:57815/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
W0915 20:52:26.160786 59380 api_server.go:101] status: https://127.0.0.1:57815/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
I0915 20:52:26.598381 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:26.740583 59380 api_server.go:265] https://127.0.0.1:57815/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
W0915 20:52:26.740785 59380 api_server.go:101] status: https://127.0.0.1:57815/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
I0915 20:52:27.097330 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:27.310201 59380 api_server.go:265] https://127.0.0.1:57815/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
W0915 20:52:27.310201 59380 api_server.go:101] status: https://127.0.0.1:57815/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/ca-registration ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/apiservice-openapi-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
healthz check failed
I0915 20:52:27.598721 59380 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57815/healthz ...
I0915 20:52:27.777414 59380 api_server.go:265] https://127.0.0.1:57815/healthz returned 200:
ok
I0915 20:52:28.151476 59380 api_server.go:139] control plane version: v1.14.0
I0915 20:52:28.151476 59380 api_server.go:129] duration metric: took 48.0824883s to wait for apiserver health ...
I0915 20:52:28.152445 59380 cni.go:93] Creating CNI manager for ""
I0915 20:52:28.152445 59380 cni.go:167] CNI unnecessary in this configuration, recommending no CNI
I0915 20:52:28.152445 59380 system_pods.go:43] waiting for kube-system pods to appear ...
I0915 20:52:28.270836 59380 system_pods.go:59] 8 kube-system pods found
I0915 20:52:28.270836 59380 system_pods.go:61] "coredns-fb8b8dccf-7ks7k" [dbd5260b-1665-11ec-901b-02421148780c] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
I0915 20:52:28.270836 59380 system_pods.go:61] "etcd-old-k8s-version-20210915203352-22848" [e30f5d24-1665-11ec-901b-02421148780c] Running
I0915 20:52:28.270836 59380 system_pods.go:61] "kube-apiserver-old-k8s-version-20210915203352-22848" [e8879afc-1665-11ec-901b-02421148780c] Running
I0915 20:52:28.270836 59380 system_pods.go:61] "kube-controller-manager-old-k8s-version-20210915203352-22848" [d39e09db-1666-11ec-96ab-0242535a2e8f] Pending
I0915 20:52:28.270836 59380 system_pods.go:61] "kube-proxy-f2dsj" [dbdeb1ac-1665-11ec-901b-02421148780c] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])
I0915 20:52:28.270836 59380 system_pods.go:61] "kube-scheduler-old-k8s-version-20210915203352-22848" [dab2ebb8-1665-11ec-901b-02421148780c] Running
I0915 20:52:28.270836 59380 system_pods.go:61] "metrics-server-8546d8b77b-fth4j" [71867ad0-1666-11ec-901b-02421148780c] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0915 20:52:28.270836 59380 system_pods.go:61] "storage-provisioner" [f3bbc18f-1665-11ec-901b-02421148780c] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
I0915 20:52:28.271106 59380 system_pods.go:74] duration metric: took 118.6614ms to wait for pod list to return data ...
I0915 20:52:28.271106 59380 node_conditions.go:102] verifying NodePressure condition ...
I0915 20:52:28.673765 59380 node_conditions.go:122] node storage ephemeral capacity is 65792556Ki
I0915 20:52:28.673765 59380 node_conditions.go:123] node cpu capacity is 4
I0915 20:52:28.673765 59380 node_conditions.go:105] duration metric: took 402.6616ms to run NodePressure ...
I0915 20:52:28.673765 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.14.0:$PATH kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"
I0915 20:52:36.364170 59380 ssh_runner.go:192] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.14.0:$PATH kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml": (7.6904516s)
I0915 20:52:36.364383 59380 kubeadm.go:731] waiting for restarted kubelet to initialise ...
I0915 20:52:36.460260 59380 retry.go:31] will retry after 276.165072ms: kubelet not initialised
I0915 20:52:36.826605 59380 retry.go:31] will retry after 540.190908ms: kubelet not initialised
I0915 20:52:37.431022 59380 retry.go:31] will retry after 655.06503ms: kubelet not initialised
I0915 20:52:38.414740 59380 retry.go:31] will retry after 791.196345ms: kubelet not initialised
I0915 20:52:39.314909 59380 retry.go:31] will retry after 1.170244332s: kubelet not initialised
I0915 20:52:40.519753 59380 retry.go:31] will retry after 2.253109428s: kubelet not initialised
I0915 20:52:42.842868 59380 retry.go:31] will retry after 1.610739793s: kubelet not initialised
I0915 20:52:44.519102 59380 kubeadm.go:746] kubelet initialised
I0915 20:52:44.519102 59380 kubeadm.go:747] duration metric: took 8.1547682s waiting for restarted kubelet to initialise ...
I0915 20:52:44.519436 59380 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0915 20:52:44.595891 59380 pod_ready.go:78] waiting up to 4m0s for pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace to be "Ready" ...
I0915 20:52:46.772539 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:52:49.463886 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:52:52.070609 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:52:54.277685 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:52:56.765054 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:52:58.903459 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:00.910720 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:03.365243 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:05.774985 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:07.859725 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:10.226076 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:12.770322 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:15.324821 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:17.327773 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:19.837662 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:22.600664 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:24.761973 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:27.263182 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:29.321626 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:31.773950 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:33.825958 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:35.829773 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:37.837882 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:39.916230 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:42.297871 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:44.733515 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:47.208400 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:47.975258 59380 pod_ready.go:92] pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace has status "Ready":"True"
I0915 20:53:47.975456 59380 pod_ready.go:81] duration metric: took 1m3.3799564s waiting for pod "coredns-fb8b8dccf-7ks7k" in "kube-system" namespace to be "Ready" ...
I0915 20:53:47.975456 59380 pod_ready.go:78] waiting up to 4m0s for pod "etcd-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 20:53:48.508921 59380 pod_ready.go:92] pod "etcd-old-k8s-version-20210915203352-22848" in "kube-system" namespace has status "Ready":"True"
I0915 20:53:48.508921 59380 pod_ready.go:81] duration metric: took 533.4685ms waiting for pod "etcd-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 20:53:48.509171 59380 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 20:53:48.764240 59380 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-20210915203352-22848" in "kube-system" namespace has status "Ready":"True"
I0915 20:53:48.764240 59380 pod_ready.go:81] duration metric: took 255.0704ms waiting for pod "kube-apiserver-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 20:53:48.764240 59380 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 20:53:48.834352 59380 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-20210915203352-22848" in "kube-system" namespace has status "Ready":"True"
I0915 20:53:48.834685 59380 pod_ready.go:81] duration metric: took 70.2304ms waiting for pod "kube-controller-manager-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 20:53:48.834685 59380 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-f2dsj" in "kube-system" namespace to be "Ready" ...
I0915 20:53:49.124943 59380 pod_ready.go:92] pod "kube-proxy-f2dsj" in "kube-system" namespace has status "Ready":"True"
I0915 20:53:49.125303 59380 pod_ready.go:81] duration metric: took 290.6196ms waiting for pod "kube-proxy-f2dsj" in "kube-system" namespace to be "Ready" ...
I0915 20:53:49.125303 59380 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 20:53:49.400080 59380 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-20210915203352-22848" in "kube-system" namespace has status "Ready":"True"
I0915 20:53:49.400080 59380 pod_ready.go:81] duration metric: took 274.7788ms waiting for pod "kube-scheduler-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 20:53:49.400080 59380 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace to be "Ready" ...
I0915 20:53:51.534637 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:53.838596 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:56.347980 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:53:58.843524 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:01.311631 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:03.343745 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:05.877698 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:08.298994 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:10.398890 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:12.818997 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:14.823374 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:16.879593 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:18.930122 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:21.155792 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:23.517364 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:26.185696 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:28.578935 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:30.965313 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:32.995717 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:35.620458 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:38.344059 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:40.416874 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:42.560861 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:44.709620 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:46.866714 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:49.159726 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:51.430326 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:53.836833 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:55.903062 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:54:58.307083 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:00.377411 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:02.612539 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:04.966661 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:07.381013 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:09.857241 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:11.905267 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:14.556622 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:16.932276 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:18.973358 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:21.447986 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:23.582356 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:25.934739 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:28.372448 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:30.661473 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:32.834603 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:34.858209 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:36.886962 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:39.568057 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:41.950835 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:44.376520 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:46.946597 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:49.348524 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:51.609340 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:53.855014 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:55.861557 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:55:58.134156 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:00.491453 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:02.563196 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:04.662009 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:06.811787 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:09.023691 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:11.469246 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:13.979282 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:16.342884 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:18.821882 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:21.054554 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:23.309111 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:25.325682 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:27.798230 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:30.334759 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:32.794389 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:34.815938 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:37.365632 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:40.067483 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:42.290154 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:44.470170 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:46.838919 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:49.370150 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:51.767444 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:53.816716 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:56.288501 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:56:58.313885 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:00.820529 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:02.827101 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:05.346235 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:07.782251 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:09.861993 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:12.308669 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:14.853447 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:17.269959 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:19.270409 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:21.326770 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:23.794349 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:25.827532 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:27.871943 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:30.334354 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:32.839854 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:34.851559 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:36.855525 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:38.884414 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:40.903520 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:43.357043 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:45.818801 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:49.048547 59380 pod_ready.go:102] pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace has status "Ready":"False"
I0915 20:57:49.742929 59380 pod_ready.go:81] duration metric: took 4m0.3443546s waiting for pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace to be "Ready" ...
E0915 20:57:49.742929 59380 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-8546d8b77b-fth4j" in "kube-system" namespace to be "Ready" (will not retry!)
I0915 20:57:49.742929 59380 pod_ready.go:38] duration metric: took 5m5.225399s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0915 20:57:49.743476 59380 kubeadm.go:604] restartCluster took 6m47.4006774s
W0915 20:57:49.744366 59380 out.go:242] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"
I0915 20:57:49.744366 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.14.0:$PATH kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I0915 20:58:16.685409 59380 ssh_runner.go:192] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.14.0:$PATH kubeadm reset --cri-socket /var/run/dockershim.sock --force": (26.9412131s)
I0915 20:58:16.715636 59380 ssh_runner.go:152] Run: sudo systemctl stop -f kubelet
I0915 20:58:16.830747 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0915 20:58:17.199845 59380 ssh_runner.go:152] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0915 20:58:17.305415 59380 kubeadm.go:220] ignoring SystemVerification for kubeadm because of docker driver
I0915 20:58:17.341076 59380 ssh_runner.go:152] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0915 20:58:17.438300 59380 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0915 20:58:17.438794 59380 ssh_runner.go:243] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.14.0:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0915 20:59:49.084926 59380 out.go:204] - Generating certificates and keys ...
I0915 20:59:49.090402 59380 out.go:204] - Booting up control plane ...
I0915 20:59:49.095946 59380 out.go:204] - Configuring RBAC rules ...
I0915 20:59:49.108830 59380 cni.go:93] Creating CNI manager for ""
I0915 20:59:49.109142 59380 cni.go:167] CNI unnecessary in this configuration, recommending no CNI
I0915 20:59:49.109812 59380 ssh_runner.go:152] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0915 20:59:49.127056 59380 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.14.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 20:59:49.127056 59380 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.14.0/kubectl label nodes minikube.k8s.io/version=v1.23.0 minikube.k8s.io/commit=0d321606059ead2904f4f5ddd59a9a7026c7ee04 minikube.k8s.io/name=old-k8s-version-20210915203352-22848 minikube.k8s.io/updated_at=2021_09_15T20_59_49_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
I0915 20:59:50.174156 59380 ssh_runner.go:192] Completed: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj": (1.0643503s)
I0915 20:59:50.174156 59380 ops.go:34] apiserver oom_adj: 16
I0915 20:59:50.174538 59380 ops.go:39] adjusting apiserver oom_adj to -10
I0915 20:59:50.174538 59380 ssh_runner.go:152] Run: /bin/bash -c "echo -10 | sudo tee /proc/$(pgrep kube-apiserver)/oom_adj"
I0915 20:59:55.533807 59380 ssh_runner.go:192] Completed: sudo /var/lib/minikube/binaries/v1.14.0/kubectl label nodes minikube.k8s.io/version=v1.23.0 minikube.k8s.io/commit=0d321606059ead2904f4f5ddd59a9a7026c7ee04 minikube.k8s.io/name=old-k8s-version-20210915203352-22848 minikube.k8s.io/updated_at=2021_09_15T20_59_49_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig: (6.4067919s)
I0915 20:59:55.534008 59380 ssh_runner.go:192] Completed: sudo /var/lib/minikube/binaries/v1.14.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig: (6.4069927s)
I0915 20:59:55.534008 59380 ssh_runner.go:192] Completed: /bin/bash -c "echo -10 | sudo tee /proc/$(pgrep kube-apiserver)/oom_adj": (5.3595038s)
I0915 20:59:55.554399 59380 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 20:59:56.820357 59380 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 20:59:57.833308 59380 ssh_runner.go:192] Completed: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (1.0129572s)
I0915 20:59:58.323287 59380 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 20:59:59.820293 59380 ssh_runner.go:192] Completed: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (1.4970155s)
I0915 21:00:00.317178 59380 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 21:00:01.459280 59380 ssh_runner.go:192] Completed: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (1.1421093s)
I0915 21:00:01.834158 59380 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 21:00:03.722510 59380 ssh_runner.go:192] Completed: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (1.8880671s)
I0915 21:00:03.816411 59380 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 21:00:06.826815 59380 ssh_runner.go:192] Completed: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (3.010423s)
I0915 21:00:07.315039 59380 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 21:00:09.286915 59380 ssh_runner.go:192] Completed: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (1.9718888s)
I0915 21:00:09.330531 59380 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 21:00:11.976283 59380 ssh_runner.go:192] Completed: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (2.6457689s)
I0915 21:00:12.321475 59380 ssh_runner.go:152] Run: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 21:00:15.342524 59380 ssh_runner.go:192] Completed: sudo /var/lib/minikube/binaries/v1.14.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (3.0210684s)
I0915 21:00:15.342683 59380 kubeadm.go:985] duration metric: took 26.2327223s to wait for elevateKubeSystemPrivileges.
I0915 21:00:15.342683 59380 kubeadm.go:392] StartCluster complete in 9m13.3854457s
I0915 21:00:15.342683 59380 settings.go:142] acquiring lock: {Name:mk81656fcf8bcddd49caaa1adb1c177165a02100 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 21:00:15.343429 59380 settings.go:150] Updating kubeconfig: C:\Users\jenkins\minikube-integration\kubeconfig
I0915 21:00:15.348588 59380 lock.go:36] WriteFile acquiring C:\Users\jenkins\minikube-integration\kubeconfig: {Name:mk312e0248780fd448f3a83862df8ee597f47373 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 21:00:16.208206 59380 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "old-k8s-version-20210915203352-22848" rescaled to 1
I0915 21:00:16.208402 59380 start.go:226] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8443 KubernetesVersion:v1.14.0 ControlPlane:true Worker:true}
I0915 21:00:16.212033 59380 out.go:177] * Verifying Kubernetes components...
I0915 21:00:16.210587 59380 addons.go:404] enableAddons start: toEnable=map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true], additional=[]
I0915 21:00:16.210934 59380 config.go:177] Loaded profile config "old-k8s-version-20210915203352-22848": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.14.0
I0915 21:00:16.212325 59380 addons.go:65] Setting storage-provisioner=true in profile "old-k8s-version-20210915203352-22848"
I0915 21:00:16.212531 59380 addons.go:153] Setting addon storage-provisioner=true in "old-k8s-version-20210915203352-22848"
I0915 21:00:16.212531 59380 addons.go:65] Setting default-storageclass=true in profile "old-k8s-version-20210915203352-22848"
I0915 21:00:16.212531 59380 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "old-k8s-version-20210915203352-22848"
I0915 21:00:16.212531 59380 addons.go:65] Setting dashboard=true in profile "old-k8s-version-20210915203352-22848"
I0915 21:00:16.212943 59380 addons.go:153] Setting addon dashboard=true in "old-k8s-version-20210915203352-22848"
W0915 21:00:16.212943 59380 addons.go:165] addon dashboard should already be in state true
I0915 21:00:16.212943 59380 host.go:66] Checking if "old-k8s-version-20210915203352-22848" exists ...
I0915 21:00:16.212943 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.14.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
W0915 21:00:16.212531 59380 addons.go:165] addon storage-provisioner should already be in state true
I0915 21:00:16.212531 59380 addons.go:65] Setting metrics-server=true in profile "old-k8s-version-20210915203352-22848"
I0915 21:00:16.216749 59380 addons.go:153] Setting addon metrics-server=true in "old-k8s-version-20210915203352-22848"
W0915 21:00:16.216749 59380 addons.go:165] addon metrics-server should already be in state true
I0915 21:00:16.216749 59380 host.go:66] Checking if "old-k8s-version-20210915203352-22848" exists ...
I0915 21:00:16.222413 59380 host.go:66] Checking if "old-k8s-version-20210915203352-22848" exists ...
I0915 21:00:16.231099 59380 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
I0915 21:00:16.240686 59380 cli_runner.go:115] Run: docker container inspect old-k8s-version-20210915203352-22848 --format={{.State.Status}}
I0915 21:00:16.242829 59380 cli_runner.go:115] Run: docker container inspect old-k8s-version-20210915203352-22848 --format={{.State.Status}}
I0915 21:00:16.273813 59380 cli_runner.go:115] Run: docker container inspect old-k8s-version-20210915203352-22848 --format={{.State.Status}}
I0915 21:00:16.277124 59380 cli_runner.go:115] Run: docker container inspect old-k8s-version-20210915203352-22848 --format={{.State.Status}}
I0915 21:00:17.194314 59380 out.go:177] - Using image kubernetesui/dashboard:v2.1.0
I0915 21:00:17.198127 59380 out.go:177] - Using image k8s.gcr.io/echoserver:1.4
I0915 21:00:17.198478 59380 addons.go:337] installing /etc/kubernetes/addons/dashboard-ns.yaml
I0915 21:00:17.198597 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
I0915 21:00:17.215090 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 21:00:17.251327 59380 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0915 21:00:17.251946 59380 addons.go:337] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0915 21:00:17.252074 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0915 21:00:17.272371 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 21:00:17.301744 59380 cli_runner.go:168] Completed: docker container inspect old-k8s-version-20210915203352-22848 --format={{.State.Status}}: (1.0279378s)
I0915 21:00:17.303718 59380 out.go:177] - Using image fake.domain/k8s.gcr.io/echoserver:1.4
I0915 21:00:17.303718 59380 addons.go:337] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0915 21:00:17.303718 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (396 bytes)
I0915 21:00:17.312721 59380 addons.go:153] Setting addon default-storageclass=true in "old-k8s-version-20210915203352-22848"
W0915 21:00:17.312721 59380 addons.go:165] addon default-storageclass should already be in state true
I0915 21:00:17.312721 59380 host.go:66] Checking if "old-k8s-version-20210915203352-22848" exists ...
I0915 21:00:17.314722 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 21:00:17.339723 59380 cli_runner.go:115] Run: docker container inspect old-k8s-version-20210915203352-22848 --format={{.State.Status}}
I0915 21:00:18.208562 59380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57811 SSHKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\old-k8s-version-20210915203352-22848\id_rsa Username:docker}
I0915 21:00:18.208562 59380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57811 SSHKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\old-k8s-version-20210915203352-22848\id_rsa Username:docker}
I0915 21:00:18.256256 59380 addons.go:337] installing /etc/kubernetes/addons/storageclass.yaml
I0915 21:00:18.256256 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0915 21:00:18.269178 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 21:00:18.338679 59380 cli_runner.go:168] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848: (1.0239637s)
I0915 21:00:18.339893 59380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57811 SSHKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\old-k8s-version-20210915203352-22848\id_rsa Username:docker}
I0915 21:00:19.046462 59380 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:57811 SSHKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\old-k8s-version-20210915203352-22848\id_rsa Username:docker}
I0915 21:00:21.534926 59380 addons.go:337] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
I0915 21:00:21.535195 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
I0915 21:00:22.530124 59380 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.14.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0915 21:00:22.798909 59380 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.14.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0915 21:00:23.256423 59380 addons.go:337] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
I0915 21:00:23.256645 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
I0915 21:00:24.129638 59380 addons.go:337] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0915 21:00:24.129822 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1849 bytes)
I0915 21:00:24.888014 59380 ssh_runner.go:192] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.14.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml": (8.6723847s)
I0915 21:00:24.888573 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.14.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.2 host.minikube.internal\n fallthrough\n }' | sudo /var/lib/minikube/binaries/v1.14.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0915 21:00:24.888573 59380 ssh_runner.go:192] Completed: sudo systemctl is-active --quiet service kubelet: (8.6573527s)
I0915 21:00:24.904827 59380 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-20210915203352-22848
I0915 21:00:25.752836 59380 node_ready.go:35] waiting up to 6m0s for node "old-k8s-version-20210915203352-22848" to be "Ready" ...
I0915 21:00:26.081216 59380 node_ready.go:49] node "old-k8s-version-20210915203352-22848" has status "Ready":"True"
I0915 21:00:26.081507 59380 node_ready.go:38] duration metric: took 328.673ms waiting for node "old-k8s-version-20210915203352-22848" to be "Ready" ...
I0915 21:00:26.082206 59380 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0915 21:00:26.195826 59380 pod_ready.go:78] waiting up to 6m0s for pod "coredns-fb8b8dccf-hgzn5" in "kube-system" namespace to be "Ready" ...
I0915 21:00:27.937283 59380 addons.go:337] installing /etc/kubernetes/addons/dashboard-configmap.yaml
I0915 21:00:27.937283 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
I0915 21:00:28.362298 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-hgzn5" in "kube-system" namespace has status "Ready":"False"
I0915 21:00:28.638878 59380 addons.go:337] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0915 21:00:28.638878 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2042 bytes)
I0915 21:00:28.967361 59380 addons.go:337] installing /etc/kubernetes/addons/dashboard-dp.yaml
I0915 21:00:28.967553 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)
I0915 21:00:30.473150 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-hgzn5" in "kube-system" namespace has status "Ready":"False"
I0915 21:00:31.268668 59380 pod_ready.go:97] error getting pod "coredns-fb8b8dccf-hgzn5" in "kube-system" namespace (skipping!): pods "coredns-fb8b8dccf-hgzn5" not found
I0915 21:00:31.268668 59380 pod_ready.go:81] duration metric: took 5.0728748s waiting for pod "coredns-fb8b8dccf-hgzn5" in "kube-system" namespace to be "Ready" ...
E0915 21:00:31.268668 59380 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-fb8b8dccf-hgzn5" in "kube-system" namespace (skipping!): pods "coredns-fb8b8dccf-hgzn5" not found
I0915 21:00:31.268668 59380 pod_ready.go:78] waiting up to 6m0s for pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace to be "Ready" ...
I0915 21:00:32.870358 59380 addons.go:337] installing /etc/kubernetes/addons/dashboard-role.yaml
I0915 21:00:32.870800 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
I0915 21:00:33.467789 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:00:33.933443 59380 addons.go:337] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0915 21:00:33.933622 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (418 bytes)
I0915 21:00:34.299843 59380 addons.go:337] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
I0915 21:00:34.299843 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
I0915 21:00:35.648121 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:00:38.115418 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:00:38.828682 59380 addons.go:337] installing /etc/kubernetes/addons/dashboard-sa.yaml
I0915 21:00:38.829102 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
I0915 21:00:40.251037 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:00:42.568268 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:00:44.822885 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:00:45.195360 59380 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.14.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0915 21:00:47.494547 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:00:47.552548 59380 addons.go:337] installing /etc/kubernetes/addons/dashboard-secret.yaml
I0915 21:00:47.552816 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
I0915 21:00:49.653794 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:00:52.146838 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:00:54.151419 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:00:56.471250 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:00:56.543060 59380 addons.go:337] installing /etc/kubernetes/addons/dashboard-svc.yaml
I0915 21:00:56.543244 59380 ssh_runner.go:319] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
I0915 21:00:59.085497 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:01.110633 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:03.117434 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:05.434982 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:05.648655 59380 ssh_runner.go:152] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.14.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
I0915 21:01:07.554451 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:09.951268 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:12.127879 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:18.201727 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:20.176124 59380 ssh_runner.go:192] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.14.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (57.6460696s)
I0915 21:01:20.176481 59380 ssh_runner.go:192] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.14.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (57.3777192s)
I0915 21:01:20.176638 59380 ssh_runner.go:192] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.14.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.65.2 host.minikube.internal\n fallthrough\n }' | sudo /var/lib/minikube/binaries/v1.14.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (55.2882621s)
I0915 21:01:20.176816 59380 start.go:729] {"host.minikube.internal": 192.168.65.2} host record injected into CoreDNS
I0915 21:01:20.663497 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:22.936576 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:23.246148 59380 ssh_runner.go:192] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.14.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (38.0510324s)
I0915 21:01:23.246535 59380 addons.go:375] Verifying addon metrics-server=true in "old-k8s-version-20210915203352-22848"
I0915 21:01:25.292294 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:27.574800 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:29.704252 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:30.670252 59380 ssh_runner.go:192] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.14.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (25.0215831s)
I0915 21:01:30.675627 59380 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
I0915 21:01:30.675920 59380 addons.go:406] enableAddons completed in 1m14.4658098s
I0915 21:01:31.930045 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:33.957283 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:36.008270 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:38.462846 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:40.477833 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:42.492692 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:45.004798 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:47.433645 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:49.452363 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:51.525296 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:53.947935 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:56.027075 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:58.606645 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:02:00.749044 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:02:02.986676 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:02:05.604697 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:02:08.342362 59380 pod_ready.go:92] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"True"
I0915 21:02:08.342362 59380 pod_ready.go:81] duration metric: took 1m37.0743164s waiting for pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.342628 59380 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.431670 59380 pod_ready.go:92] pod "etcd-old-k8s-version-20210915203352-22848" in "kube-system" namespace has status "Ready":"True"
I0915 21:02:08.431837 59380 pod_ready.go:81] duration metric: took 89.2095ms waiting for pod "etcd-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.431837 59380 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.530628 59380 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-20210915203352-22848" in "kube-system" namespace has status "Ready":"True"
I0915 21:02:08.530628 59380 pod_ready.go:81] duration metric: took 98.7918ms waiting for pod "kube-apiserver-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.530628 59380 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.623612 59380 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-20210915203352-22848" in "kube-system" namespace has status "Ready":"True"
I0915 21:02:08.623744 59380 pod_ready.go:81] duration metric: took 93.1164ms waiting for pod "kube-controller-manager-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.623744 59380 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-fjmvd" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.682303 59380 pod_ready.go:92] pod "kube-proxy-fjmvd" in "kube-system" namespace has status "Ready":"True"
I0915 21:02:08.682576 59380 pod_ready.go:81] duration metric: took 58.736ms waiting for pod "kube-proxy-fjmvd" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.682576 59380 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.764335 59380 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-20210915203352-22848" in "kube-system" namespace has status "Ready":"True"
I0915 21:02:08.764335 59380 pod_ready.go:81] duration metric: took 81.7595ms waiting for pod "kube-scheduler-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.764335 59380 pod_ready.go:38] duration metric: took 1m42.6827872s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0915 21:02:08.764335 59380 api_server.go:50] waiting for apiserver process to appear ...
I0915 21:02:08.788795 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0915 21:02:11.886042 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}: (3.0970689s)
I0915 21:02:11.886149 59380 logs.go:270] 1 containers: [3537b9c6e4ed]
I0915 21:02:11.900760 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0915 21:02:14.320564 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_etcd --format={{.ID}}: (2.4194268s)
I0915 21:02:14.320721 59380 logs.go:270] 1 containers: [0b52d929b618]
I0915 21:02:14.340316 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0915 21:02:16.462510 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_coredns --format={{.ID}}: (2.1221147s)
I0915 21:02:16.462510 59380 logs.go:270] 2 containers: [56f408c7ef80 edc543ebc579]
I0915 21:02:16.481520 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0915 21:02:17.909577 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}: (1.4279284s)
I0915 21:02:17.909577 59380 logs.go:270] 1 containers: [f62b255531be]
I0915 21:02:17.922156 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0915 21:02:19.029541 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}: (1.1073925s)
I0915 21:02:19.030029 59380 logs.go:270] 1 containers: [b6a7846cc5e6]
I0915 21:02:19.057397 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0915 21:02:20.309647 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}: (1.2511439s)
I0915 21:02:20.309647 59380 logs.go:270] 1 containers: [cf62060e4365]
I0915 21:02:20.325297 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0915 21:02:22.494620 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}: (2.1690651s)
I0915 21:02:22.494620 59380 logs.go:270] 1 containers: [2708aca9f909]
I0915 21:02:22.513090 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0915 21:02:23.899916 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}: (1.3868346s)
I0915 21:02:23.900058 59380 logs.go:270] 2 containers: [5dcc93538d3a 2444d44bba6b]
I0915 21:02:23.900058 59380 logs.go:123] Gathering logs for kube-apiserver [3537b9c6e4ed] ...
I0915 21:02:23.900058 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 3537b9c6e4ed"
I0915 21:02:26.584619 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 3537b9c6e4ed": (2.6845789s)
I0915 21:02:26.628390 59380 logs.go:123] Gathering logs for etcd [0b52d929b618] ...
I0915 21:02:26.628390 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 0b52d929b618"
I0915 21:02:29.188968 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 0b52d929b618": (2.5605947s)
I0915 21:02:29.222295 59380 logs.go:123] Gathering logs for coredns [56f408c7ef80] ...
I0915 21:02:29.222653 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 56f408c7ef80"
I0915 21:02:30.913622 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 56f408c7ef80": (1.6909792s)
I0915 21:02:30.914656 59380 logs.go:123] Gathering logs for Docker ...
I0915 21:02:30.914656 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0915 21:02:31.073495 59380 logs.go:123] Gathering logs for container status ...
I0915 21:02:31.073495 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0915 21:02:32.132766 59380 ssh_runner.go:192] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (1.0592772s)
I0915 21:02:32.134065 59380 logs.go:123] Gathering logs for dmesg ...
I0915 21:02:32.134065 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0915 21:02:32.761531 59380 logs.go:123] Gathering logs for describe nodes ...
I0915 21:02:32.761774 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.14.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0915 21:02:40.222423 59380 ssh_runner.go:192] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.14.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": (7.4606972s)
I0915 21:02:40.248362 59380 logs.go:123] Gathering logs for kube-scheduler [f62b255531be] ...
I0915 21:02:40.250291 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 f62b255531be"
I0915 21:02:44.722028 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 f62b255531be": (4.4715535s)
I0915 21:02:44.739482 59380 logs.go:123] Gathering logs for storage-provisioner [2708aca9f909] ...
I0915 21:02:44.739702 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 2708aca9f909"
I0915 21:02:48.982771 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 2708aca9f909": (4.2430962s)
I0915 21:02:48.982771 59380 logs.go:123] Gathering logs for kube-controller-manager [5dcc93538d3a] ...
I0915 21:02:48.982771 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 5dcc93538d3a"
I0915 21:02:57.130767 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 5dcc93538d3a": (8.1478521s)
I0915 21:02:57.167857 59380 logs.go:123] Gathering logs for coredns [edc543ebc579] ...
I0915 21:02:57.167857 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 edc543ebc579"
I0915 21:03:00.457615 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 edc543ebc579": (3.2897791s)
I0915 21:03:00.459196 59380 logs.go:123] Gathering logs for kube-controller-manager [2444d44bba6b] ...
I0915 21:03:00.459196 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 2444d44bba6b"
I0915 21:03:02.905669 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 2444d44bba6b": (2.4464887s)
I0915 21:03:02.906730 59380 logs.go:123] Gathering logs for kubelet ...
I0915 21:03:02.906730 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0915 21:03:03.939909 59380 ssh_runner.go:192] Completed: /bin/bash -c "sudo journalctl -u kubelet -n 400": (1.0331857s)
W0915 21:03:04.019616 59380 logs.go:138] Found kubelet problem: Sep 15 21:01:39 old-k8s-version-20210915203352-22848 kubelet[6242]: E0915 21:01:39.816057 6242 pod_workers.go:190] Error syncing pod 13c53a65-1668-11ec-9ee7-0242535a2e8f ("metrics-server-8546d8b77b-pwkmq_kube-system(13c53a65-1668-11ec-9ee7-0242535a2e8f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"
I0915 21:03:04.019616 59380 logs.go:123] Gathering logs for kube-proxy [b6a7846cc5e6] ...
I0915 21:03:04.020627 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 b6a7846cc5e6"
I0915 21:03:07.698325 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 b6a7846cc5e6": (3.6775764s)
I0915 21:03:07.699351 59380 logs.go:123] Gathering logs for kubernetes-dashboard [cf62060e4365] ...
I0915 21:03:07.699512 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 cf62060e4365"
I0915 21:03:11.626181 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 cf62060e4365": (3.9266946s)
I0915 21:03:11.627244 59380 out.go:311] Setting ErrFile to fd 2480...
I0915 21:03:11.627244 59380 out.go:345] TERM=,COLORTERM=, which probably does not support color
W0915 21:03:11.628241 59380 out.go:242] X Problems detected in kubelet:
X Problems detected in kubelet:
W0915 21:03:11.628241 59380 out.go:242] Sep 15 21:01:39 old-k8s-version-20210915203352-22848 kubelet[6242]: E0915 21:01:39.816057 6242 pod_workers.go:190] Error syncing pod 13c53a65-1668-11ec-9ee7-0242535a2e8f ("metrics-server-8546d8b77b-pwkmq_kube-system(13c53a65-1668-11ec-9ee7-0242535a2e8f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"
Sep 15 21:01:39 old-k8s-version-20210915203352-22848 kubelet[6242]: E0915 21:01:39.816057 6242 pod_workers.go:190] Error syncing pod 13c53a65-1668-11ec-9ee7-0242535a2e8f ("metrics-server-8546d8b77b-pwkmq_kube-system(13c53a65-1668-11ec-9ee7-0242535a2e8f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"
I0915 21:03:11.628241 59380 out.go:311] Setting ErrFile to fd 2480...
I0915 21:03:11.628241 59380 out.go:345] TERM=,COLORTERM=, which probably does not support color
I0915 21:03:21.642458 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 21:03:22.962331 59380 ssh_runner.go:192] Completed: sudo pgrep -xnf kube-apiserver.*minikube.*: (1.3198818s)
I0915 21:03:22.962331 59380 api_server.go:70] duration metric: took 3m6.7549273s to wait for apiserver process to appear ...
I0915 21:03:22.962331 59380 api_server.go:86] waiting for apiserver healthz status ...
I0915 21:03:22.973266 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0915 21:03:25.331696 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}: (2.3584456s)
I0915 21:03:25.331696 59380 logs.go:270] 1 containers: [3537b9c6e4ed]
I0915 21:03:25.354855 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0915 21:03:28.602931 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_etcd --format={{.ID}}: (3.2480972s)
I0915 21:03:28.602931 59380 logs.go:270] 1 containers: [0b52d929b618]
I0915 21:03:28.619223 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0915 21:03:31.478130 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_coredns --format={{.ID}}: (2.8589259s)
I0915 21:03:31.478960 59380 logs.go:270] 2 containers: [56f408c7ef80 edc543ebc579]
I0915 21:03:31.522508 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0915 21:03:34.377512 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}: (2.8550217s)
I0915 21:03:34.377512 59380 logs.go:270] 1 containers: [f62b255531be]
I0915 21:03:34.393177 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0915 21:03:35.911771 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}: (1.5186033s)
I0915 21:03:35.911910 59380 logs.go:270] 1 containers: [b6a7846cc5e6]
I0915 21:03:35.935753 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0915 21:03:39.083471 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}: (3.147738s)
I0915 21:03:39.083471 59380 logs.go:270] 1 containers: [cf62060e4365]
I0915 21:03:39.093501 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0915 21:03:43.154841 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}: (4.0613659s)
I0915 21:03:43.154841 59380 logs.go:270] 1 containers: [2708aca9f909]
I0915 21:03:43.166883 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0915 21:03:46.250128 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}: (3.0832639s)
I0915 21:03:46.250254 59380 logs.go:270] 2 containers: [5dcc93538d3a 2444d44bba6b]
I0915 21:03:46.250254 59380 logs.go:123] Gathering logs for describe nodes ...
I0915 21:03:46.250254 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.14.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
** /stderr **
start_stop_delete_test.go:244: failed to start minikube post-stop. args "out/minikube-windows-amd64.exe start -p old-k8s-version-20210915203352-22848 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker --kubernetes-version=v1.14.0": exit status 1
helpers_test.go:223: -----------------------post-mortem--------------------------------
helpers_test.go:231: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: docker inspect <======
helpers_test.go:232: (dbg) Run: docker inspect old-k8s-version-20210915203352-22848
helpers_test.go:236: (dbg) docker inspect old-k8s-version-20210915203352-22848:
-- stdout --
[
{
"Id": "9b27ec9d5a2cd174bf43f235c940004401f58a18a94c29ec4a6ee4a2b784f75d",
"Created": "2021-09-15T20:38:54.6399688Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 211404,
"ExitCode": 0,
"Error": "",
"StartedAt": "2021-09-15T20:50:29.5187633Z",
"FinishedAt": "2021-09-15T20:50:10.0365142Z"
},
"Image": "sha256:83b5a81388468b1ffcd3874b4f24c1406c63c33ac07797cc8bed6ad0207d36a8",
"ResolvConfPath": "/var/lib/docker/containers/9b27ec9d5a2cd174bf43f235c940004401f58a18a94c29ec4a6ee4a2b784f75d/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/9b27ec9d5a2cd174bf43f235c940004401f58a18a94c29ec4a6ee4a2b784f75d/hostname",
"HostsPath": "/var/lib/docker/containers/9b27ec9d5a2cd174bf43f235c940004401f58a18a94c29ec4a6ee4a2b784f75d/hosts",
"LogPath": "/var/lib/docker/containers/9b27ec9d5a2cd174bf43f235c940004401f58a18a94c29ec4a6ee4a2b784f75d/9b27ec9d5a2cd174bf43f235c940004401f58a18a94c29ec4a6ee4a2b784f75d-json.log",
"Name": "/old-k8s-version-20210915203352-22848",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"old-k8s-version-20210915203352-22848:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "old-k8s-version-20210915203352-22848",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "0"
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 2306867200,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [
{
"PathOnHost": "/dev/fuse",
"PathInContainer": "/dev/fuse",
"CgroupPermissions": "rwm"
}
],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 2306867200,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/c50296d19c7373d9d15bdd50bc7ff47de1d4c184edd1ad66ed8291d8261193a3-init/diff:/var/lib/docker/overlay2/a259804ff45c264548e9459111f8eb7e789339b3253b50b62afde896e9e19e34/diff:/var/lib/docker/overlay2/61882a81480713e64bf02bef67583a0609b2be0589d08187547a88789584af86/diff:/var/lib/docker/overlay2/a41d1f5e24156c1d438fe25c567f3c3492d15cb77b1bf5545be9086be845138a/diff:/var/lib/docker/overlay2/86e30e10438032d0a02b54850ad0316347488f3d5b831234af1e91f943269850/diff:/var/lib/docker/overlay2/f6962936c0c1b0636454847e8e963a472786602e15a00d5e020827c2372acfce/diff:/var/lib/docker/overlay2/5eee83c6029359aefecbba85cc6d456e3a5a97c3ef6e9f4850e8a53c62b30ef5/diff:/var/lib/docker/overlay2/fdaa4e134ab960962e0a388adaa3a6aa59dd139cc016dfd4cdf4565bc80e8469/diff:/var/lib/docker/overlay2/9e1b9be7e17136fa81b0a224e2fab9704d3234ca119d87c14f9a676bbdb023f5/diff:/var/lib/docker/overlay2/ffe06185e93cb7ae8d48d84ea9be8817f2ae3d2aae85114ce41477579e23debd/diff:/var/lib/docker/overlay2/221713
20a621ffe79c2acb0c13308b1b0cd3bc94a4083992e7b8589b820c625c/diff:/var/lib/docker/overlay2/eb2fb3ccafd6cb1c26a9642601357b3e0563e9e9361a5ab359bf1af592a0d709/diff:/var/lib/docker/overlay2/6081368e802a14f6f6a7424eb7af3f5f29f85bf59ed0a0709ce25b53738095cb/diff:/var/lib/docker/overlay2/fd7176e5912a824a0543fa3ab5170921538a287401ff8a451c90e1ef0fd8adea/diff:/var/lib/docker/overlay2/eec5078968f5e7332ff82191a780be0efef38aef75ea7cd67723ab3d2760c281/diff:/var/lib/docker/overlay2/d18d41a44c04cb695c4b69ac0db0d5807cee4ca8a5a695629f97e2d8d9cf9461/diff:/var/lib/docker/overlay2/b125406c01cea6a83fa5515a19bb6822d1194fcd47eeb1ed541b9304804a54be/diff:/var/lib/docker/overlay2/b49ae7a2c3101c5b094f611e08fb7b68d8688cb3c333066f697aafc1dc7c2c7e/diff:/var/lib/docker/overlay2/ce599106d279966257baab0cc43ed0366d690702b449073e812a47ae6698dedf/diff:/var/lib/docker/overlay2/5f005c2e8ab4cd52b59f5118e6f5e352dd834afde547ba1ee7b71141319e3547/diff:/var/lib/docker/overlay2/2b1f9abca5d32e21fe1da66b2604d858599b74fc9359bd55e050cebccaba5c7d/diff:/var/lib/d
ocker/overlay2/a5f956d0de2a0313dfbaefb921518d8a75267b71a9e7c68207a81682db5394b5/diff:/var/lib/docker/overlay2/e0050af32b9eb0f12404cf384139cd48050d4a969d090faaa07b9f42fe954627/diff:/var/lib/docker/overlay2/f18c15fd90b361f7a13265b5426d985a47e261abde790665028916551b5218f3/diff:/var/lib/docker/overlay2/0f266ad6b65c857206fd10e121b74564370ca213f5706493619b6a590c496660/diff:/var/lib/docker/overlay2/fc044060d3681022984120753b0c02afc05afbb256dbdfc9f7f5e966e1d98820/diff:/var/lib/docker/overlay2/91df5011d1388013be2af7bb3097195366fd38d1f46d472e630aab583779f7c0/diff:/var/lib/docker/overlay2/f810a7fbc880b9ff7c367b14e34088e851fa045d860ce4bf4c49999fcf814a6e/diff:/var/lib/docker/overlay2/318584cae4acc059b81627e00ae703167673c73d234d6e64e894fc3500750f90/diff:/var/lib/docker/overlay2/a2e1d86ffb5aec517fe891619294d506621a002f4c53e8d3103d5d4ce777ebaf/diff:/var/lib/docker/overlay2/12fd1d215a6881aa03a06f2b8a5415b483530db121b120b66940e1e5cd2e1b96/diff:/var/lib/docker/overlay2/28bbbfc0404aecb7d7d79b4c2bfec07cd44260c922a982af523bda70bbd
7be20/diff:/var/lib/docker/overlay2/4dc0077174d58a8904abddfc67a48e6dd082a1eebc72518af19da37b4eff7b2c/diff:/var/lib/docker/overlay2/4d39db844b44258dbb67b16662175b453df7bfd43274abbf1968486539955750/diff:/var/lib/docker/overlay2/ca34d73c6c31358a3eb714a014a5961863e05dee505a1cfca2c8829380ce362b/diff:/var/lib/docker/overlay2/0c0595112799a0b3604c58158946fb3d0657c4198a6a72e12fbe29a74174d3ea/diff:/var/lib/docker/overlay2/5fc43276da56e90293816918613014e7cec7bedc292a062d39d034c95d56351d/diff:/var/lib/docker/overlay2/71a282cb60752128ee370ced1695c67c421341d364956818e5852fd6714a0e64/diff:/var/lib/docker/overlay2/07723c7054e35caae4987fa66d3d1fd44de0d2875612274dde2bf04e8349b0a0/diff:/var/lib/docker/overlay2/0433db88749fb49b0f02cc65b7113c97134270991a8a82bbe7ff4432aae7e502/diff",
"MergedDir": "/var/lib/docker/overlay2/c50296d19c7373d9d15bdd50bc7ff47de1d4c184edd1ad66ed8291d8261193a3/merged",
"UpperDir": "/var/lib/docker/overlay2/c50296d19c7373d9d15bdd50bc7ff47de1d4c184edd1ad66ed8291d8261193a3/diff",
"WorkDir": "/var/lib/docker/overlay2/c50296d19c7373d9d15bdd50bc7ff47de1d4c184edd1ad66ed8291d8261193a3/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "old-k8s-version-20210915203352-22848",
"Source": "/var/lib/docker/volumes/old-k8s-version-20210915203352-22848/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "old-k8s-version-20210915203352-22848",
"Domainname": "",
"User": "root",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "old-k8s-version-20210915203352-22848",
"name.minikube.sigs.k8s.io": "old-k8s-version-20210915203352-22848",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "3a4ba5744cc7686e414b3dea11608c1cbf27a62a0632f8769e74344694292442",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "57811"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "57812"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "57813"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "57814"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "57815"
}
]
},
"SandboxKey": "/var/run/docker/netns/3a4ba5744cc7",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"old-k8s-version-20210915203352-22848": {
"IPAMConfig": {
"IPv4Address": "192.168.85.2"
},
"Links": null,
"Aliases": [
"9b27ec9d5a2c",
"old-k8s-version-20210915203352-22848"
],
"NetworkID": "d05bee2b7d78b979c0756af91adef980ef055503d6582e76d04d9610112497ba",
"EndpointID": "196f3b5e1add9aca66a26a35d443525724a171737b819f7a2def0f131919f8c9",
"Gateway": "192.168.85.1",
"IPAddress": "192.168.85.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:c0:a8:55:02",
"DriverOpts": null
}
}
}
}
]
-- /stdout --
helpers_test.go:240: (dbg) Run: out/minikube-windows-amd64.exe status --format={{.Host}} -p old-k8s-version-20210915203352-22848 -n old-k8s-version-20210915203352-22848
=== CONT TestStartStop/group/old-k8s-version/serial/SecondStart
helpers_test.go:240: (dbg) Done: out/minikube-windows-amd64.exe status --format={{.Host}} -p old-k8s-version-20210915203352-22848 -n old-k8s-version-20210915203352-22848: (11.2411721s)
helpers_test.go:245: <<< TestStartStop/group/old-k8s-version/serial/SecondStart FAILED: start of post-mortem logs <<<
helpers_test.go:246: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: minikube logs <======
helpers_test.go:248: (dbg) Run: out/minikube-windows-amd64.exe -p old-k8s-version-20210915203352-22848 logs -n 25
=== CONT TestStartStop/group/old-k8s-version/serial/SecondStart
helpers_test.go:248: (dbg) Done: out/minikube-windows-amd64.exe -p old-k8s-version-20210915203352-22848 logs -n 25: (44.4126704s)
helpers_test.go:253: TestStartStop/group/old-k8s-version/serial/SecondStart logs:
-- stdout --
*
* ==> Audit <==
* |---------|---------------------------------------------------|-------------------------------------------------|-------------------------|---------|-------------------------------|-------------------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|---------------------------------------------------|-------------------------------------------------|-------------------------|---------|-------------------------------|-------------------------------|
| addons | enable dashboard -p | no-preload-20210915203420-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:42:45 GMT | Wed, 15 Sep 2021 20:42:48 GMT |
| | no-preload-20210915203420-22848 | | | | | |
| | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4 | | | | | |
| start | -p | embed-certs-20210915203657-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:36:57 GMT | Wed, 15 Sep 2021 20:45:14 GMT |
| | embed-certs-20210915203657-22848 | | | | | |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --embed-certs | | | | | |
| | --driver=docker | | | | | |
| | --kubernetes-version=v1.22.1 | | | | | |
| start | -p | kubernetes-upgrade-20210915203315-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:33:16 GMT | Wed, 15 Sep 2021 20:45:31 GMT |
| | kubernetes-upgrade-20210915203315-22848 | | | | | |
| | --memory=2200 | | | | | |
| | --kubernetes-version=v1.14.0 | | | | | |
| | --alsologtostderr -v=1 --driver=docker | | | | | |
| stop | -p | kubernetes-upgrade-20210915203315-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:45:32 GMT | Wed, 15 Sep 2021 20:46:05 GMT |
| | kubernetes-upgrade-20210915203315-22848 | | | | | |
| addons | enable metrics-server -p | embed-certs-20210915203657-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:46:15 GMT | Wed, 15 Sep 2021 20:46:29 GMT |
| | embed-certs-20210915203657-22848 | | | | | |
| | --images=MetricsServer=k8s.gcr.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p | embed-certs-20210915203657-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:46:30 GMT | Wed, 15 Sep 2021 20:47:06 GMT |
| | embed-certs-20210915203657-22848 | | | | | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p | embed-certs-20210915203657-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:47:10 GMT | Wed, 15 Sep 2021 20:47:13 GMT |
| | embed-certs-20210915203657-22848 | | | | | |
| | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4 | | | | | |
| start | -p | old-k8s-version-20210915203352-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:33:52 GMT | Wed, 15 Sep 2021 20:48:59 GMT |
| | old-k8s-version-20210915203352-22848 | | | | | |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --kvm-network=default | | | | | |
| | --kvm-qemu-uri=qemu:///system | | | | | |
| | --disable-driver-mounts | | | | | |
| | --keep-context=false --driver=docker | | | | | |
| | --kubernetes-version=v1.14.0 | | | | | |
| addons | enable metrics-server -p | old-k8s-version-20210915203352-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:49:29 GMT | Wed, 15 Sep 2021 20:49:41 GMT |
| | old-k8s-version-20210915203352-22848 | | | | | |
| | --images=MetricsServer=k8s.gcr.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
| stop | -p | old-k8s-version-20210915203352-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:49:42 GMT | Wed, 15 Sep 2021 20:50:13 GMT |
| | old-k8s-version-20210915203352-22848 | | | | | |
| | --alsologtostderr -v=3 | | | | | |
| addons | enable dashboard -p | old-k8s-version-20210915203352-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:50:16 GMT | Wed, 15 Sep 2021 20:50:18 GMT |
| | old-k8s-version-20210915203352-22848 | | | | | |
| | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4 | | | | | |
| start | -p | kubernetes-upgrade-20210915203315-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:46:09 GMT | Wed, 15 Sep 2021 20:51:13 GMT |
| | kubernetes-upgrade-20210915203315-22848 | | | | | |
| | --memory=2200 | | | | | |
| | --kubernetes-version=v1.22.2-rc.0 | | | | | |
| | --alsologtostderr -v=1 --driver=docker | | | | | |
| start | -p | kubernetes-upgrade-20210915203315-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:51:15 GMT | Wed, 15 Sep 2021 20:52:25 GMT |
| | kubernetes-upgrade-20210915203315-22848 | | | | | |
| | --memory=2200 | | | | | |
| | --kubernetes-version=v1.22.2-rc.0 | | | | | |
| | --alsologtostderr -v=1 --driver=docker | | | | | |
| delete | -p | kubernetes-upgrade-20210915203315-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:52:25 GMT | Wed, 15 Sep 2021 20:53:02 GMT |
| | kubernetes-upgrade-20210915203315-22848 | | | | | |
| delete | -p | disable-driver-mounts-20210915205302-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:53:03 GMT | Wed, 15 Sep 2021 20:53:15 GMT |
| | disable-driver-mounts-20210915205302-22848 | | | | | |
| start | -p | no-preload-20210915203420-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:42:48 GMT | Wed, 15 Sep 2021 20:57:24 GMT |
| | no-preload-20210915203420-22848 | | | | | |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --preload=false | | | | | |
| | --driver=docker | | | | | |
| | --kubernetes-version=v1.22.2-rc.0 | | | | | |
| ssh | -p | no-preload-20210915203420-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:59:31 GMT | Wed, 15 Sep 2021 20:59:39 GMT |
| | no-preload-20210915203420-22848 | | | | | |
| | sudo crictl images -o json | | | | | |
| pause | -p | no-preload-20210915203420-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:59:39 GMT | Wed, 15 Sep 2021 20:59:54 GMT |
| | no-preload-20210915203420-22848 | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| unpause | -p | no-preload-20210915203420-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 21:00:06 GMT | Wed, 15 Sep 2021 21:00:19 GMT |
| | no-preload-20210915203420-22848 | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| delete | -p | no-preload-20210915203420-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 21:00:35 GMT | Wed, 15 Sep 2021 21:01:15 GMT |
| | no-preload-20210915203420-22848 | | | | | |
| delete | -p | no-preload-20210915203420-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 21:01:16 GMT | Wed, 15 Sep 2021 21:01:29 GMT |
| | no-preload-20210915203420-22848 | | | | | |
| start | -p | default-k8s-different-port-20210915205315-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:53:15 GMT | Wed, 15 Sep 2021 21:02:10 GMT |
| | default-k8s-different-port-20210915205315-22848 | | | | | |
| | --memory=2200 --alsologtostderr --wait=true | | | | | |
| | --apiserver-port=8444 --driver=docker | | | | | |
| | --kubernetes-version=v1.22.1 | | | | | |
| start | -p | embed-certs-20210915203657-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 20:47:13 GMT | Wed, 15 Sep 2021 21:03:15 GMT |
| | embed-certs-20210915203657-22848 | | | | | |
| | --memory=2200 --alsologtostderr | | | | | |
| | --wait=true --embed-certs | | | | | |
| | --driver=docker | | | | | |
| | --kubernetes-version=v1.22.1 | | | | | |
| ssh | -p | embed-certs-20210915203657-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 21:03:43 GMT | Wed, 15 Sep 2021 21:03:59 GMT |
| | embed-certs-20210915203657-22848 | | | | | |
| | sudo crictl images -o json | | | | | |
| addons | enable metrics-server -p | default-k8s-different-port-20210915205315-22848 | WINDOWS-SERVER-\jenkins | v1.23.0 | Wed, 15 Sep 2021 21:03:31 GMT | Wed, 15 Sep 2021 21:04:06 GMT |
| | default-k8s-different-port-20210915205315-22848 | | | | | |
| | --images=MetricsServer=k8s.gcr.io/echoserver:1.4 | | | | | |
| | --registries=MetricsServer=fake.domain | | | | | |
|---------|---------------------------------------------------|-------------------------------------------------|-------------------------|---------|-------------------------------|-------------------------------|
*
* ==> Last Start <==
* Log file created at: 2021/09/15 21:01:29
Running on machine: windows-server-1
Binary: Built with gc go1.17 for windows/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0915 21:01:29.498656 71312 out.go:298] Setting OutFile to fd 2668 ...
I0915 21:01:29.498656 71312 out.go:345] TERM=,COLORTERM=, which probably does not support color
I0915 21:01:29.498656 71312 out.go:311] Setting ErrFile to fd 2532...
I0915 21:01:29.498656 71312 out.go:345] TERM=,COLORTERM=, which probably does not support color
I0915 21:01:29.527846 71312 out.go:305] Setting JSON to false
I0915 21:01:29.533834 71312 start.go:111] hostinfo: {"hostname":"windows-server-1","uptime":9159163,"bootTime":1622580526,"procs":158,"os":"windows","platform":"Microsoft Windows Server 2019 Datacenter","platformFamily":"Server","platformVersion":"10.0.17763 Build 17763","kernelVersion":"10.0.17763 Build 17763","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"9879231f-6171-435d-bab4-5b366cc6391b"}
W0915 21:01:29.534832 71312 start.go:119] gopshost.Virtualization returned error: not implemented yet
I0915 21:01:29.538826 71312 out.go:177] * [newest-cni-20210915210129-22848] minikube v1.23.0 on Microsoft Windows Server 2019 Datacenter 10.0.17763 Build 17763
I0915 21:01:29.539838 71312 notify.go:169] Checking for updates...
I0915 21:01:29.541832 71312 out.go:177] - KUBECONFIG=C:\Users\jenkins\minikube-integration\kubeconfig
I0915 21:01:29.543863 71312 out.go:177] - MINIKUBE_HOME=C:\Users\jenkins\minikube-integration\.minikube
I0915 21:01:25.874571 57992 logs.go:123] Gathering logs for Docker ...
I0915 21:01:25.874571 57992 ssh_runner.go:152] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0915 21:01:26.636407 57992 logs.go:123] Gathering logs for container status ...
I0915 21:01:26.636744 57992 ssh_runner.go:152] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0915 21:01:28.751029 57992 ssh_runner.go:192] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.1142984s)
I0915 21:01:29.704252 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:30.670252 59380 ssh_runner.go:192] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.14.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (25.0215831s)
I0915 21:01:29.545832 71312 out.go:177] - MINIKUBE_LOCATION=12425
I0915 21:01:29.547833 71312 config.go:177] Loaded profile config "default-k8s-different-port-20210915205315-22848": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.1
I0915 21:01:29.547833 71312 config.go:177] Loaded profile config "embed-certs-20210915203657-22848": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.1
I0915 21:01:29.548893 71312 config.go:177] Loaded profile config "old-k8s-version-20210915203352-22848": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.14.0
I0915 21:01:29.548893 71312 config.go:177] Loaded profile config "pause-20210915200708-22848": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.1
I0915 21:01:29.549902 71312 driver.go:343] Setting default libvirt URI to qemu:///system
I0915 21:01:31.777050 71312 docker.go:132] docker version: linux-20.10.5
I0915 21:01:31.791482 71312 cli_runner.go:115] Run: docker system info --format "{{json .}}"
I0915 21:01:33.136955 71312 cli_runner.go:168] Completed: docker system info --format "{{json .}}": (1.345481s)
I0915 21:01:33.138771 71312 info.go:263] docker info: {ID:AZM6:4F7P:D7J3:PGKE:EIYN:3OQU:SEA3:BB2T:P6VC:GKKH:UKSA:R2VX Containers:4 ContainersRunning:4 ContainersPaused:0 ContainersStopped:0 Images:7 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:76 OomKillDisable:true NGoroutines:74 SystemTime:2021-09-15 21:01:32.5173986 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:4 KernelVersion:4.19.121-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:https://inde
x.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:4 MemTotal:20973547520 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[]
ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:C:\ProgramData\Docker\cli-plugins\docker-app.exe SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:C:\ProgramData\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:scan Path:C:\ProgramData\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.5.0]] Warnings:<nil>}}
I0915 21:01:28.663534 60636 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}: (2.2388434s)
I0915 21:01:28.663534 60636 logs.go:270] 1 containers: [dd15470492e2]
I0915 21:01:28.683664 60636 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0915 21:01:29.893598 60636 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}: (1.2099417s)
I0915 21:01:29.893598 60636 logs.go:270] 2 containers: [5c2cc55aa311 3f363fd7e539]
I0915 21:01:29.893598 60636 logs.go:123] Gathering logs for kube-apiserver [5b512fefe3b9] ...
I0915 21:01:29.893598 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 5b512fefe3b9"
I0915 21:01:30.996543 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 5b512fefe3b9": (1.1029518s)
I0915 21:01:31.017773 60636 logs.go:123] Gathering logs for kube-scheduler [c93c1026cc1a] ...
I0915 21:01:31.018003 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 c93c1026cc1a"
I0915 21:01:31.816269 60636 logs.go:123] Gathering logs for kubelet ...
I0915 21:01:31.816520 60636 ssh_runner.go:152] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0915 21:01:32.533140 60636 logs.go:123] Gathering logs for describe nodes ...
I0915 21:01:32.533140 60636 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0915 21:01:30.675627 59380 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard
I0915 21:01:30.675920 59380 addons.go:406] enableAddons completed in 1m14.4658098s
I0915 21:01:31.930045 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:33.145988 71312 out.go:177] * Using the docker driver based on user configuration
I0915 21:01:33.146149 71312 start.go:278] selected driver: docker
I0915 21:01:33.146393 71312 start.go:751] validating driver "docker" against <nil>
I0915 21:01:33.146393 71312 start.go:762] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}
I0915 21:01:33.377854 71312 cli_runner.go:115] Run: docker system info --format "{{json .}}"
I0915 21:01:34.659660 71312 cli_runner.go:168] Completed: docker system info --format "{{json .}}": (1.2815979s)
I0915 21:01:34.660543 71312 info.go:263] docker info: {ID:AZM6:4F7P:D7J3:PGKE:EIYN:3OQU:SEA3:BB2T:P6VC:GKKH:UKSA:R2VX Containers:4 ContainersRunning:4 ContainersPaused:0 ContainersStopped:0 Images:7 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:76 OomKillDisable:true NGoroutines:74 SystemTime:2021-09-15 21:01:34.0300921 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:4 KernelVersion:4.19.121-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:https://inde
x.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:4 MemTotal:20973547520 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[]
ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:C:\ProgramData\Docker\cli-plugins\docker-app.exe SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:C:\ProgramData\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:scan Path:C:\ProgramData\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.5.0]] Warnings:<nil>}}
I0915 21:01:34.661042 71312 start_flags.go:264] no existing cluster config was found, will generate one from the flags
W0915 21:01:34.661678 71312 out.go:242] ! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
I0915 21:01:34.666347 71312 start_flags.go:756] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
I0915 21:01:34.666551 71312 cni.go:93] Creating CNI manager for ""
I0915 21:01:34.666762 71312 cni.go:167] CNI unnecessary in this configuration, recommending no CNI
I0915 21:01:34.666762 71312 start_flags.go:278] config:
{Name:newest-cni-20210915210129-22848 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.2-rc.0 ClusterName:newest-cni-20210915210129-22848 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:network-plugin Value:cni} {Component:kubeadm Key:pod-network-cidr Value:192.168.111.111/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0}
I0915 21:01:34.670746 71312 out.go:177] * Starting control plane node newest-cni-20210915210129-22848 in cluster newest-cni-20210915210129-22848
I0915 21:01:34.670965 71312 cache.go:118] Beginning downloading kic base image for docker with docker
I0915 21:01:31.253244 57992 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57928/healthz ...
I0915 21:01:31.347436 57992 api_server.go:265] https://127.0.0.1:57928/healthz returned 200:
ok
I0915 21:01:31.365530 57992 api_server.go:139] control plane version: v1.22.1
I0915 21:01:31.365530 57992 api_server.go:129] duration metric: took 35.6275244s to wait for apiserver health ...
I0915 21:01:31.365530 57992 system_pods.go:43] waiting for kube-system pods to appear ...
I0915 21:01:31.374545 57992 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0915 21:01:32.188285 57992 logs.go:270] 1 containers: [7e0da6df2ce9]
I0915 21:01:32.198743 57992 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0915 21:01:32.988506 57992 logs.go:270] 1 containers: [cc02e6c3d1f4]
I0915 21:01:32.999707 57992 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0915 21:01:33.829433 57992 logs.go:270] 1 containers: [8caa653135bf]
I0915 21:01:33.845197 57992 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0915 21:01:34.676029 71312 out.go:177] * Pulling base image ...
I0915 21:01:34.676197 71312 preload.go:131] Checking if preload exists for k8s version v1.22.2-rc.0 and runtime docker
I0915 21:01:34.676520 71312 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon
I0915 21:01:34.676675 71312 preload.go:147] Found local preload: C:\Users\jenkins\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4
I0915 21:01:34.676896 71312 cache.go:57] Caching tarball of preloaded images
I0915 21:01:34.677667 71312 preload.go:173] Found C:\Users\jenkins\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0915 21:01:34.678224 71312 cache.go:60] Finished verifying existence of preloaded tar for v1.22.2-rc.0 on docker
I0915 21:01:34.678554 71312 profile.go:148] Saving config to C:\Users\jenkins\minikube-integration\.minikube\profiles\newest-cni-20210915210129-22848\config.json ...
I0915 21:01:34.680628 71312 lock.go:36] WriteFile acquiring C:\Users\jenkins\minikube-integration\.minikube\profiles\newest-cni-20210915210129-22848\config.json: {Name:mk924de5ec852f9b1c000f71eed191bf8edd47a5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 21:01:35.535265 71312 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 in local docker daemon, skipping pull
I0915 21:01:35.535442 71312 cache.go:140] gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 exists in daemon, skipping load
I0915 21:01:35.535679 71312 cache.go:206] Successfully downloaded all kic artifacts
I0915 21:01:35.536428 71312 start.go:313] acquiring machines lock for newest-cni-20210915210129-22848: {Name:mk22a38dbdfe93064c971061a28e7df34d849025 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0915 21:01:35.536691 71312 start.go:317] acquired machines lock for "newest-cni-20210915210129-22848" in 262.4µs
I0915 21:01:35.537281 71312 start.go:89] Provisioning new machine with config: &{Name:newest-cni-20210915210129-22848 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.2-rc.0 ClusterName:newest-cni-20210915210129-22848 Namespace:default A
PIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:network-plugin Value:cni} {Component:kubeadm Key:pod-network-cidr Value:192.168.111.111/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.22.2-rc.0 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0} &{Name: IP: Port:8443 KubernetesVersion:v1.22.2-rc.0 ControlPlane:true Worker:true}
I0915 21:01:35.537537 71312 start.go:126] createHost starting for "" (driver="docker")
I0915 21:01:35.780248 60636 ssh_runner.go:192] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": (3.2471285s)
I0915 21:01:35.789820 60636 logs.go:123] Gathering logs for etcd [225ed7592959] ...
I0915 21:01:35.790079 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 225ed7592959"
I0915 21:01:33.957283 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:36.008270 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:38.462846 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:35.541312 71312 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
I0915 21:01:35.542331 71312 start.go:160] libmachine.API.Create for "newest-cni-20210915210129-22848" (driver="docker")
I0915 21:01:35.542660 71312 client.go:168] LocalClient.Create starting
I0915 21:01:35.543726 71312 main.go:130] libmachine: Reading certificate data from C:\Users\jenkins\minikube-integration\.minikube\certs\ca.pem
I0915 21:01:35.544428 71312 main.go:130] libmachine: Decoding PEM data...
I0915 21:01:35.544636 71312 main.go:130] libmachine: Parsing certificate...
I0915 21:01:35.544636 71312 main.go:130] libmachine: Reading certificate data from C:\Users\jenkins\minikube-integration\.minikube\certs\cert.pem
I0915 21:01:35.544636 71312 main.go:130] libmachine: Decoding PEM data...
I0915 21:01:35.544636 71312 main.go:130] libmachine: Parsing certificate...
I0915 21:01:35.566700 71312 cli_runner.go:115] Run: docker network inspect newest-cni-20210915210129-22848 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0915 21:01:36.378678 71312 cli_runner.go:162] docker network inspect newest-cni-20210915210129-22848 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0915 21:01:36.393324 71312 network_create.go:255] running [docker network inspect newest-cni-20210915210129-22848] to gather additional debugging logs...
I0915 21:01:36.393324 71312 cli_runner.go:115] Run: docker network inspect newest-cni-20210915210129-22848
W0915 21:01:37.233513 71312 cli_runner.go:162] docker network inspect newest-cni-20210915210129-22848 returned with exit code 1
I0915 21:01:37.233724 71312 network_create.go:258] error running [docker network inspect newest-cni-20210915210129-22848]: docker network inspect newest-cni-20210915210129-22848: exit status 1
stdout:
[]
stderr:
Error: No such network: newest-cni-20210915210129-22848
I0915 21:01:37.233724 71312 network_create.go:260] output of [docker network inspect newest-cni-20210915210129-22848]: -- stdout --
[]
-- /stdout --
** stderr **
Error: No such network: newest-cni-20210915210129-22848
** /stderr **
I0915 21:01:37.271659 71312 cli_runner.go:115] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0915 21:01:38.175033 71312 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc000006500] misses:0}
I0915 21:01:38.175262 71312 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0915 21:01:38.175427 71312 network_create.go:106] attempt to create docker network newest-cni-20210915210129-22848 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0915 21:01:38.189485 71312 cli_runner.go:115] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true newest-cni-20210915210129-22848
W0915 21:01:39.002636 71312 cli_runner.go:162] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true newest-cni-20210915210129-22848 returned with exit code 1
W0915 21:01:39.002636 71312 network_create.go:98] failed to create docker network newest-cni-20210915210129-22848 192.168.49.0/24, will retry: subnet is taken
I0915 21:01:39.032477 71312 network.go:279] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000006500] amended:false}} dirty:map[] misses:0}
I0915 21:01:39.032477 71312 network.go:238] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0915 21:01:39.064737 71312 network.go:288] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000006500] amended:true}} dirty:map[192.168.49.0:0xc000006500 192.168.58.0:0xc00079afe0] misses:0}
I0915 21:01:39.064933 71312 network.go:235] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0915 21:01:39.064933 71312 network_create.go:106] attempt to create docker network newest-cni-20210915210129-22848 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I0915 21:01:39.089723 71312 cli_runner.go:115] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true newest-cni-20210915210129-22848
I0915 21:01:35.687871 57992 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}: (1.8426864s)
I0915 21:01:35.687871 57992 logs.go:270] 1 containers: [0580f16f21bc]
I0915 21:01:35.688289 57992 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0915 21:01:36.752581 57992 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}: (1.063193s)
I0915 21:01:36.758612 57992 logs.go:270] 1 containers: [b6f05b0beae3]
I0915 21:01:36.810473 57992 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0915 21:01:37.874916 57992 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}: (1.0644499s)
I0915 21:01:37.875083 57992 logs.go:270] 0 containers: []
W0915 21:01:37.875083 57992 logs.go:272] No container was found matching "kubernetes-dashboard"
I0915 21:01:37.895018 57992 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0915 21:01:39.075759 57992 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}: (1.180748s)
I0915 21:01:39.075979 57992 logs.go:270] 1 containers: [63466781db67]
I0915 21:01:39.089310 57992 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0915 21:01:38.846119 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 225ed7592959": (3.0557149s)
I0915 21:01:38.906738 60636 logs.go:123] Gathering logs for kubernetes-dashboard [780e328d61ab] ...
I0915 21:01:38.906738 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 780e328d61ab"
I0915 21:01:41.253332 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 780e328d61ab": (2.3466091s)
I0915 21:01:41.255552 60636 logs.go:123] Gathering logs for container status ...
I0915 21:01:41.255808 60636 ssh_runner.go:152] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0915 21:01:42.198922 60636 logs.go:123] Gathering logs for coredns [bd8a9c6d784f] ...
I0915 21:01:42.198922 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 bd8a9c6d784f"
I0915 21:01:40.477833 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:42.492692 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:40.362231 71312 cli_runner.go:168] Completed: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true newest-cni-20210915210129-22848: (1.2720029s)
I0915 21:01:40.362231 71312 network_create.go:90] docker network newest-cni-20210915210129-22848 192.168.58.0/24 created
I0915 21:01:40.362388 71312 kic.go:106] calculated static IP "192.168.58.2" for the "newest-cni-20210915210129-22848" container
I0915 21:01:40.395788 71312 cli_runner.go:115] Run: docker ps -a --format {{.Names}}
I0915 21:01:41.270456 71312 cli_runner.go:115] Run: docker volume create newest-cni-20210915210129-22848 --label name.minikube.sigs.k8s.io=newest-cni-20210915210129-22848 --label created_by.minikube.sigs.k8s.io=true
I0915 21:01:42.005703 71312 oci.go:102] Successfully created a docker volume newest-cni-20210915210129-22848
I0915 21:01:42.025495 71312 cli_runner.go:115] Run: docker run --rm --name newest-cni-20210915210129-22848-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=newest-cni-20210915210129-22848 --entrypoint /usr/bin/test -v newest-cni-20210915210129-22848:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 -d /var/lib
I0915 21:01:40.805487 57992 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}: (1.7158412s)
I0915 21:01:40.805487 57992 logs.go:270] 2 containers: [ac13dfebc110 e2e39e98bdf7]
I0915 21:01:40.805487 57992 logs.go:123] Gathering logs for storage-provisioner [63466781db67] ...
I0915 21:01:40.805724 57992 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 63466781db67"
I0915 21:01:41.433637 57992 logs.go:123] Gathering logs for kube-controller-manager [ac13dfebc110] ...
I0915 21:01:41.433637 57992 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 ac13dfebc110"
I0915 21:01:42.385648 57992 logs.go:123] Gathering logs for dmesg ...
I0915 21:01:42.385648 57992 ssh_runner.go:152] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0915 21:01:42.828108 57992 logs.go:123] Gathering logs for kube-apiserver [7e0da6df2ce9] ...
I0915 21:01:42.828108 57992 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 7e0da6df2ce9"
I0915 21:01:43.521876 57992 logs.go:123] Gathering logs for etcd [cc02e6c3d1f4] ...
I0915 21:01:43.521876 57992 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 cc02e6c3d1f4"
I0915 21:01:45.239234 57992 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 cc02e6c3d1f4": (1.7171714s)
I0915 21:01:45.300141 57992 logs.go:123] Gathering logs for coredns [8caa653135bf] ...
I0915 21:01:45.300394 57992 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 8caa653135bf"
I0915 21:01:43.796132 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 bd8a9c6d784f": (1.5972204s)
I0915 21:01:43.796585 60636 logs.go:123] Gathering logs for dmesg ...
I0915 21:01:43.796585 60636 ssh_runner.go:152] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0915 21:01:44.428434 60636 logs.go:123] Gathering logs for kube-proxy [45c113f5873c] ...
I0915 21:01:44.428434 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 45c113f5873c"
I0915 21:01:46.398825 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 45c113f5873c": (1.9704034s)
I0915 21:01:46.403541 60636 logs.go:123] Gathering logs for storage-provisioner [dd15470492e2] ...
I0915 21:01:46.404017 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 dd15470492e2"
I0915 21:01:45.004798 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:47.433645 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:47.967000 71312 cli_runner.go:168] Completed: docker run --rm --name newest-cni-20210915210129-22848-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=newest-cni-20210915210129-22848 --entrypoint /usr/bin/test -v newest-cni-20210915210129-22848:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 -d /var/lib: (5.9415434s)
I0915 21:01:47.967000 71312 oci.go:106] Successfully prepared a docker volume newest-cni-20210915210129-22848
I0915 21:01:47.967000 71312 preload.go:131] Checking if preload exists for k8s version v1.22.2-rc.0 and runtime docker
I0915 21:01:47.967000 71312 kic.go:179] Starting extracting preloaded images to volume ...
I0915 21:01:47.978950 71312 cli_runner.go:115] Run: docker system info --format "{{json .}}"
I0915 21:01:47.978950 71312 cli_runner.go:115] Run: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v newest-cni-20210915210129-22848:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 -I lz4 -xf /preloaded.tar -C /extractDir
W0915 21:01:48.884497 71312 cli_runner.go:162] docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v newest-cni-20210915210129-22848:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 -I lz4 -xf /preloaded.tar -C /extractDir returned with exit code 125
I0915 21:01:48.884497 71312 kic.go:186] Unable to extract preloaded tarball to volume: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v newest-cni-20210915210129-22848:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56 -I lz4 -xf /preloaded.tar -C /extractDir: exit status 125
stdout:
stderr:
docker: Error response from daemon: status code not OK but 500: ������������������System.Exception ��� ClassNameMessageDataInnerExceptionHelpURLStackTraceStringRemoteStackTraceStringRemoteStackIndexExceptionMethodHResultSource WatsonBuckets��)System.Collections.ListDictionaryInternalSystem.Exception���System.Exception���XThe notification platform is unavailable.
The notification platform is unavailable.
���
���� at Windows.UI.Notifications.ToastNotificationManager.CreateToastNotifier(String applicationId)
at Docker.WPF.PromptShareDirectory.<PromptUserAsync>d__6.MoveNext() in C:\workspaces\PR-15387\src\github.com\docker\pinata\win\src\Docker.WPF\PromptShareDirectory.cs:line 53
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Docker.ApiServices.Mounting.FileSharing.<DoShareAsync>d__7.MoveNext() in C:\workspaces\PR-15387\src\github.com\docker\pinata\win\src\Docker.ApiServices\Mounting\FileSharing.cs:line 86
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Docker.ApiServices.Mounting.FileSharing.<ShareAsync>d__5.MoveNext() in C:\workspaces\PR-15387\src\github.com\docker\pinata\win\src\Docker.ApiServices\Mounting\FileSharing.cs:line 53
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Docker.HttpApi.Controllers.FilesharingController.<ShareDirectory>d__2.MoveNext() in C:\workspaces\PR-15387\src\github.com\docker\pinata\win\src\Docker.HttpApi\Controllers\FilesharingController.cs:line 21
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Threading.Tasks.TaskHelpersExtensions.<CastToObject>d__1`1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Web.Http.Controllers.ApiControllerActionInvoker.<InvokeActionAsyncCore>d__1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Web.Http.Controllers.ActionFilterResult.<ExecuteAsync>d__5.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at System.Web.Http.Dispatcher.HttpControllerDispatcher.<SendAsync>d__15.MoveNext()
��������8
CreateToastNotifier
Windows.UI, Version=255.255.255.255, Culture=neutral, PublicKeyToken=null, ContentType=WindowsRuntime
Windows.UI.Notifications.ToastNotificationManager
Windows.UI.Notifications.ToastNotifier CreateToastNotifier(System.String)>�����
���)System.Collections.ListDictionaryInternal���headversioncount��8System.Collections.ListDictionaryInternal+DictionaryNode ������������8System.Collections.ListDictionaryInternal+DictionaryNode���keyvaluenext8System.Collections.ListDictionaryInternal+DictionaryNode ���RestrictedDescription
���+The notification platform is unavailable.
��� ������ ���RestrictedErrorReference
��� ���������RestrictedCapabilitySid
������������__RestrictedErrorObject ��� ������(System.Exception+__RestrictedErrorObject�������������"__HasRestrictedLanguageErrorObject�.
See 'docker run --help'.
I0915 21:01:47.061987 57992 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 8caa653135bf": (1.7616039s)
I0915 21:01:47.063214 57992 logs.go:123] Gathering logs for kube-scheduler [0580f16f21bc] ...
I0915 21:01:47.063528 57992 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 0580f16f21bc"
I0915 21:01:49.613042 57992 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 0580f16f21bc": (2.549531s)
I0915 21:01:49.624978 57992 logs.go:123] Gathering logs for kube-proxy [b6f05b0beae3] ...
I0915 21:01:49.624978 57992 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 b6f05b0beae3"
I0915 21:01:48.550176 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 dd15470492e2": (2.1461734s)
I0915 21:01:48.550176 60636 logs.go:123] Gathering logs for kube-controller-manager [5c2cc55aa311] ...
I0915 21:01:48.550176 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 5c2cc55aa311"
I0915 21:01:52.067855 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 5c2cc55aa311": (3.517396s)
I0915 21:01:52.092440 60636 logs.go:123] Gathering logs for kube-controller-manager [3f363fd7e539] ...
I0915 21:01:52.092440 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 3f363fd7e539"
I0915 21:01:49.452363 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:51.525296 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:49.282901 71312 cli_runner.go:168] Completed: docker system info --format "{{json .}}": (1.3039593s)
I0915 21:01:49.283168 71312 info.go:263] docker info: {ID:AZM6:4F7P:D7J3:PGKE:EIYN:3OQU:SEA3:BB2T:P6VC:GKKH:UKSA:R2VX Containers:4 ContainersRunning:4 ContainersPaused:0 ContainersStopped:0 Images:7 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:77 OomKillDisable:true NGoroutines:77 SystemTime:2021-09-15 21:01:48.7132168 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:4 KernelVersion:4.19.121-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:https://inde
x.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:4 MemTotal:20973547520 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[]
ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:C:\ProgramData\Docker\cli-plugins\docker-app.exe SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:C:\ProgramData\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.5.1-docker] map[Name:scan Path:C:\ProgramData\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.5.0]] Warnings:<nil>}}
I0915 21:01:49.295572 71312 cli_runner.go:115] Run: docker info --format "'{{json .SecurityOptions}}'"
I0915 21:01:50.536199 71312 cli_runner.go:168] Completed: docker info --format "'{{json .SecurityOptions}}'": (1.2405023s)
I0915 21:01:50.548217 71312 cli_runner.go:115] Run: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname newest-cni-20210915210129-22848 --name newest-cni-20210915210129-22848 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=newest-cni-20210915210129-22848 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=newest-cni-20210915210129-22848 --network newest-cni-20210915210129-22848 --ip 192.168.58.2 --volume newest-cni-20210915210129-22848:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56
I0915 21:01:50.695770 57992 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 b6f05b0beae3": (1.0707987s)
I0915 21:01:50.698768 57992 logs.go:123] Gathering logs for kube-controller-manager [e2e39e98bdf7] ...
I0915 21:01:50.698768 57992 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 e2e39e98bdf7"
I0915 21:01:53.241317 57992 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 e2e39e98bdf7": (2.5422604s)
I0915 21:01:53.294874 57992 logs.go:123] Gathering logs for Docker ...
I0915 21:01:53.295103 57992 ssh_runner.go:152] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0915 21:01:54.028175 57992 logs.go:123] Gathering logs for container status ...
I0915 21:01:54.028175 57992 ssh_runner.go:152] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0915 21:01:55.053013 57992 ssh_runner.go:192] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (1.0248446s)
I0915 21:01:55.056423 57992 logs.go:123] Gathering logs for kubelet ...
I0915 21:01:55.056605 57992 ssh_runner.go:152] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0915 21:01:55.545051 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 3f363fd7e539": (3.4526333s)
I0915 21:01:55.573045 60636 logs.go:123] Gathering logs for Docker ...
I0915 21:01:55.573045 60636 ssh_runner.go:152] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0915 21:01:53.947935 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:56.027075 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:58.606645 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:56.313372 71312 cli_runner.go:168] Completed: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname newest-cni-20210915210129-22848 --name newest-cni-20210915210129-22848 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=newest-cni-20210915210129-22848 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=newest-cni-20210915210129-22848 --network newest-cni-20210915210129-22848 --ip 192.168.58.2 --volume newest-cni-20210915210129-22848:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.26-1631295795-12425@sha256:7d61c0b6cf6832c8015ada78640635c5ab74b72f12f51bcc4c7660b0be01af56: (5.7651915s)
I0915 21:01:56.325370 71312 cli_runner.go:115] Run: docker container inspect newest-cni-20210915210129-22848 --format={{.State.Running}}
I0915 21:01:57.234231 71312 cli_runner.go:115] Run: docker container inspect newest-cni-20210915210129-22848 --format={{.State.Status}}
I0915 21:01:58.025052 71312 cli_runner.go:115] Run: docker exec newest-cni-20210915210129-22848 stat /var/lib/dpkg/alternatives/iptables
I0915 21:01:55.930904 57992 logs.go:123] Gathering logs for describe nodes ...
I0915 21:01:55.930904 57992 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0915 21:01:58.750289 60636 api_server.go:239] Checking apiserver healthz at https://127.0.0.1:57730/healthz ...
I0915 21:01:58.898254 60636 api_server.go:265] https://127.0.0.1:57730/healthz returned 200:
ok
I0915 21:01:59.241783 60636 api_server.go:139] control plane version: v1.22.1
I0915 21:01:59.241940 60636 api_server.go:129] duration metric: took 48.8965337s to wait for apiserver health ...
I0915 21:01:59.241940 60636 system_pods.go:43] waiting for kube-system pods to appear ...
I0915 21:01:59.256633 60636 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0915 21:02:02.785974 60636 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}: (3.5293638s)
I0915 21:02:02.786332 60636 logs.go:270] 1 containers: [5b512fefe3b9]
I0915 21:02:02.829228 60636 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0915 21:02:00.749044 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:02:02.986676 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:01:59.473575 71312 cli_runner.go:168] Completed: docker exec newest-cni-20210915210129-22848 stat /var/lib/dpkg/alternatives/iptables: (1.448533s)
I0915 21:01:59.473575 71312 oci.go:281] the created container "newest-cni-20210915210129-22848" has a running status.
I0915 21:01:59.474123 71312 kic.go:210] Creating ssh key for kic: C:\Users\jenkins\minikube-integration\.minikube\machines\newest-cni-20210915210129-22848\id_rsa...
I0915 21:01:59.731261 71312 kic_runner.go:188] docker (temp): C:\Users\jenkins\minikube-integration\.minikube\machines\newest-cni-20210915210129-22848\id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0915 21:02:01.561699 71312 cli_runner.go:115] Run: docker container inspect newest-cni-20210915210129-22848 --format={{.State.Status}}
I0915 21:02:02.422706 71312 kic_runner.go:94] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0915 21:02:02.422706 71312 kic_runner.go:115] Args: [docker exec --privileged newest-cni-20210915210129-22848 chown docker:docker /home/docker/.ssh/authorized_keys]
I0915 21:02:03.912553 71312 kic_runner.go:124] Done: [docker exec --privileged newest-cni-20210915210129-22848 chown docker:docker /home/docker/.ssh/authorized_keys]: (1.4898573s)
I0915 21:02:03.918156 71312 kic.go:250] ensuring only current user has permissions to key file located at : C:\Users\jenkins\minikube-integration\.minikube\machines\newest-cni-20210915210129-22848\id_rsa...
I0915 21:02:06.402733 60636 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_etcd --format={{.ID}}: (3.5735284s)
I0915 21:02:06.402733 60636 logs.go:270] 1 containers: [225ed7592959]
I0915 21:02:06.419837 60636 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0915 21:02:05.604697 59380 pod_ready.go:102] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"False"
I0915 21:02:08.342362 59380 pod_ready.go:92] pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace has status "Ready":"True"
I0915 21:02:08.342362 59380 pod_ready.go:81] duration metric: took 1m37.0743164s waiting for pod "coredns-fb8b8dccf-pxwb4" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.342628 59380 pod_ready.go:78] waiting up to 6m0s for pod "etcd-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.431670 59380 pod_ready.go:92] pod "etcd-old-k8s-version-20210915203352-22848" in "kube-system" namespace has status "Ready":"True"
I0915 21:02:08.431837 59380 pod_ready.go:81] duration metric: took 89.2095ms waiting for pod "etcd-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.431837 59380 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.530628 59380 pod_ready.go:92] pod "kube-apiserver-old-k8s-version-20210915203352-22848" in "kube-system" namespace has status "Ready":"True"
I0915 21:02:08.530628 59380 pod_ready.go:81] duration metric: took 98.7918ms waiting for pod "kube-apiserver-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.530628 59380 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.623612 59380 pod_ready.go:92] pod "kube-controller-manager-old-k8s-version-20210915203352-22848" in "kube-system" namespace has status "Ready":"True"
I0915 21:02:08.623744 59380 pod_ready.go:81] duration metric: took 93.1164ms waiting for pod "kube-controller-manager-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.623744 59380 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-fjmvd" in "kube-system" namespace to be "Ready" ...
I0915 21:02:04.806925 71312 cli_runner.go:115] Run: docker container inspect newest-cni-20210915210129-22848 --format={{.State.Status}}
I0915 21:02:05.663179 71312 machine.go:88] provisioning docker machine ...
I0915 21:02:05.663977 71312 ubuntu.go:169] provisioning hostname "newest-cni-20210915210129-22848"
I0915 21:02:05.678790 71312 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915210129-22848
I0915 21:02:06.548813 71312 main.go:130] libmachine: Using SSH client type: native
I0915 21:02:06.559314 71312 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x11facc0] 0x11fdb80 <nil> [] 0s} 127.0.0.1 58050 <nil> <nil>}
I0915 21:02:06.559509 71312 main.go:130] libmachine: About to run SSH command:
sudo hostname newest-cni-20210915210129-22848 && echo "newest-cni-20210915210129-22848" | sudo tee /etc/hostname
I0915 21:02:07.359353 71312 main.go:130] libmachine: SSH cmd err, output: <nil>: newest-cni-20210915210129-22848
I0915 21:02:07.375049 71312 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915210129-22848
I0915 21:02:08.126047 71312 main.go:130] libmachine: Using SSH client type: native
I0915 21:02:08.126047 71312 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x11facc0] 0x11fdb80 <nil> [] 0s} 127.0.0.1 58050 <nil> <nil>}
I0915 21:02:08.126047 71312 main.go:130] libmachine: About to run SSH command:
if ! grep -xq '.*\snewest-cni-20210915210129-22848' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 newest-cni-20210915210129-22848/g' /etc/hosts;
else
echo '127.0.1.1 newest-cni-20210915210129-22848' | sudo tee -a /etc/hosts;
fi
fi
I0915 21:02:08.867685 71312 main.go:130] libmachine: SSH cmd err, output: <nil>:
I0915 21:02:08.867847 71312 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins\minikube-integration\.minikube CaCertPath:C:\Users\jenkins\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins\minikube-integration\.minikube}
I0915 21:02:08.867847 71312 ubuntu.go:177] setting up certificates
I0915 21:02:08.867847 71312 provision.go:83] configureAuth start
I0915 21:02:08.881391 71312 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-20210915210129-22848
I0915 21:02:07.025787 57992 ssh_runner.go:192] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": (11.0949547s)
I0915 21:02:09.591724 57992 system_pods.go:59] 7 kube-system pods found
I0915 21:02:09.591724 57992 system_pods.go:61] "coredns-78fcd69978-8t7vx" [acd23737-160a-4681-bfa9-dca716e5d9db] Running
I0915 21:02:09.591724 57992 system_pods.go:61] "etcd-default-k8s-different-port-20210915205315-22848" [9a3f18f6-09c1-4077-a874-96026dbcac7e] Running
I0915 21:02:09.591724 57992 system_pods.go:61] "kube-apiserver-default-k8s-different-port-20210915205315-22848" [873c66c1-96bd-4857-bb27-2c1ce18d8771] Running
I0915 21:02:09.591724 57992 system_pods.go:61] "kube-controller-manager-default-k8s-different-port-20210915205315-22848" [1d847019-cbd3-4be6-aa0d-6fd934cc7ddf] Running
I0915 21:02:09.591724 57992 system_pods.go:61] "kube-proxy-tt8jd" [bd8a85d9-160c-4399-ae10-d7d8621870ba] Running
I0915 21:02:09.591724 57992 system_pods.go:61] "kube-scheduler-default-k8s-different-port-20210915205315-22848" [23c71740-6bdd-46e8-88f5-9ff955deb18b] Running
I0915 21:02:09.591724 57992 system_pods.go:61] "storage-provisioner" [dc3d7b88-6efe-4b41-a4c0-4580c90d3bdc] Running
I0915 21:02:09.591724 57992 system_pods.go:74] duration metric: took 38.2264389s to wait for pod list to return data ...
I0915 21:02:09.591724 57992 default_sa.go:34] waiting for default service account to be created ...
I0915 21:02:09.618788 57992 default_sa.go:45] found service account: "default"
I0915 21:02:09.618788 57992 default_sa.go:55] duration metric: took 27.0643ms for default service account to be created ...
I0915 21:02:09.618788 57992 system_pods.go:116] waiting for k8s-apps to be running ...
I0915 21:02:09.699848 57992 system_pods.go:86] 7 kube-system pods found
I0915 21:02:09.700006 57992 system_pods.go:89] "coredns-78fcd69978-8t7vx" [acd23737-160a-4681-bfa9-dca716e5d9db] Running
I0915 21:02:09.700006 57992 system_pods.go:89] "etcd-default-k8s-different-port-20210915205315-22848" [9a3f18f6-09c1-4077-a874-96026dbcac7e] Running
I0915 21:02:09.700006 57992 system_pods.go:89] "kube-apiserver-default-k8s-different-port-20210915205315-22848" [873c66c1-96bd-4857-bb27-2c1ce18d8771] Running
I0915 21:02:09.700006 57992 system_pods.go:89] "kube-controller-manager-default-k8s-different-port-20210915205315-22848" [1d847019-cbd3-4be6-aa0d-6fd934cc7ddf] Running
I0915 21:02:09.700006 57992 system_pods.go:89] "kube-proxy-tt8jd" [bd8a85d9-160c-4399-ae10-d7d8621870ba] Running
I0915 21:02:09.700006 57992 system_pods.go:89] "kube-scheduler-default-k8s-different-port-20210915205315-22848" [23c71740-6bdd-46e8-88f5-9ff955deb18b] Running
I0915 21:02:09.700006 57992 system_pods.go:89] "storage-provisioner" [dc3d7b88-6efe-4b41-a4c0-4580c90d3bdc] Running
I0915 21:02:09.700006 57992 system_pods.go:126] duration metric: took 81.2184ms to wait for k8s-apps to be running ...
I0915 21:02:09.700006 57992 system_svc.go:44] waiting for kubelet service to be running ....
I0915 21:02:09.718525 57992 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
I0915 21:02:09.868994 57992 system_svc.go:56] duration metric: took 168.989ms WaitForService to wait for kubelet.
I0915 21:02:09.868994 57992 kubeadm.go:547] duration metric: took 3m8.5474799s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
I0915 21:02:09.868994 57992 node_conditions.go:102] verifying NodePressure condition ...
I0915 21:02:09.909349 57992 node_conditions.go:122] node storage ephemeral capacity is 65792556Ki
I0915 21:02:09.909584 57992 node_conditions.go:123] node cpu capacity is 4
I0915 21:02:09.909584 57992 node_conditions.go:105] duration metric: took 40.5899ms to run NodePressure ...
I0915 21:02:09.909751 57992 start.go:231] waiting for startup goroutines ...
I0915 21:02:10.165395 57992 start.go:462] kubectl: 1.20.0, cluster: 1.22.1 (minor skew: 2)
I0915 21:02:10.169631 57992 out.go:177]
W0915 21:02:10.193593 57992 out.go:242] ! C:\Program Files\Docker\Docker\resources\bin\kubectl.exe is version 1.20.0, which may have incompatibilites with Kubernetes 1.22.1.
I0915 21:02:10.198575 57992 out.go:177] - Want kubectl v1.22.1? Try 'minikube kubectl -- get pods -A'
I0915 21:02:10.203496 57992 out.go:177] * Done! kubectl is now configured to use "default-k8s-different-port-20210915205315-22848" cluster and "default" namespace by default
I0915 21:02:09.039489 60636 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_coredns --format={{.ID}}: (2.6193127s)
I0915 21:02:09.039489 60636 logs.go:270] 1 containers: [bd8a9c6d784f]
I0915 21:02:09.049864 60636 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0915 21:02:10.941102 60636 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}: (1.890878s)
I0915 21:02:10.941102 60636 logs.go:270] 1 containers: [c93c1026cc1a]
I0915 21:02:10.970092 60636 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0915 21:02:08.682303 59380 pod_ready.go:92] pod "kube-proxy-fjmvd" in "kube-system" namespace has status "Ready":"True"
I0915 21:02:08.682576 59380 pod_ready.go:81] duration metric: took 58.736ms waiting for pod "kube-proxy-fjmvd" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.682576 59380 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.764335 59380 pod_ready.go:92] pod "kube-scheduler-old-k8s-version-20210915203352-22848" in "kube-system" namespace has status "Ready":"True"
I0915 21:02:08.764335 59380 pod_ready.go:81] duration metric: took 81.7595ms waiting for pod "kube-scheduler-old-k8s-version-20210915203352-22848" in "kube-system" namespace to be "Ready" ...
I0915 21:02:08.764335 59380 pod_ready.go:38] duration metric: took 1m42.6827872s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0915 21:02:08.764335 59380 api_server.go:50] waiting for apiserver process to appear ...
I0915 21:02:08.788795 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0915 21:02:11.886042 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}: (3.0970689s)
I0915 21:02:11.886149 59380 logs.go:270] 1 containers: [3537b9c6e4ed]
I0915 21:02:11.900760 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0915 21:02:09.631726 71312 provision.go:138] copyHostCerts
I0915 21:02:09.632738 71312 exec_runner.go:145] found C:\Users\jenkins\minikube-integration\.minikube/ca.pem, removing ...
I0915 21:02:09.632738 71312 exec_runner.go:208] rm: C:\Users\jenkins\minikube-integration\.minikube\ca.pem
I0915 21:02:09.632738 71312 exec_runner.go:152] cp: C:\Users\jenkins\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins\minikube-integration\.minikube/ca.pem (1078 bytes)
I0915 21:02:09.634742 71312 exec_runner.go:145] found C:\Users\jenkins\minikube-integration\.minikube/cert.pem, removing ...
I0915 21:02:09.634742 71312 exec_runner.go:208] rm: C:\Users\jenkins\minikube-integration\.minikube\cert.pem
I0915 21:02:09.635742 71312 exec_runner.go:152] cp: C:\Users\jenkins\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins\minikube-integration\.minikube/cert.pem (1123 bytes)
I0915 21:02:09.637741 71312 exec_runner.go:145] found C:\Users\jenkins\minikube-integration\.minikube/key.pem, removing ...
I0915 21:02:09.637741 71312 exec_runner.go:208] rm: C:\Users\jenkins\minikube-integration\.minikube\key.pem
I0915 21:02:09.638743 71312 exec_runner.go:152] cp: C:\Users\jenkins\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins\minikube-integration\.minikube/key.pem (1675 bytes)
I0915 21:02:09.639741 71312 provision.go:112] generating server cert: C:\Users\jenkins\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.newest-cni-20210915210129-22848 san=[192.168.58.2 127.0.0.1 localhost 127.0.0.1 minikube newest-cni-20210915210129-22848]
I0915 21:02:09.859069 71312 provision.go:172] copyRemoteCerts
I0915 21:02:09.876086 71312 ssh_runner.go:152] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0915 21:02:09.890070 71312 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915210129-22848
I0915 21:02:10.688626 71312 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58050 SSHKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\newest-cni-20210915210129-22848\id_rsa Username:docker}
I0915 21:02:11.144232 71312 ssh_runner.go:192] Completed: sudo mkdir -p /etc/docker /etc/docker /etc/docker: (1.2681545s)
I0915 21:02:11.144828 71312 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1265 bytes)
I0915 21:02:11.307838 71312 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0915 21:02:11.565420 71312 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0915 21:02:11.737230 71312 provision.go:86] duration metric: configureAuth took 2.869402s
I0915 21:02:11.737230 71312 ubuntu.go:193] setting minikube options for container-runtime
I0915 21:02:11.737892 71312 config.go:177] Loaded profile config "newest-cni-20210915210129-22848": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.22.2-rc.0
I0915 21:02:11.742616 71312 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915210129-22848
I0915 21:02:12.650152 71312 main.go:130] libmachine: Using SSH client type: native
I0915 21:02:12.650744 71312 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x11facc0] 0x11fdb80 <nil> [] 0s} 127.0.0.1 58050 <nil> <nil>}
I0915 21:02:12.650902 71312 main.go:130] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0915 21:02:13.206639 71312 main.go:130] libmachine: SSH cmd err, output: <nil>: overlay
I0915 21:02:13.206863 71312 ubuntu.go:71] root file system type: overlay
I0915 21:02:13.207210 71312 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
I0915 21:02:13.217715 71312 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915210129-22848
I0915 21:02:14.076472 71312 main.go:130] libmachine: Using SSH client type: native
I0915 21:02:14.076472 71312 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x11facc0] 0x11fdb80 <nil> [] 0s} 127.0.0.1 58050 <nil> <nil>}
I0915 21:02:14.076472 71312 main.go:130] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0915 21:02:13.250820 60636 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}: (2.2807428s)
I0915 21:02:13.251041 60636 logs.go:270] 1 containers: [45c113f5873c]
I0915 21:02:13.254186 60636 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0915 21:02:14.972340 60636 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}: (1.7181659s)
I0915 21:02:14.972469 60636 logs.go:270] 1 containers: [780e328d61ab]
I0915 21:02:14.992056 60636 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0915 21:02:17.412975 60636 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}: (2.4200496s)
I0915 21:02:17.413096 60636 logs.go:270] 1 containers: [dd15470492e2]
I0915 21:02:17.446750 60636 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0915 21:02:14.320564 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_etcd --format={{.ID}}: (2.4194268s)
I0915 21:02:14.320721 59380 logs.go:270] 1 containers: [0b52d929b618]
I0915 21:02:14.340316 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0915 21:02:16.462510 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_coredns --format={{.ID}}: (2.1221147s)
I0915 21:02:16.462510 59380 logs.go:270] 2 containers: [56f408c7ef80 edc543ebc579]
I0915 21:02:16.481520 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0915 21:02:17.909577 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}: (1.4279284s)
I0915 21:02:17.909577 59380 logs.go:270] 1 containers: [f62b255531be]
I0915 21:02:17.922156 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0915 21:02:14.673467 71312 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0915 21:02:14.701532 71312 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915210129-22848
I0915 21:02:15.535422 71312 main.go:130] libmachine: Using SSH client type: native
I0915 21:02:15.536146 71312 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x11facc0] 0x11fdb80 <nil> [] 0s} 127.0.0.1 58050 <nil> <nil>}
I0915 21:02:15.536146 71312 main.go:130] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0915 21:02:19.765952 60636 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}: (2.3190791s)
I0915 21:02:19.766191 60636 logs.go:270] 2 containers: [5c2cc55aa311 3f363fd7e539]
I0915 21:02:19.766375 60636 logs.go:123] Gathering logs for kube-apiserver [5b512fefe3b9] ...
I0915 21:02:19.766375 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 5b512fefe3b9"
I0915 21:02:21.969273 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 5b512fefe3b9": (2.2029126s)
I0915 21:02:21.991142 60636 logs.go:123] Gathering logs for etcd [225ed7592959] ...
I0915 21:02:21.991142 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 225ed7592959"
I0915 21:02:19.029541 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}: (1.1073925s)
I0915 21:02:19.030029 59380 logs.go:270] 1 containers: [b6a7846cc5e6]
I0915 21:02:19.057397 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0915 21:02:20.309647 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}: (1.2511439s)
I0915 21:02:20.309647 59380 logs.go:270] 1 containers: [cf62060e4365]
I0915 21:02:20.325297 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0915 21:02:22.494620 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}: (2.1690651s)
I0915 21:02:22.494620 59380 logs.go:270] 1 containers: [2708aca9f909]
I0915 21:02:22.513090 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0915 21:02:22.819430 71312 main.go:130] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2021-07-30 19:52:33.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2021-09-15 21:02:14.653086000 +0000
@@ -1,30 +1,32 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
+BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
-Requires=docker.socket containerd.service
+Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutSec=0
-RestartSec=2
-Restart=always
-
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
+Restart=on-failure
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
@@ -32,16 +34,16 @@
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0915 21:02:22.819430 71312 machine.go:91] provisioned docker machine in 17.1563625s
I0915 21:02:22.819430 71312 client.go:171] LocalClient.Create took 47.2770749s
I0915 21:02:22.819664 71312 start.go:168] duration metric: libmachine.API.Create for "newest-cni-20210915210129-22848" took 47.277638s
I0915 21:02:22.819664 71312 start.go:267] post-start starting for "newest-cni-20210915210129-22848" (driver="docker")
I0915 21:02:22.819664 71312 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0915 21:02:22.841502 71312 ssh_runner.go:152] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0915 21:02:22.851387 71312 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915210129-22848
I0915 21:02:23.711808 71312 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58050 SSHKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\newest-cni-20210915210129-22848\id_rsa Username:docker}
I0915 21:02:25.218412 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 225ed7592959": (3.2272912s)
I0915 21:02:25.292510 60636 logs.go:123] Gathering logs for container status ...
I0915 21:02:25.292510 60636 ssh_runner.go:152] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0915 21:02:26.452902 60636 ssh_runner.go:192] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (1.1603996s)
I0915 21:02:26.453922 60636 logs.go:123] Gathering logs for dmesg ...
I0915 21:02:26.453922 60636 ssh_runner.go:152] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0915 21:02:27.577219 60636 ssh_runner.go:192] Completed: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400": (1.1233037s)
I0915 21:02:27.577219 60636 logs.go:123] Gathering logs for coredns [bd8a9c6d784f] ...
I0915 21:02:27.577219 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 bd8a9c6d784f"
I0915 21:02:23.899916 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}: (1.3868346s)
I0915 21:02:23.900058 59380 logs.go:270] 2 containers: [5dcc93538d3a 2444d44bba6b]
I0915 21:02:23.900058 59380 logs.go:123] Gathering logs for kube-apiserver [3537b9c6e4ed] ...
I0915 21:02:23.900058 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 3537b9c6e4ed"
I0915 21:02:26.584619 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 3537b9c6e4ed": (2.6845789s)
I0915 21:02:26.628390 59380 logs.go:123] Gathering logs for etcd [0b52d929b618] ...
I0915 21:02:26.628390 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 0b52d929b618"
I0915 21:02:24.118327 71312 ssh_runner.go:192] Completed: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs: (1.2766951s)
I0915 21:02:24.152027 71312 ssh_runner.go:152] Run: cat /etc/os-release
I0915 21:02:24.204076 71312 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0915 21:02:24.204251 71312 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0915 21:02:24.204385 71312 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0915 21:02:24.204385 71312 info.go:137] Remote host: Ubuntu 20.04.2 LTS
I0915 21:02:24.204385 71312 filesync.go:126] Scanning C:\Users\jenkins\minikube-integration\.minikube\addons for local assets ...
I0915 21:02:24.204922 71312 filesync.go:126] Scanning C:\Users\jenkins\minikube-integration\.minikube\files for local assets ...
I0915 21:02:24.206378 71312 filesync.go:149] local asset: C:\Users\jenkins\minikube-integration\.minikube\files\etc\ssl\certs\228482.pem -> 228482.pem in /etc/ssl/certs
I0915 21:02:24.230742 71312 ssh_runner.go:152] Run: sudo mkdir -p /etc/ssl/certs
I0915 21:02:24.321807 71312 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\files\etc\ssl\certs\228482.pem --> /etc/ssl/certs/228482.pem (1708 bytes)
I0915 21:02:24.563612 71312 start.go:270] post-start completed in 1.7439584s
I0915 21:02:24.582605 71312 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-20210915210129-22848
I0915 21:02:25.320802 71312 profile.go:148] Saving config to C:\Users\jenkins\minikube-integration\.minikube\profiles\newest-cni-20210915210129-22848\config.json ...
I0915 21:02:25.350199 71312 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0915 21:02:25.359979 71312 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915210129-22848
I0915 21:02:26.197254 71312 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58050 SSHKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\newest-cni-20210915210129-22848\id_rsa Username:docker}
I0915 21:02:26.542917 71312 ssh_runner.go:192] Completed: sh -c "df -h /var | awk 'NR==2{print $5}'": (1.1927259s)
I0915 21:02:26.543042 71312 start.go:129] duration metric: createHost completed in 51.0058333s
I0915 21:02:26.543042 71312 start.go:80] releasing machines lock for "newest-cni-20210915210129-22848", held for 51.0063581s
I0915 21:02:26.560670 71312 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" newest-cni-20210915210129-22848
I0915 21:02:27.523676 71312 ssh_runner.go:152] Run: curl -sS -m 2 https://k8s.gcr.io/
I0915 21:02:27.537720 71312 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915210129-22848
I0915 21:02:27.552138 71312 ssh_runner.go:152] Run: systemctl --version
I0915 21:02:27.563143 71312 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20210915210129-22848
I0915 21:02:28.384022 71312 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58050 SSHKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\newest-cni-20210915210129-22848\id_rsa Username:docker}
I0915 21:02:28.420395 71312 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:58050 SSHKeyPath:C:\Users\jenkins\minikube-integration\.minikube\machines\newest-cni-20210915210129-22848\id_rsa Username:docker}
I0915 21:02:28.775210 71312 ssh_runner.go:192] Completed: systemctl --version: (1.2230797s)
I0915 21:02:28.794440 71312 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service containerd
I0915 21:02:30.293345 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 bd8a9c6d784f": (2.7158756s)
I0915 21:02:30.293616 60636 logs.go:123] Gathering logs for kube-proxy [45c113f5873c] ...
I0915 21:02:30.293616 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 45c113f5873c"
I0915 21:02:29.188968 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 0b52d929b618": (2.5605947s)
I0915 21:02:29.222295 59380 logs.go:123] Gathering logs for coredns [56f408c7ef80] ...
I0915 21:02:29.222653 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 56f408c7ef80"
I0915 21:02:30.913622 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 56f408c7ef80": (1.6909792s)
I0915 21:02:30.914656 59380 logs.go:123] Gathering logs for Docker ...
I0915 21:02:30.914656 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0915 21:02:31.073495 59380 logs.go:123] Gathering logs for container status ...
I0915 21:02:31.073495 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I0915 21:02:32.132766 59380 ssh_runner.go:192] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (1.0592772s)
I0915 21:02:32.134065 59380 logs.go:123] Gathering logs for dmesg ...
I0915 21:02:32.134065 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I0915 21:02:32.761531 59380 logs.go:123] Gathering logs for describe nodes ...
I0915 21:02:32.761774 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.14.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0915 21:02:29.232877 71312 ssh_runner.go:192] Completed: curl -sS -m 2 https://k8s.gcr.io/: (1.7092123s)
I0915 21:02:29.254275 71312 ssh_runner.go:152] Run: sudo systemctl cat docker.service
I0915 21:02:29.409130 71312 cruntime.go:255] skipping containerd shutdown because we are bound to it
I0915 21:02:29.427839 71312 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service crio
I0915 21:02:29.533831 71312 ssh_runner.go:152] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I0915 21:02:29.738307 71312 ssh_runner.go:152] Run: sudo systemctl unmask docker.service
I0915 21:02:30.581903 71312 ssh_runner.go:152] Run: sudo systemctl enable docker.socket
I0915 21:02:31.624980 71312 ssh_runner.go:192] Completed: sudo systemctl enable docker.socket: (1.0430844s)
I0915 21:02:31.643975 71312 ssh_runner.go:152] Run: sudo systemctl cat docker.service
I0915 21:02:31.900633 71312 ssh_runner.go:152] Run: sudo systemctl daemon-reload
I0915 21:02:32.986333 71312 ssh_runner.go:192] Completed: sudo systemctl daemon-reload: (1.0857068s)
I0915 21:02:33.011636 71312 ssh_runner.go:152] Run: sudo systemctl start docker
I0915 21:02:33.142677 71312 ssh_runner.go:152] Run: docker version --format {{.Server.Version}}
I0915 21:02:33.621182 71312 ssh_runner.go:152] Run: docker version --format {{.Server.Version}}
I0915 21:02:34.075598 71312 out.go:204] * Preparing Kubernetes v1.22.2-rc.0 on Docker 20.10.8 ...
I0915 21:02:34.094423 71312 cli_runner.go:115] Run: docker exec -t newest-cni-20210915210129-22848 dig +short host.docker.internal
I0915 21:02:35.705263 71312 cli_runner.go:168] Completed: docker exec -t newest-cni-20210915210129-22848 dig +short host.docker.internal: (1.6108511s)
I0915 21:02:35.705263 71312 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2
I0915 21:02:35.721787 71312 ssh_runner.go:152] Run: grep 192.168.65.2 host.minikube.internal$ /etc/hosts
I0915 21:02:35.810215 71312 ssh_runner.go:152] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0915 21:02:36.040817 71312 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" newest-cni-20210915210129-22848
I0915 21:02:36.844223 71312 out.go:177] - kubelet.network-plugin=cni
I0915 21:02:33.225118 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 45c113f5873c": (2.9315214s)
I0915 21:02:33.225514 60636 logs.go:123] Gathering logs for describe nodes ...
I0915 21:02:33.225514 60636 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
I0915 21:02:36.847964 71312 out.go:177] - kubeadm.pod-network-cidr=192.168.111.111/16
I0915 21:02:36.848507 71312 preload.go:131] Checking if preload exists for k8s version v1.22.2-rc.0 and runtime docker
I0915 21:02:36.861442 71312 ssh_runner.go:152] Run: docker images --format {{.Repository}}:{{.Tag}}
I0915 21:02:37.370821 71312 docker.go:558] Got preloaded images:
I0915 21:02:37.371009 71312 docker.go:564] k8s.gcr.io/kube-apiserver:v1.22.2-rc.0 wasn't preloaded
I0915 21:02:37.385934 71312 ssh_runner.go:152] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
I0915 21:02:37.530391 71312 ssh_runner.go:152] Run: which lz4
I0915 21:02:37.599862 71312 ssh_runner.go:152] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
I0915 21:02:37.639466 71312 ssh_runner.go:309] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
stdout:
stderr:
stat: cannot stat '/preloaded.tar.lz4': No such file or directory
I0915 21:02:37.640111 71312 ssh_runner.go:319] scp C:\Users\jenkins\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v12-v1.22.2-rc.0-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (540035829 bytes)
I0915 21:02:42.084060 60636 ssh_runner.go:192] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.22.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": (8.8586035s)
I0915 21:02:42.088584 60636 logs.go:123] Gathering logs for kubernetes-dashboard [780e328d61ab] ...
I0915 21:02:42.088774 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 780e328d61ab"
I0915 21:02:40.222423 59380 ssh_runner.go:192] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.14.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": (7.4606972s)
I0915 21:02:40.248362 59380 logs.go:123] Gathering logs for kube-scheduler [f62b255531be] ...
I0915 21:02:40.250291 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 f62b255531be"
I0915 21:02:45.538641 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 780e328d61ab": (3.4498893s)
I0915 21:02:45.539921 60636 logs.go:123] Gathering logs for storage-provisioner [dd15470492e2] ...
I0915 21:02:45.539921 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 dd15470492e2"
I0915 21:02:44.722028 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 f62b255531be": (4.4715535s)
I0915 21:02:44.739482 59380 logs.go:123] Gathering logs for storage-provisioner [2708aca9f909] ...
I0915 21:02:44.739702 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 2708aca9f909"
I0915 21:02:50.757829 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 dd15470492e2": (5.2179427s)
I0915 21:02:50.759507 60636 logs.go:123] Gathering logs for kube-controller-manager [5c2cc55aa311] ...
I0915 21:02:50.759684 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 5c2cc55aa311"
I0915 21:02:48.982771 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 2708aca9f909": (4.2430962s)
I0915 21:02:48.982771 59380 logs.go:123] Gathering logs for kube-controller-manager [5dcc93538d3a] ...
I0915 21:02:48.982771 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 5dcc93538d3a"
I0915 21:02:57.130767 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 5dcc93538d3a": (8.1478521s)
I0915 21:02:57.167857 59380 logs.go:123] Gathering logs for coredns [edc543ebc579] ...
I0915 21:02:57.167857 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 edc543ebc579"
I0915 21:02:58.304395 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 5c2cc55aa311": (7.5447603s)
I0915 21:02:58.329179 60636 logs.go:123] Gathering logs for Docker ...
I0915 21:02:58.329179 60636 ssh_runner.go:152] Run: /bin/bash -c "sudo journalctl -u docker -n 400"
I0915 21:02:59.517340 60636 ssh_runner.go:192] Completed: /bin/bash -c "sudo journalctl -u docker -n 400": (1.1879461s)
I0915 21:02:59.540019 60636 logs.go:123] Gathering logs for kube-scheduler [c93c1026cc1a] ...
I0915 21:02:59.540174 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 c93c1026cc1a"
I0915 21:03:00.457615 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 edc543ebc579": (3.2897791s)
I0915 21:03:00.459196 59380 logs.go:123] Gathering logs for kube-controller-manager [2444d44bba6b] ...
I0915 21:03:00.459196 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 2444d44bba6b"
I0915 21:03:02.905669 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 2444d44bba6b": (2.4464887s)
I0915 21:03:02.906730 59380 logs.go:123] Gathering logs for kubelet ...
I0915 21:03:02.906730 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0915 21:03:03.344788 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 c93c1026cc1a": (3.8046393s)
I0915 21:03:03.349747 60636 logs.go:123] Gathering logs for kube-controller-manager [3f363fd7e539] ...
I0915 21:03:03.349747 60636 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 3f363fd7e539"
I0915 21:03:03.939909 59380 ssh_runner.go:192] Completed: /bin/bash -c "sudo journalctl -u kubelet -n 400": (1.0331857s)
W0915 21:03:04.019616 59380 logs.go:138] Found kubelet problem: Sep 15 21:01:39 old-k8s-version-20210915203352-22848 kubelet[6242]: E0915 21:01:39.816057 6242 pod_workers.go:190] Error syncing pod 13c53a65-1668-11ec-9ee7-0242535a2e8f ("metrics-server-8546d8b77b-pwkmq_kube-system(13c53a65-1668-11ec-9ee7-0242535a2e8f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"
I0915 21:03:04.019616 59380 logs.go:123] Gathering logs for kube-proxy [b6a7846cc5e6] ...
I0915 21:03:04.020627 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 b6a7846cc5e6"
I0915 21:03:07.698325 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 b6a7846cc5e6": (3.6775764s)
I0915 21:03:07.699351 59380 logs.go:123] Gathering logs for kubernetes-dashboard [cf62060e4365] ...
I0915 21:03:07.699512 59380 ssh_runner.go:152] Run: /bin/bash -c "docker logs --tail 400 cf62060e4365"
I0915 21:03:10.216457 60636 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 3f363fd7e539": (6.8665889s)
I0915 21:03:10.236783 60636 logs.go:123] Gathering logs for kubelet ...
I0915 21:03:10.236783 60636 ssh_runner.go:152] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I0915 21:03:11.553417 60636 ssh_runner.go:192] Completed: /bin/bash -c "sudo journalctl -u kubelet -n 400": (1.3164683s)
I0915 21:03:11.626181 59380 ssh_runner.go:192] Completed: /bin/bash -c "docker logs --tail 400 cf62060e4365": (3.9266946s)
I0915 21:03:11.627244 59380 out.go:311] Setting ErrFile to fd 2480...
I0915 21:03:11.627244 59380 out.go:345] TERM=,COLORTERM=, which probably does not support color
W0915 21:03:11.628241 59380 out.go:242] X Problems detected in kubelet:
W0915 21:03:11.628241 59380 out.go:242] Sep 15 21:01:39 old-k8s-version-20210915203352-22848 kubelet[6242]: E0915 21:01:39.816057 6242 pod_workers.go:190] Error syncing pod 13c53a65-1668-11ec-9ee7-0242535a2e8f ("metrics-server-8546d8b77b-pwkmq_kube-system(13c53a65-1668-11ec-9ee7-0242535a2e8f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"
I0915 21:03:11.628241 59380 out.go:311] Setting ErrFile to fd 2480...
I0915 21:03:11.628241 59380 out.go:345] TERM=,COLORTERM=, which probably does not support color
I0915 21:03:14.324659 60636 system_pods.go:59] 8 kube-system pods found
I0915 21:03:14.324659 60636 system_pods.go:61] "coredns-78fcd69978-b6m27" [3fc7acc8-56a7-4172-9ecd-8109469c4dc3] Running
I0915 21:03:14.324659 60636 system_pods.go:61] "etcd-embed-certs-20210915203657-22848" [32e94a70-1e65-4e2f-aef0-e4d70db9d83d] Running
I0915 21:03:14.324659 60636 system_pods.go:61] "kube-apiserver-embed-certs-20210915203657-22848" [beade954-ec00-4a60-b123-7664ff8b8c40] Running
I0915 21:03:14.324659 60636 system_pods.go:61] "kube-controller-manager-embed-certs-20210915203657-22848" [42f80b13-022a-4925-b978-11e841b8bea3] Running
I0915 21:03:14.324659 60636 system_pods.go:61] "kube-proxy-v6dbz" [6b78a2c4-c67f-40cc-a21f-175097dcfd11] Running
I0915 21:03:14.324659 60636 system_pods.go:61] "kube-scheduler-embed-certs-20210915203657-22848" [d746244e-81e0-4c15-ad1f-c02392773ff3] Running
I0915 21:03:14.324659 60636 system_pods.go:61] "metrics-server-7c784ccb57-ljjc6" [9ca7acff-feb6-49d1-b680-6341086852fd] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0915 21:03:14.324659 60636 system_pods.go:61] "storage-provisioner" [ccb11020-cc00-4835-8ea0-a2d46f6ac8cd] Running
I0915 21:03:14.324659 60636 system_pods.go:74] duration metric: took 1m15.0832059s to wait for pod list to return data ...
I0915 21:03:14.324659 60636 default_sa.go:34] waiting for default service account to be created ...
I0915 21:03:14.422148 60636 default_sa.go:45] found service account: "default"
I0915 21:03:14.422148 60636 default_sa.go:55] duration metric: took 97.4894ms for default service account to be created ...
I0915 21:03:14.422313 60636 system_pods.go:116] waiting for k8s-apps to be running ...
I0915 21:03:14.483718 60636 system_pods.go:86] 8 kube-system pods found
I0915 21:03:14.483944 60636 system_pods.go:89] "coredns-78fcd69978-b6m27" [3fc7acc8-56a7-4172-9ecd-8109469c4dc3] Running
I0915 21:03:14.483944 60636 system_pods.go:89] "etcd-embed-certs-20210915203657-22848" [32e94a70-1e65-4e2f-aef0-e4d70db9d83d] Running
I0915 21:03:14.483944 60636 system_pods.go:89] "kube-apiserver-embed-certs-20210915203657-22848" [beade954-ec00-4a60-b123-7664ff8b8c40] Running
I0915 21:03:14.483944 60636 system_pods.go:89] "kube-controller-manager-embed-certs-20210915203657-22848" [42f80b13-022a-4925-b978-11e841b8bea3] Running
I0915 21:03:14.483944 60636 system_pods.go:89] "kube-proxy-v6dbz" [6b78a2c4-c67f-40cc-a21f-175097dcfd11] Running
I0915 21:03:14.483944 60636 system_pods.go:89] "kube-scheduler-embed-certs-20210915203657-22848" [d746244e-81e0-4c15-ad1f-c02392773ff3] Running
I0915 21:03:14.484174 60636 system_pods.go:89] "metrics-server-7c784ccb57-ljjc6" [9ca7acff-feb6-49d1-b680-6341086852fd] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0915 21:03:14.484299 60636 system_pods.go:89] "storage-provisioner" [ccb11020-cc00-4835-8ea0-a2d46f6ac8cd] Running
I0915 21:03:14.484400 60636 system_pods.go:126] duration metric: took 62.0873ms to wait for k8s-apps to be running ...
I0915 21:03:14.484400 60636 system_svc.go:44] waiting for kubelet service to be running ....
I0915 21:03:14.526937 60636 ssh_runner.go:152] Run: sudo systemctl is-active --quiet service kubelet
I0915 21:03:15.168833 60636 system_svc.go:56] duration metric: took 684.2716ms WaitForService to wait for kubelet.
I0915 21:03:15.168982 60636 kubeadm.go:547] duration metric: took 4m18.4807443s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
I0915 21:03:15.168982 60636 node_conditions.go:102] verifying NodePressure condition ...
I0915 21:03:15.261303 60636 node_conditions.go:122] node storage ephemeral capacity is 65792556Ki
I0915 21:03:15.261487 60636 node_conditions.go:123] node cpu capacity is 4
I0915 21:03:15.261751 60636 node_conditions.go:105] duration metric: took 92.7691ms to run NodePressure ...
I0915 21:03:15.262136 60636 start.go:231] waiting for startup goroutines ...
I0915 21:03:15.610865 60636 start.go:462] kubectl: 1.20.0, cluster: 1.22.1 (minor skew: 2)
I0915 21:03:15.615095 60636 out.go:177]
W0915 21:03:15.624359 60636 out.go:242] ! C:\Program Files\Docker\Docker\resources\bin\kubectl.exe is version 1.20.0, which may have incompatibilites with Kubernetes 1.22.1.
I0915 21:03:15.630134 60636 out.go:177] - Want kubectl v1.22.1? Try 'minikube kubectl -- get pods -A'
I0915 21:03:15.634566 60636 out.go:177] * Done! kubectl is now configured to use "embed-certs-20210915203657-22848" cluster and "default" namespace by default
I0915 21:03:21.642458 59380 ssh_runner.go:152] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 21:03:22.962331 59380 ssh_runner.go:192] Completed: sudo pgrep -xnf kube-apiserver.*minikube.*: (1.3198818s)
I0915 21:03:22.962331 59380 api_server.go:70] duration metric: took 3m6.7549273s to wait for apiserver process to appear ...
I0915 21:03:22.962331 59380 api_server.go:86] waiting for apiserver healthz status ...
I0915 21:03:22.973266 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}
I0915 21:03:25.331696 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}: (2.3584456s)
I0915 21:03:25.331696 59380 logs.go:270] 1 containers: [3537b9c6e4ed]
I0915 21:03:25.354855 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}
I0915 21:03:28.602931 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_etcd --format={{.ID}}: (3.2480972s)
I0915 21:03:28.602931 59380 logs.go:270] 1 containers: [0b52d929b618]
I0915 21:03:28.619223 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}
I0915 21:03:31.478130 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_coredns --format={{.ID}}: (2.8589259s)
I0915 21:03:31.478960 59380 logs.go:270] 2 containers: [56f408c7ef80 edc543ebc579]
I0915 21:03:31.522508 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}
I0915 21:03:34.377512 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}: (2.8550217s)
I0915 21:03:34.377512 59380 logs.go:270] 1 containers: [f62b255531be]
I0915 21:03:34.393177 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}
I0915 21:03:35.911771 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}: (1.5186033s)
I0915 21:03:35.911910 59380 logs.go:270] 1 containers: [b6a7846cc5e6]
I0915 21:03:35.935753 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}
I0915 21:03:39.083471 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}}: (3.147738s)
I0915 21:03:39.083471 59380 logs.go:270] 1 containers: [cf62060e4365]
I0915 21:03:39.093501 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}
I0915 21:03:43.154841 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}}: (4.0613659s)
I0915 21:03:43.154841 59380 logs.go:270] 1 containers: [2708aca9f909]
I0915 21:03:43.166883 59380 ssh_runner.go:152] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}
I0915 21:03:46.250128 59380 ssh_runner.go:192] Completed: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}: (3.0832639s)
I0915 21:03:46.250254 59380 logs.go:270] 2 containers: [5dcc93538d3a 2444d44bba6b]
I0915 21:03:46.250254 59380 logs.go:123] Gathering logs for describe nodes ...
I0915 21:03:46.250254 59380 ssh_runner.go:152] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.14.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
*
* ==> Docker <==
* -- Logs begin at Wed 2021-09-15 20:50:33 UTC, end at Wed 2021-09-15 21:04:39 UTC. --
Sep 15 20:57:58 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T20:57:58.425947300Z" level=info msg="ignoring event" container=56ee26d2d802f2506e662823720e9fe7dbc1eef4f710efafd2e8e61b4033b510 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 20:57:59 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T20:57:59.596047000Z" level=info msg="ignoring event" container=ccb8aef11c354521450bf9a6831ff63af7b5abf658fc65e6440a111b4ef3c8ab module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 20:58:01 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T20:58:01.010745800Z" level=info msg="ignoring event" container=2beb62466c63110c58ff11bdaaff94058570df1158a18d99db6d60de26269de3 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 20:58:02 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T20:58:02.102844200Z" level=info msg="ignoring event" container=2438e41344f6aaaaf8cb11f307387a78ca44255f1d3489bec338d40a9d95379f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 20:58:03 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T20:58:03.121466800Z" level=info msg="ignoring event" container=feef17f2f4101fbcbdf992fecb64617535a192dc0b2715fc300d3d07fdcdde75 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 20:58:03 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T20:58:03.939445200Z" level=info msg="ignoring event" container=efdc8b6ad4e83db59d1cb39a988de65ddc36bd610d29f06aeb834a0177c3790a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 20:58:04 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T20:58:04.953238100Z" level=info msg="ignoring event" container=2c067aeb5ba34686d6da5c86200ff4049d81427db0da877be8f7ec40bafdba7e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 20:58:06 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T20:58:06.140677100Z" level=info msg="ignoring event" container=73357eba53e81044f79da41d275871f464579b561580c02566e6e0c3a8e86821 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 20:58:07 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T20:58:07.642640000Z" level=info msg="ignoring event" container=a980a1327edecf7860597138bf3b60c5f7007754c93e601c3547aeb75ce69928 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 20:58:08 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T20:58:08.512471500Z" level=info msg="ignoring event" container=24ded2f0bc5fd547e70c880e83f0b489d4370c336b8196a79eb791b1d08c9c84 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 20:58:09 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T20:58:09.750678100Z" level=info msg="ignoring event" container=635446c5c939457df157ed6248a9678aa6d0b08a8cb665f675ff428f80234848 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 20:58:10 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T20:58:10.588631000Z" level=info msg="ignoring event" container=8c7e8f6108b1e5641b5db89590d893dd234df882a8762e39982cc0061ec4c617 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 20:58:11 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T20:58:11.541403500Z" level=info msg="ignoring event" container=835c124cbb5238b109fb89a83db01675230fed0a3526b82346a45b354b29a00b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 20:58:12 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T20:58:12.307269900Z" level=info msg="ignoring event" container=14e5df03f4638129578faba821e29236da7fdf85b81216695522fa3128b3bd03 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 20:59:28 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T20:59:28.641374700Z" level=info msg="ignoring event" container=2444d44bba6bcad13f8a3b53c12828e6dcc9f1e27cfb8d61dc7f78aefc1bab46 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 21:00:34 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T21:00:34.074065700Z" level=error msg="stream copy error: reading from a closed fifo"
Sep 15 21:00:34 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T21:00:34.082045300Z" level=error msg="stream copy error: reading from a closed fifo"
Sep 15 21:00:35 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T21:00:35.529516300Z" level=error msg="048d22dff159e586f83048bee5732b80c7d47dc9bd43d743799997e173fd66e3 cleanup: failed to delete container from containerd: no such container"
Sep 15 21:01:26 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T21:01:26.357836300Z" level=info msg="ignoring event" container=edc543ebc579c6ea305637e052e85c6e98ef03c01ee9911f04b440841033db54 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 15 21:01:39 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T21:01:39.687514200Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"
Sep 15 21:01:39 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T21:01:39.687576900Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"
Sep 15 21:01:39 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T21:01:39.759521400Z" level=error msg="Handler for POST /v1.38/images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"
Sep 15 21:01:53 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T21:01:53.093208400Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="k8s.gcr.io/echoserver:1.4"
Sep 15 21:01:53 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T21:01:53.644419600Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="k8s.gcr.io/echoserver:1.4"
Sep 15 21:02:15 old-k8s-version-20210915203352-22848 dockerd[214]: time="2021-09-15T21:02:15.373659500Z" level=info msg="Download failed, retrying (1/5): unexpected EOF"
*
* ==> container status <==
* CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID
cf62060e4365a 9a07b5b4bfac0 2 minutes ago Running kubernetes-dashboard 0 a0de183f3af6f
56f408c7ef80a eb516548c180f 2 minutes ago Running coredns 1 79e7a6ac35951
2708aca9f9090 6e38f40d628db 3 minutes ago Running storage-provisioner 0 ffccf2c6a501f
edc543ebc579c eb516548c180f 3 minutes ago Exited coredns 0 79e7a6ac35951
b6a7846cc5e6f 5cd54e388abaf 4 minutes ago Running kube-proxy 0 7fd4d7ebc1ffb
5dcc93538d3a2 b95b1efa0436b 5 minutes ago Running kube-controller-manager 1 9d3be78e963ef
3537b9c6e4edd ecf910f40d6e0 6 minutes ago Running kube-apiserver 0 5e3b3c9e3c200
f62b255531be6 00638a24688b0 6 minutes ago Running kube-scheduler 0 35bd3c2d2864d
2444d44bba6bc b95b1efa0436b 6 minutes ago Exited kube-controller-manager 0 9d3be78e963ef
0b52d929b6188 2c4adeb21b4ff 6 minutes ago Running etcd 0 e04fd4934d629
*
* ==> coredns [56f408c7ef80] <==
* .:53
2021-09-15T21:01:54.683Z [INFO] CoreDNS-1.3.1
2021-09-15T21:01:54.683Z [INFO] linux/amd64, go1.11.4, 6b56a9c
CoreDNS-1.3.1
linux/amd64, go1.11.4, 6b56a9c
2021-09-15T21:01:54.683Z [INFO] plugin/reload: Running configuration MD5 = 0d0ce6260bc0c3008bf1060be1c57923
*
* ==> coredns [edc543ebc579] <==
* .:53
2021-09-15T21:01:08.338Z [INFO] CoreDNS-1.3.1
2021-09-15T21:01:08.338Z [INFO] linux/amd64, go1.11.4, 6b56a9c
CoreDNS-1.3.1
linux/amd64, go1.11.4, 6b56a9c
2021-09-15T21:01:08.338Z [INFO] plugin/reload: Running configuration MD5 = 599b9eb76b8c147408aed6a0bbe0f669
E0915 21:01:24.346717 1 reflector.go:134] github.com/coredns/coredns/plugin/kubernetes/controller.go:315: Failed to list *v1.Service: Get https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.96.0.1:443: connect: connection refused
E0915 21:01:24.346717 1 reflector.go:134] github.com/coredns/coredns/plugin/kubernetes/controller.go:315: Failed to list *v1.Service: Get https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0: dial tcp 10.96.0.1:443: connect: connection refused
log: exiting because of error: log: cannot create log: open /tmp/coredns.coredns-fb8b8dccf-pxwb4.unknownuser.log.ERROR.20210915-210124.1: no such file or directory
*
* ==> describe nodes <==
* Name: old-k8s-version-20210915203352-22848
Roles: master
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=old-k8s-version-20210915203352-22848
kubernetes.io/os=linux
minikube.k8s.io/commit=0d321606059ead2904f4f5ddd59a9a7026c7ee04
minikube.k8s.io/name=old-k8s-version-20210915203352-22848
minikube.k8s.io/updated_at=2021_09_15T20_59_49_0700
minikube.k8s.io/version=v1.23.0
node-role.kubernetes.io/master=
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 15 Sep 2021 20:59:24 +0000
Taints: <none>
Unschedulable: false
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 15 Sep 2021 21:04:00 +0000 Wed, 15 Sep 2021 20:59:13 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 15 Sep 2021 21:04:00 +0000 Wed, 15 Sep 2021 20:59:13 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 15 Sep 2021 21:04:00 +0000 Wed, 15 Sep 2021 20:59:13 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 15 Sep 2021 21:04:00 +0000 Wed, 15 Sep 2021 20:59:13 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.85.2
Hostname: old-k8s-version-20210915203352-22848
Capacity:
cpu: 4
ephemeral-storage: 65792556Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 20481980Ki
pods: 110
Allocatable:
cpu: 4
ephemeral-storage: 65792556Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 20481980Ki
pods: 110
System Info:
Machine ID: 4b5e5cdd53d44f5ab575bb522d42acca
System UUID: a6b6ae6e-adde-4157-81eb-073f2cc75b74
Boot ID: 7b7b18db-3e3e-49d3-a2cb-ac38329b7bd9
Kernel Version: 4.19.121-linuxkit
OS Image: Ubuntu 20.04.2 LTS
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://20.10.8
Kubelet Version: v1.14.0
Kube-Proxy Version: v1.14.0
PodCIDR: 10.244.0.0/24
Non-terminated Pods: (10 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system coredns-fb8b8dccf-pxwb4 100m (2%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (0%!)(MISSING) 4m32s
kube-system etcd-old-k8s-version-20210915203352-22848 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m37s
kube-system kube-apiserver-old-k8s-version-20210915203352-22848 250m (6%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m21s
kube-system kube-controller-manager-old-k8s-version-20210915203352-22848 200m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 5m11s
kube-system kube-proxy-fjmvd 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m32s
kube-system kube-scheduler-old-k8s-version-20210915203352-22848 100m (2%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 4m35s
kube-system metrics-server-8546d8b77b-pwkmq 100m (2%!)(MISSING) 0 (0%!)(MISSING) 300Mi (1%!)(MISSING) 0 (0%!)(MISSING) 3m22s
kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m23s
kubernetes-dashboard dashboard-metrics-scraper-5b494cc544-2mvzw 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m14s
kubernetes-dashboard kubernetes-dashboard-5d8978d65d-8p7lf 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 3m14s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (18%!)(MISSING) 0 (0%!)(MISSING)
memory 370Mi (1%!)(MISSING) 170Mi (0%!)(MISSING)
ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeHasSufficientMemory 6m8s (x8 over 6m11s) kubelet, old-k8s-version-20210915203352-22848 Node old-k8s-version-20210915203352-22848 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m8s (x8 over 6m11s) kubelet, old-k8s-version-20210915203352-22848 Node old-k8s-version-20210915203352-22848 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m8s (x7 over 6m11s) kubelet, old-k8s-version-20210915203352-22848 Node old-k8s-version-20210915203352-22848 status is now: NodeHasSufficientPID
Normal Starting 3m41s kube-proxy, old-k8s-version-20210915203352-22848 Starting kube-proxy.
*
* ==> dmesg <==
* [ +0.000000] hv_stimer0_isr+0x20/0x2d
[ +0.000000] hv_stimer0_vector_handler+0x3b/0x57
[ +0.000000] hv_stimer0_callback_vector+0xf/0x20
[ +0.000000] </IRQ>
[ +0.000000] RIP: 0010:arch_local_irq_enable+0x7/0x8
[ +0.000000] Code: ef ff ff 0f 20 d8 0f 1f 40 00 c3 48 89 f8 0f 1f 40 00 c3 48 89 f8 0f 1f 40 00 c3 48 89 f8 0f 1f 40 00 c3 fb 66 0f 1f 44 00 00 <c3> 0f 1f 44 00 00 40 f6 c7 02 74 12 48 b8 ff 0f 00 00 00 00 f0 ff
[ +0.000000] RSP: 0000:ffffbcaf423f7ee0 EFLAGS: 00000206 ORIG_RAX: ffffffffffffff12
[ +0.000000] RAX: 0000000080000000 RBX: 0000000000000000 RCX: 0000000000000000
[ +0.000000] RDX: 000055a9735499db RSI: 0000000000000004 RDI: ffffbcaf423f7f58
[ +0.000000] RBP: ffffbcaf423f7f58 R08: 0000000000000000 R09: 0000000000000000
[ +0.000000] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000004
[ +0.000000] R13: 000055a9735499db R14: ffff97d483b18dc0 R15: ffff97d4e4dc7400
[ +0.000000] __do_page_fault+0x17f/0x42d
[ +0.000000] ? page_fault+0x8/0x30
[ +0.000000] page_fault+0x1e/0x30
[ +0.000000] RIP: 0033:0x55a9730c8f03
[ +0.000000] Code: 0f 6f d9 66 0f ef 0d ec 85 97 00 66 0f ef 15 f4 85 97 00 66 0f ef 1d fc 85 97 00 66 0f 38 dc c9 66 0f 38 dc d2 66 0f 38 dc db <f3> 0f 6f 20 f3 0f 6f 68 10 f3 0f 6f 74 08 e0 f3 0f 6f 7c 08 f0 66
[ +0.000000] RSP: 002b:000000c00004bdc8 EFLAGS: 00010287
[ +0.000000] RAX: 000055a9735499db RBX: 000055a9730cb860 RCX: 0000000000000022
[ +0.000000] RDX: 000000c00004bde0 RSI: 000000c00004be48 RDI: 000000c000080868
[ +0.000000] RBP: 000000c00004be28 R08: 000055a97353d681 R09: 0000000000000000
[ +0.000000] R10: 0000000000000004 R11: 000000c0000807d0 R12: 000000000000001a
[ +0.000000] R13: 0000000000000006 R14: 0000000000000008 R15: 0000000000000017
[ +0.000000] ---[ end trace cdbbbbc925f6eff0 ]---
[Sep15 20:45] tee (198366): /proc/194820/oom_adj is deprecated, please use /proc/194820/oom_score_adj instead.
*
* ==> etcd [0b52d929b618] <==
* 2021-09-15 21:02:06.294535 W | etcdserver: read-only range request "key:\"/registry/clusterroles\" range_end:\"/registry/clusterrolet\" count_only:true " with result "range_response_count:0 size:7" took too long (178.035ms) to execute
2021-09-15 21:02:06.561438 I | embed: rejected connection from "127.0.0.1:39362" (error "EOF", ServerName "")
2021-09-15 21:02:07.257426 W | etcdserver: read-only range request "key:\"/registry/minions/old-k8s-version-20210915203352-22848\" " with result "range_response_count:1 size:3284" took too long (123.1187ms) to execute
2021-09-15 21:02:07.877931 W | etcdserver: read-only range request "key:\"/registry/secrets\" range_end:\"/registry/secrett\" count_only:true " with result "range_response_count:0 size:7" took too long (415.9755ms) to execute
2021-09-15 21:02:07.894717 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (199.3305ms) to execute
2021-09-15 21:02:34.859092 W | etcdserver: request "header:<ID:9722563420904418568 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/masterleases/192.168.85.2\" mod_revision:590 > success:<request_put:<key:\"/registry/masterleases/192.168.85.2\" value_size:67 lease:499191384049642758 >> failure:<request_range:<key:\"/registry/masterleases/192.168.85.2\" > >>" with result "size:16" took too long (134.4731ms) to execute
2021-09-15 21:02:46.549813 W | etcdserver: request "header:<ID:9722563420904418602 username:\"kube-apiserver-etcd-client\" auth_revision:1 > lease_grant:<ttl:15-second id:06ed7beb4136ed29>" with result "size:40" took too long (334.5257ms) to execute
2021-09-15 21:02:49.725821 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" " with result "range_response_count:1 size:766" took too long (114.4536ms) to execute
2021-09-15 21:02:56.983932 W | etcdserver: request "header:<ID:9722563420904418640 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/minions/old-k8s-version-20210915203352-22848\" mod_revision:546 > success:<request_put:<key:\"/registry/minions/old-k8s-version-20210915203352-22848\" value_size:3208 >> failure:<request_range:<key:\"/registry/minions/old-k8s-version-20210915203352-22848\" > >>" with result "size:16" took too long (134.3574ms) to execute
2021-09-15 21:03:00.596276 W | etcdserver: read-only range request "key:\"/registry/networkpolicies\" range_end:\"/registry/networkpoliciet\" count_only:true " with result "range_response_count:0 size:5" took too long (126.168ms) to execute
2021-09-15 21:03:05.039330 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" " with result "range_response_count:1 size:766" took too long (123.2504ms) to execute
2021-09-15 21:03:07.801275 W | etcdserver: read-only range request "key:\"/registry/clusterrolebindings\" range_end:\"/registry/clusterrolebindingt\" count_only:true " with result "range_response_count:0 size:7" took too long (131.9686ms) to execute
2021-09-15 21:03:12.487095 W | etcdserver: read-only range request "key:\"/registry/jobs/\" range_end:\"/registry/jobs0\" limit:500 " with result "range_response_count:0 size:5" took too long (148.5938ms) to execute
2021-09-15 21:03:15.423874 W | etcdserver: read-only range request "key:\"/registry/masterleases/\" range_end:\"/registry/masterleases0\" " with result "range_response_count:1 size:133" took too long (138.4128ms) to execute
2021-09-15 21:03:28.190213 W | etcdserver: read-only range request "key:\"/registry/services/specs\" range_end:\"/registry/services/spect\" count_only:true " with result "range_response_count:0 size:7" took too long (183.9059ms) to execute
2021-09-15 21:03:42.525164 W | etcdserver: request "header:<ID:9722563420904418777 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" mod_revision:637 > success:<request_put:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" value_size:678 >> failure:<request_range:<key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" > >>" with result "size:16" took too long (113.1488ms) to execute
2021-09-15 21:03:48.011084 W | etcdserver: read-only range request "key:\"/registry/roles\" range_end:\"/registry/rolet\" count_only:true " with result "range_response_count:0 size:7" took too long (190.3614ms) to execute
2021-09-15 21:03:59.164807 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" " with result "range_response_count:1 size:766" took too long (135.7852ms) to execute
2021-09-15 21:04:01.988721 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" " with result "range_response_count:1 size:766" took too long (268.7992ms) to execute
2021-09-15 21:04:01.996409 W | etcdserver: read-only range request "key:\"/registry/secrets\" range_end:\"/registry/secrett\" count_only:true " with result "range_response_count:0 size:7" took too long (312.8341ms) to execute
2021-09-15 21:04:24.066954 W | etcdserver: read-only range request "key:\"/registry/apiregistration.k8s.io/apiservices\" range_end:\"/registry/apiregistration.k8s.io/apiservicet\" count_only:true " with result "range_response_count:0 size:7" took too long (285.0402ms) to execute
2021-09-15 21:04:25.139587 W | etcdserver: read-only range request "key:\"/registry/namespaces/default\" " with result "range_response_count:1 size:172" took too long (175.5346ms) to execute
2021-09-15 21:04:25.756785 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/default/kubernetes\" " with result "range_response_count:1 size:215" took too long (129.7052ms) to execute
2021-09-15 21:04:28.674437 W | etcdserver: read-only range request "key:\"/registry/ingress\" range_end:\"/registry/ingrest\" count_only:true " with result "range_response_count:0 size:5" took too long (328.7151ms) to execute
2021-09-15 21:04:28.727438 W | etcdserver: read-only range request "key:\"foo\" " with result "range_response_count:0 size:5" took too long (414.8575ms) to execute
*
* ==> kernel <==
* 21:04:43 up 2:39, 0 users, load average: 66.17, 57.87, 43.81
Linux old-k8s-version-20210915203352-22848 4.19.121-linuxkit #1 SMP Thu Jan 21 15:36:34 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
PRETTY_NAME="Ubuntu 20.04.2 LTS"
*
* ==> kube-apiserver [3537b9c6e4ed] <==
* I0915 21:04:32.529719 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000001
I0915 21:04:33.221563 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000002
I0915 21:04:33.540687 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000001
I0915 21:04:34.242858 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000002
I0915 21:04:34.245288 1 trace.go:81] Trace[573432358]: "List /apis/batch/v1beta1/cronjobs" (started: 2021-09-15 21:04:33.740872 +0000 UTC m=+347.681523601) (total time: 504.2192ms):
Trace[573432358]: [485.5604ms] [485.4784ms] Listing from storage done
I0915 21:04:34.556024 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000001
I0915 21:04:35.266693 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000002
I0915 21:04:35.571910 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000001
I0915 21:04:36.267425 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000002
I0915 21:04:36.579603 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000001
I0915 21:04:37.276275 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000002
I0915 21:04:37.580318 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000001
I0915 21:04:38.277698 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000002
I0915 21:04:38.588742 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000001
I0915 21:04:39.282418 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000002
I0915 21:04:39.592744 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000001
I0915 21:04:40.284089 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000002
I0915 21:04:40.605114 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000001
I0915 21:04:41.298811 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000002
I0915 21:04:41.606469 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000001
I0915 21:04:42.299410 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000002
I0915 21:04:42.608548 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000001
I0915 21:04:43.300993 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000002
I0915 21:04:43.609793 1 controller.go:102] OpenAPI AggregationController: Processing item k8s_internal_local_delegation_chain_0000000001
*
* ==> kube-controller-manager [2444d44bba6b] <==
* I0915 20:58:49.637692 1 serving.go:319] Generated self-signed cert in-memory
I0915 20:58:56.555015 1 controllermanager.go:155] Version: v1.14.0
I0915 20:58:56.576218 1 secure_serving.go:116] Serving securely on 127.0.0.1:10257
I0915 20:58:56.583465 1 deprecated_insecure_serving.go:51] Serving insecurely on [::]:10252
F0915 20:59:23.652734 1 controllermanager.go:213] error building controller context: failed to wait for apiserver being healthy: timed out waiting for the condition: failed to get apiserver /healthz status: forbidden: User "system:kube-controller-manager" cannot get path "/healthz"
*
* ==> kube-controller-manager [5dcc93538d3a] <==
* I0915 21:01:26.996575 1 event.go:209] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-5b494cc544", UID:"164f2dcd-1668-11ec-9ee7-0242535a2e8f", APIVersion:"apps/v1", ResourceVersion:"470", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "dashboard-metrics-scraper-5b494cc544-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
I0915 21:01:26.996648 1 event.go:209] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-5d8978d65d", UID:"16c36f33-1668-11ec-9ee7-0242535a2e8f", APIVersion:"apps/v1", ResourceVersion:"479", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-5d8978d65d-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
E0915 21:01:27.048553 1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-5d8978d65d" failed with pods "kubernetes-dashboard-5d8978d65d-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
E0915 21:01:27.050128 1 replica_set.go:450] Sync "kubernetes-dashboard/dashboard-metrics-scraper-5b494cc544" failed with pods "dashboard-metrics-scraper-5b494cc544-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
I0915 21:01:27.050317 1 event.go:209] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-5d8978d65d", UID:"16c36f33-1668-11ec-9ee7-0242535a2e8f", APIVersion:"apps/v1", ResourceVersion:"479", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-5d8978d65d-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
I0915 21:01:27.050430 1 event.go:209] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-5b494cc544", UID:"164f2dcd-1668-11ec-9ee7-0242535a2e8f", APIVersion:"apps/v1", ResourceVersion:"470", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "dashboard-metrics-scraper-5b494cc544-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
E0915 21:01:27.217749 1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-5d8978d65d" failed with pods "kubernetes-dashboard-5d8978d65d-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
I0915 21:01:27.219854 1 event.go:209] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-5d8978d65d", UID:"16c36f33-1668-11ec-9ee7-0242535a2e8f", APIVersion:"apps/v1", ResourceVersion:"479", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-5d8978d65d-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
E0915 21:01:27.239153 1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-5d8978d65d" failed with pods "kubernetes-dashboard-5d8978d65d-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
I0915 21:01:27.240583 1 event.go:209] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-5d8978d65d", UID:"16c36f33-1668-11ec-9ee7-0242535a2e8f", APIVersion:"apps/v1", ResourceVersion:"479", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-5d8978d65d-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found
I0915 21:01:28.462615 1 event.go:209] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-5b494cc544", UID:"164f2dcd-1668-11ec-9ee7-0242535a2e8f", APIVersion:"apps/v1", ResourceVersion:"470", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: dashboard-metrics-scraper-5b494cc544-2mvzw
I0915 21:01:28.795730 1 event.go:209] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-5d8978d65d", UID:"16c36f33-1668-11ec-9ee7-0242535a2e8f", APIVersion:"apps/v1", ResourceVersion:"479", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kubernetes-dashboard-5d8978d65d-8p7lf
E0915 21:01:40.878042 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0915 21:01:43.498596 1 garbagecollector.go:644] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0915 21:02:11.209520 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0915 21:02:15.556647 1 garbagecollector.go:644] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0915 21:02:41.553423 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0915 21:02:47.575119 1 garbagecollector.go:644] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0915 21:03:11.826104 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0915 21:03:19.632005 1 garbagecollector.go:644] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0915 21:03:42.194332 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0915 21:03:51.645105 1 garbagecollector.go:644] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0915 21:04:12.484519 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
W0915 21:04:23.663773 1 garbagecollector.go:644] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
E0915 21:04:42.770830 1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
*
* ==> kube-proxy [b6a7846cc5e6] <==
* W0915 21:00:54.501001 1 server_others.go:295] Flag proxy-mode="" unknown, assuming iptables proxy
I0915 21:00:55.030056 1 server_others.go:148] Using iptables Proxier.
I0915 21:00:55.032253 1 server_others.go:178] Tearing down inactive rules.
E0915 21:00:58.200967 1 proxier.go:583] Error removing iptables rules in ipvs proxier: error deleting chain "KUBE-MARK-MASQ": exit status 1: iptables: Too many links.
I0915 21:00:59.844320 1 server.go:555] Version: v1.14.0
I0915 21:01:01.530012 1 config.go:202] Starting service config controller
I0915 21:01:01.537130 1 controller_utils.go:1027] Waiting for caches to sync for service config controller
I0915 21:01:01.538438 1 config.go:102] Starting endpoints config controller
I0915 21:01:01.538491 1 controller_utils.go:1027] Waiting for caches to sync for endpoints config controller
I0915 21:01:01.756092 1 controller_utils.go:1034] Caches are synced for endpoints config controller
I0915 21:01:01.854379 1 controller_utils.go:1034] Caches are synced for service config controller
*
* ==> kube-scheduler [f62b255531be] <==
* E0915 20:59:27.551711 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0915 20:59:27.592419 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0915 20:59:27.867730 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0915 20:59:28.087350 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0915 20:59:28.095370 1 reflector.go:126] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:223: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0915 20:59:28.156173 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0915 20:59:28.422172 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0915 20:59:28.420014 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0915 20:59:28.488109 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0915 20:59:28.621372 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0915 20:59:28.623520 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0915 20:59:28.623620 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0915 20:59:28.879737 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0915 20:59:29.099230 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0915 20:59:29.119527 1 reflector.go:126] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:223: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0915 20:59:29.181759 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0915 20:59:29.446114 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0915 20:59:29.530597 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0915 20:59:29.530769 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0915 20:59:29.654570 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0915 20:59:29.670562 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0915 20:59:29.670706 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0915 20:59:29.882997 1 reflector.go:126] k8s.io/client-go/informers/factory.go:133: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
I0915 20:59:31.619088 1 controller_utils.go:1027] Waiting for caches to sync for scheduler controller
I0915 20:59:31.727653 1 controller_utils.go:1034] Caches are synced for scheduler controller
*
* ==> kubelet <==
* -- Logs begin at Wed 2021-09-15 20:50:33 UTC, end at Wed 2021-09-15 21:04:48 UTC. --
Sep 15 21:00:50 old-k8s-version-20210915203352-22848 kubelet[6242]: W0915 21:00:50.611399 6242 pod_container_deletor.go:75] Container "79e7a6ac35951f5944ad0ffe265aaa418f2d0542cf7da68ba780d4ca8c9e6aa8" not found in pod's containers
Sep 15 21:00:54 old-k8s-version-20210915203352-22848 kubelet[6242]: W0915 21:00:54.983430 6242 pod_container_deletor.go:75] Container "7fd4d7ebc1ffb9db3c02502f8a7cdba0a5716997c7761fb7e9f3a68a31fdfbf3" not found in pod's containers
Sep 15 21:01:20 old-k8s-version-20210915203352-22848 kubelet[6242]: I0915 21:01:20.235661 6242 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "tmp" (UniqueName: "kubernetes.io/host-path/13467966-1668-11ec-9ee7-0242535a2e8f-tmp") pod "storage-provisioner" (UID: "13467966-1668-11ec-9ee7-0242535a2e8f")
Sep 15 21:01:20 old-k8s-version-20210915203352-22848 kubelet[6242]: I0915 21:01:20.235761 6242 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "storage-provisioner-token-62qjl" (UniqueName: "kubernetes.io/secret/13467966-1668-11ec-9ee7-0242535a2e8f-storage-provisioner-token-62qjl") pod "storage-provisioner" (UID: "13467966-1668-11ec-9ee7-0242535a2e8f")
Sep 15 21:01:23 old-k8s-version-20210915203352-22848 kubelet[6242]: I0915 21:01:23.433794 6242 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "tmp-dir" (UniqueName: "kubernetes.io/empty-dir/13c53a65-1668-11ec-9ee7-0242535a2e8f-tmp-dir") pod "metrics-server-8546d8b77b-pwkmq" (UID: "13c53a65-1668-11ec-9ee7-0242535a2e8f")
Sep 15 21:01:23 old-k8s-version-20210915203352-22848 kubelet[6242]: I0915 21:01:23.471968 6242 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "metrics-server-token-pwdl7" (UniqueName: "kubernetes.io/secret/13c53a65-1668-11ec-9ee7-0242535a2e8f-metrics-server-token-pwdl7") pod "metrics-server-8546d8b77b-pwkmq" (UID: "13c53a65-1668-11ec-9ee7-0242535a2e8f")
Sep 15 21:01:29 old-k8s-version-20210915203352-22848 kubelet[6242]: I0915 21:01:29.609073 6242 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "tmp-volume" (UniqueName: "kubernetes.io/empty-dir/18789695-1668-11ec-9ee7-0242535a2e8f-tmp-volume") pod "kubernetes-dashboard-5d8978d65d-8p7lf" (UID: "18789695-1668-11ec-9ee7-0242535a2e8f")
Sep 15 21:01:29 old-k8s-version-20210915203352-22848 kubelet[6242]: I0915 21:01:29.633018 6242 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubernetes-dashboard-token-89vzx" (UniqueName: "kubernetes.io/secret/1868c3ae-1668-11ec-9ee7-0242535a2e8f-kubernetes-dashboard-token-89vzx") pod "dashboard-metrics-scraper-5b494cc544-2mvzw" (UID: "1868c3ae-1668-11ec-9ee7-0242535a2e8f")
Sep 15 21:01:29 old-k8s-version-20210915203352-22848 kubelet[6242]: I0915 21:01:29.675966 6242 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "tmp-volume" (UniqueName: "kubernetes.io/empty-dir/1868c3ae-1668-11ec-9ee7-0242535a2e8f-tmp-volume") pod "dashboard-metrics-scraper-5b494cc544-2mvzw" (UID: "1868c3ae-1668-11ec-9ee7-0242535a2e8f")
Sep 15 21:01:29 old-k8s-version-20210915203352-22848 kubelet[6242]: I0915 21:01:29.676853 6242 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubernetes-dashboard-token-89vzx" (UniqueName: "kubernetes.io/secret/18789695-1668-11ec-9ee7-0242535a2e8f-kubernetes-dashboard-token-89vzx") pod "kubernetes-dashboard-5d8978d65d-8p7lf" (UID: "18789695-1668-11ec-9ee7-0242535a2e8f")
Sep 15 21:01:30 old-k8s-version-20210915203352-22848 kubelet[6242]: W0915 21:01:30.361117 6242 raw.go:87] Error while processing event ("/sys/fs/cgroup/memory/system.slice/run-r343d9355ba284f2fb0c7a84ecbfb4f67.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/memory/system.slice/run-r343d9355ba284f2fb0c7a84ecbfb4f67.scope: no such file or directory
Sep 15 21:01:30 old-k8s-version-20210915203352-22848 kubelet[6242]: W0915 21:01:30.382445 6242 raw.go:87] Error while processing event ("/sys/fs/cgroup/devices/system.slice/run-r343d9355ba284f2fb0c7a84ecbfb4f67.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/devices/system.slice/run-r343d9355ba284f2fb0c7a84ecbfb4f67.scope: no such file or directory
Sep 15 21:01:30 old-k8s-version-20210915203352-22848 kubelet[6242]: W0915 21:01:30.580124 6242 raw.go:87] Error while processing event ("/sys/fs/cgroup/cpu/system.slice/run-r7fc63d8f9e7d426093ebd88b5364076f.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/cpu/system.slice/run-r7fc63d8f9e7d426093ebd88b5364076f.scope: no such file or directory
Sep 15 21:01:30 old-k8s-version-20210915203352-22848 kubelet[6242]: W0915 21:01:30.690159 6242 raw.go:87] Error while processing event ("/sys/fs/cgroup/blkio/system.slice/run-r7fc63d8f9e7d426093ebd88b5364076f.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/blkio/system.slice/run-r7fc63d8f9e7d426093ebd88b5364076f.scope: no such file or directory
Sep 15 21:01:30 old-k8s-version-20210915203352-22848 kubelet[6242]: W0915 21:01:30.832450 6242 raw.go:87] Error while processing event ("/sys/fs/cgroup/memory/system.slice/run-r7fc63d8f9e7d426093ebd88b5364076f.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/memory/system.slice/run-r7fc63d8f9e7d426093ebd88b5364076f.scope: no such file or directory
Sep 15 21:01:31 old-k8s-version-20210915203352-22848 kubelet[6242]: W0915 21:01:30.995514 6242 raw.go:87] Error while processing event ("/sys/fs/cgroup/devices/system.slice/run-r7fc63d8f9e7d426093ebd88b5364076f.scope": 0x40000100 == IN_CREATE|IN_ISDIR): inotify_add_watch /sys/fs/cgroup/devices/system.slice/run-r7fc63d8f9e7d426093ebd88b5364076f.scope: no such file or directory
Sep 15 21:01:31 old-k8s-version-20210915203352-22848 kubelet[6242]: W0915 21:01:31.813566 6242 pod_container_deletor.go:75] Container "ffccf2c6a501f9281b076ddce286ed28d2cd1649040535a09521bacf16ea662a" not found in pod's containers
Sep 15 21:01:39 old-k8s-version-20210915203352-22848 kubelet[6242]: W0915 21:01:39.025673 6242 pod_container_deletor.go:75] Container "64d34c2031150e385339f8f5e9028123682b0224177c194d682c0ff61f66c64e" not found in pod's containers
Sep 15 21:01:39 old-k8s-version-20210915203352-22848 kubelet[6242]: W0915 21:01:39.314758 6242 container.go:409] Failed to create summary reader for "/system.slice/run-r343d9355ba284f2fb0c7a84ecbfb4f67.scope": none of the resources are being tracked.
Sep 15 21:01:39 old-k8s-version-20210915203352-22848 kubelet[6242]: E0915 21:01:39.771555 6242 remote_image.go:113] PullImage "fake.domain/k8s.gcr.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host
Sep 15 21:01:39 old-k8s-version-20210915203352-22848 kubelet[6242]: E0915 21:01:39.815630 6242 kuberuntime_image.go:51] Pull image "fake.domain/k8s.gcr.io/echoserver:1.4" failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host
Sep 15 21:01:39 old-k8s-version-20210915203352-22848 kubelet[6242]: E0915 21:01:39.815888 6242 kuberuntime_manager.go:780] container start failed: ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host
Sep 15 21:01:39 old-k8s-version-20210915203352-22848 kubelet[6242]: E0915 21:01:39.816057 6242 pod_workers.go:190] Error syncing pod 13c53a65-1668-11ec-9ee7-0242535a2e8f ("metrics-server-8546d8b77b-pwkmq_kube-system(13c53a65-1668-11ec-9ee7-0242535a2e8f)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"
Sep 15 21:01:46 old-k8s-version-20210915203352-22848 kubelet[6242]: W0915 21:01:46.144802 6242 pod_container_deletor.go:75] Container "58a86504bd857ab953eff1cf4fad276027cc52ec88e3187c494390015e6482e8" not found in pod's containers
Sep 15 21:01:52 old-k8s-version-20210915203352-22848 kubelet[6242]: W0915 21:01:52.828676 6242 pod_container_deletor.go:75] Container "a0de183f3af6f31e5711b9ea96d18e60af999f3cb5cdc6b6855615c20ddae4e1" not found in pod's containers
*
* ==> kubernetes-dashboard [cf62060e4365] <==
* 2021/09/15 21:02:08 Starting overwatch
2021/09/15 21:02:08 Using namespace: kubernetes-dashboard
2021/09/15 21:02:08 Using in-cluster config to connect to apiserver
2021/09/15 21:02:08 Using secret token for csrf signing
2021/09/15 21:02:08 Initializing csrf token from kubernetes-dashboard-csrf secret
2021/09/15 21:02:08 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
2021/09/15 21:02:08 Successful initial request to the apiserver, version: v1.14.0
2021/09/15 21:02:08 Generating JWE encryption key
2021/09/15 21:02:08 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
2021/09/15 21:02:08 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
2021/09/15 21:02:14 Initializing JWE encryption key from synchronized object
2021/09/15 21:02:14 Creating in-cluster Sidecar client
2021/09/15 21:02:15 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2021/09/15 21:02:15 Serving insecurely on HTTP port: 9090
2021/09/15 21:02:45 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2021/09/15 21:03:15 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2021/09/15 21:03:45 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2021/09/15 21:04:16 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
2021/09/15 21:04:46 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.
*
* ==> storage-provisioner [2708aca9f909] <==
* I0915 21:01:40.753119 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0915 21:01:41.321793 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0915 21:01:41.321949 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0915 21:01:41.635473 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0915 21:01:41.635782 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-20210915203352-22848_b70da16a-b32b-48c4-89a2-6508f6543fc9!
I0915 21:01:41.747743 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"10021bd7-1668-11ec-9ee7-0242535a2e8f", APIVersion:"v1", ResourceVersion:"537", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-20210915203352-22848_b70da16a-b32b-48c4-89a2-6508f6543fc9 became leader
I0915 21:01:42.246000 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-20210915203352-22848_b70da16a-b32b-48c4-89a2-6508f6543fc9!
-- /stdout --
** stderr **
! Executing "docker container inspect old-k8s-version-20210915203352-22848 --format={{.State.Status}}" took an unusually long time: 2.7778674s
* Restarting the docker service may improve performance.
** /stderr **
helpers_test.go:255: (dbg) Run: out/minikube-windows-amd64.exe status --format={{.APIServer}} -p old-k8s-version-20210915203352-22848 -n old-k8s-version-20210915203352-22848
=== CONT TestStartStop/group/old-k8s-version/serial/SecondStart
helpers_test.go:255: (dbg) Done: out/minikube-windows-amd64.exe status --format={{.APIServer}} -p old-k8s-version-20210915203352-22848 -n old-k8s-version-20210915203352-22848: (8.8482586s)
helpers_test.go:262: (dbg) Run: kubectl --context old-k8s-version-20210915203352-22848 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
=== CONT TestStartStop/group/old-k8s-version/serial/SecondStart
helpers_test.go:271: non-running pods: metrics-server-8546d8b77b-pwkmq dashboard-metrics-scraper-5b494cc544-2mvzw
helpers_test.go:273: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/SecondStart]: describe non-running pods <======
helpers_test.go:276: (dbg) Run: kubectl --context old-k8s-version-20210915203352-22848 describe pod metrics-server-8546d8b77b-pwkmq dashboard-metrics-scraper-5b494cc544-2mvzw
helpers_test.go:276: (dbg) Non-zero exit: kubectl --context old-k8s-version-20210915203352-22848 describe pod metrics-server-8546d8b77b-pwkmq dashboard-metrics-scraper-5b494cc544-2mvzw: exit status 1 (433.6146ms)
** stderr **
Error from server (NotFound): pods "metrics-server-8546d8b77b-pwkmq" not found
Error from server (NotFound): pods "dashboard-metrics-scraper-5b494cc544-2mvzw" not found
** /stderr **
helpers_test.go:278: kubectl --context old-k8s-version-20210915203352-22848 describe pod metrics-server-8546d8b77b-pwkmq dashboard-metrics-scraper-5b494cc544-2mvzw: exit status 1
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (882.53s)