=== RUN TestAddons/serial/Volcano
addons_test.go:807: volcano-scheduler stabilized in 8.645287ms
addons_test.go:823: volcano-controller stabilized in 8.709508ms
addons_test.go:815: volcano-admission stabilized in 8.740443ms
addons_test.go:829: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-6c9778cbdf-48p4z" [e9c3d04e-8237-42f7-8a07-245157f72d6e] Pending / Ready:ContainersNotReady (containers with unready status: [volcano-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [volcano-scheduler])
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "volcano-system" "app=volcano-scheduler" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:829: ***** TestAddons/serial/Volcano: pod "app=volcano-scheduler" failed to start within 6m0s: context deadline exceeded ****
addons_test.go:829: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p minikube -n minikube
addons_test.go:829: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-12-11 23:23:57.446367274 +0000 UTC m=+794.410941368
addons_test.go:829: (dbg) Run: kubectl --context minikube describe po volcano-scheduler-6c9778cbdf-48p4z -n volcano-system
addons_test.go:829: (dbg) kubectl --context minikube describe po volcano-scheduler-6c9778cbdf-48p4z -n volcano-system:
Name: volcano-scheduler-6c9778cbdf-48p4z
Namespace: volcano-system
Priority: 2000000000
Priority Class Name: system-cluster-critical
Service Account: volcano-scheduler
Node: ubuntu-20-agent-15/10.128.15.240
Start Time: Wed, 11 Dec 2024 23:11:52 +0000
Labels: app=volcano-scheduler
pod-template-hash=6c9778cbdf
Annotations: <none>
Status: Pending
IP: 10.244.0.17
IPs:
IP: 10.244.0.17
Controlled By: ReplicaSet/volcano-scheduler-6c9778cbdf
Containers:
volcano-scheduler:
Container ID:
Image: docker.io/volcanosh/vc-scheduler:v1.10.0@sha256:b618879e2ff768f69fb94084f0c644d2278d31e4fa17c898b8763fc7e1648882
Image ID:
Port: <none>
Host Port: <none>
Args:
--logtostderr
--scheduler-conf=/volcano.scheduler/volcano-scheduler.conf
--enable-healthz=true
--enable-metrics=true
--leader-elect=false
-v=3
2>&1
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment:
DEBUG_SOCKET_DIR: /tmp/klog-socks
Mounts:
/tmp/klog-socks from klog-sock (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-k5bx8 (ro)
/volcano.scheduler from scheduler-config (rw)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
scheduler-config:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: volcano-scheduler-configmap
Optional: false
klog-sock:
Type: HostPath (bare host directory volume)
Path: /tmp/klog-socks
HostPathType:
kube-api-access-k5bx8:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 12m default-scheduler Successfully assigned volcano-system/volcano-scheduler-6c9778cbdf-48p4z to ubuntu-20-agent-15
Normal Pulling 10m (x4 over 12m) kubelet Pulling image "docker.io/volcanosh/vc-scheduler:v1.10.0@sha256:b618879e2ff768f69fb94084f0c644d2278d31e4fa17c898b8763fc7e1648882"
Warning Failed 10m (x4 over 11m) kubelet Failed to pull image "docker.io/volcanosh/vc-scheduler:v1.10.0@sha256:b618879e2ff768f69fb94084f0c644d2278d31e4fa17c898b8763fc7e1648882": Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit
Warning Failed 10m (x4 over 11m) kubelet Error: ErrImagePull
Warning Failed 10m (x6 over 11m) kubelet Error: ImagePullBackOff
Normal BackOff 114s (x42 over 11m) kubelet Back-off pulling image "docker.io/volcanosh/vc-scheduler:v1.10.0@sha256:b618879e2ff768f69fb94084f0c644d2278d31e4fa17c898b8763fc7e1648882"
addons_test.go:829: (dbg) Run: kubectl --context minikube logs volcano-scheduler-6c9778cbdf-48p4z -n volcano-system
addons_test.go:829: (dbg) Non-zero exit: kubectl --context minikube logs volcano-scheduler-6c9778cbdf-48p4z -n volcano-system: exit status 1 (76.19346ms)
** stderr **
Error from server (BadRequest): container "volcano-scheduler" in pod "volcano-scheduler-6c9778cbdf-48p4z" is waiting to start: trying and failing to pull image
** /stderr **
addons_test.go:829: kubectl --context minikube logs volcano-scheduler-6c9778cbdf-48p4z -n volcano-system: exit status 1
addons_test.go:830: failed waiting for app=volcano-scheduler pod: app=volcano-scheduler within 6m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p minikube -n minikube
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p minikube logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p minikube logs -n 25: (1.202677416s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------|----------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------|----------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | minikube | jenkins | v1.34.0 | 11 Dec 24 23:10 UTC | |
| | -p minikube --force | | | | | |
| | --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=docker | | | | | |
| | --driver=none | | | | | |
| | --bootstrapper=kubeadm | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 11 Dec 24 23:10 UTC | 11 Dec 24 23:10 UTC |
| delete | -p minikube | minikube | jenkins | v1.34.0 | 11 Dec 24 23:10 UTC | 11 Dec 24 23:10 UTC |
| start | -o=json --download-only | minikube | jenkins | v1.34.0 | 11 Dec 24 23:10 UTC | |
| | -p minikube --force | | | | | |
| | --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.2 | | | | | |
| | --container-runtime=docker | | | | | |
| | --driver=none | | | | | |
| | --bootstrapper=kubeadm | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 11 Dec 24 23:10 UTC | 11 Dec 24 23:10 UTC |
| delete | -p minikube | minikube | jenkins | v1.34.0 | 11 Dec 24 23:10 UTC | 11 Dec 24 23:10 UTC |
| delete | -p minikube | minikube | jenkins | v1.34.0 | 11 Dec 24 23:10 UTC | 11 Dec 24 23:10 UTC |
| delete | -p minikube | minikube | jenkins | v1.34.0 | 11 Dec 24 23:10 UTC | 11 Dec 24 23:10 UTC |
| start | --download-only -p | minikube | jenkins | v1.34.0 | 11 Dec 24 23:10 UTC | |
| | minikube --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:37265 | | | | | |
| | --driver=none | | | | | |
| | --bootstrapper=kubeadm | | | | | |
| delete | -p minikube | minikube | jenkins | v1.34.0 | 11 Dec 24 23:10 UTC | 11 Dec 24 23:10 UTC |
| start | -p minikube --alsologtostderr | minikube | jenkins | v1.34.0 | 11 Dec 24 23:10 UTC | 11 Dec 24 23:11 UTC |
| | -v=1 --memory=2048 | | | | | |
| | --wait=true --driver=none | | | | | |
| | --bootstrapper=kubeadm | | | | | |
| delete | -p minikube | minikube | jenkins | v1.34.0 | 11 Dec 24 23:11 UTC | 11 Dec 24 23:11 UTC |
| addons | enable dashboard -p minikube | minikube | jenkins | v1.34.0 | 11 Dec 24 23:11 UTC | |
| addons | disable dashboard -p minikube | minikube | jenkins | v1.34.0 | 11 Dec 24 23:11 UTC | |
| start | -p minikube --wait=true | minikube | jenkins | v1.34.0 | 11 Dec 24 23:11 UTC | 11 Dec 24 23:17 UTC |
| | --memory=4000 | | | | | |
| | --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --addons=amd-gpu-device-plugin | | | | | |
| | --driver=none | | | | | |
| | --bootstrapper=kubeadm | | | | | |
|---------|--------------------------------|----------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/12/11 23:11:30
Running on machine: ubuntu-20-agent-15
Binary: Built with gc go1.23.3 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1211 23:11:30.090400 501593 out.go:345] Setting OutFile to fd 1 ...
I1211 23:11:30.090527 501593 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1211 23:11:30.090537 501593 out.go:358] Setting ErrFile to fd 2...
I1211 23:11:30.090543 501593 out.go:392] TERM=,COLORTERM=, which probably does not support color
I1211 23:11:30.090734 501593 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20083-490991/.minikube/bin
I1211 23:11:30.091368 501593 out.go:352] Setting JSON to false
I1211 23:11:30.092364 501593 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-15","uptime":6837,"bootTime":1733951853,"procs":176,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1071-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I1211 23:11:30.092483 501593 start.go:139] virtualization: kvm guest
I1211 23:11:30.094800 501593 out.go:177] * minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
W1211 23:11:30.096328 501593 preload.go:293] Failed to list preload files: open /home/jenkins/minikube-integration/20083-490991/.minikube/cache/preloaded-tarball: no such file or directory
I1211 23:11:30.096374 501593 notify.go:220] Checking for updates...
I1211 23:11:30.096385 501593 out.go:177] - MINIKUBE_LOCATION=20083
I1211 23:11:30.098211 501593 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1211 23:11:30.099519 501593 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/20083-490991/kubeconfig
I1211 23:11:30.100752 501593 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/20083-490991/.minikube
I1211 23:11:30.102106 501593 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I1211 23:11:30.103593 501593 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I1211 23:11:30.105137 501593 driver.go:394] Setting default libvirt URI to qemu:///system
I1211 23:11:30.116124 501593 out.go:177] * Using the none driver based on user configuration
I1211 23:11:30.117520 501593 start.go:297] selected driver: none
I1211 23:11:30.117539 501593 start.go:901] validating driver "none" against <nil>
I1211 23:11:30.117551 501593 start.go:912] status for none: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1211 23:11:30.117597 501593 start.go:1730] auto setting extra-config to "kubelet.resolv-conf=/run/systemd/resolve/resolv.conf".
W1211 23:11:30.117883 501593 out.go:270] ! The 'none' driver does not respect the --memory flag
I1211 23:11:30.118459 501593 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I1211 23:11:30.118749 501593 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1211 23:11:30.118785 501593 cni.go:84] Creating CNI manager for ""
I1211 23:11:30.118841 501593 cni.go:158] "none" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I1211 23:11:30.118854 501593 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I1211 23:11:30.118908 501593 start.go:340] cluster config:
{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:4000 CPUs:2 DiskSize:20000 Driver:none HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRIS
ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:resolv-conf Value:/run/systemd/resolve/resolv.conf}] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:
SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1211 23:11:30.120459 501593 out.go:177] * Starting "minikube" primary control-plane node in "minikube" cluster
I1211 23:11:30.122203 501593 profile.go:143] Saving config to /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/config.json ...
I1211 23:11:30.122240 501593 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/config.json: {Name:mk6aa5d2e5bbc9cba361e8b40cf6d1790998ab4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1211 23:11:30.122393 501593 start.go:360] acquireMachinesLock for minikube: {Name:mkb86dafd4d17330e5070cdfb1895def98bb075d Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1211 23:11:30.122424 501593 start.go:364] duration metric: took 17.285µs to acquireMachinesLock for "minikube"
I1211 23:11:30.122437 501593 start.go:93] Provisioning new machine with config: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:4000 CPUs:2 DiskSize:20000 Driver:none HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIS
erverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:resolv-conf Value:/run/systemd/resolve/resolv.conf}] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker Bin
aryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
I1211 23:11:30.122498 501593 start.go:125] createHost starting for "" (driver="none")
I1211 23:11:30.124063 501593 out.go:177] * Running on localhost (CPUs=8, Memory=32089MB, Disk=297540MB) ...
I1211 23:11:30.125413 501593 exec_runner.go:51] Run: systemctl --version
I1211 23:11:30.128198 501593 start.go:159] libmachine.API.Create for "minikube" (driver="none")
I1211 23:11:30.128245 501593 client.go:168] LocalClient.Create starting
I1211 23:11:30.128306 501593 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20083-490991/.minikube/certs/ca.pem
I1211 23:11:30.128344 501593 main.go:141] libmachine: Decoding PEM data...
I1211 23:11:30.128358 501593 main.go:141] libmachine: Parsing certificate...
I1211 23:11:30.128400 501593 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20083-490991/.minikube/certs/cert.pem
I1211 23:11:30.128422 501593 main.go:141] libmachine: Decoding PEM data...
I1211 23:11:30.128434 501593 main.go:141] libmachine: Parsing certificate...
I1211 23:11:30.128737 501593 client.go:171] duration metric: took 482.595µs to LocalClient.Create
I1211 23:11:30.128761 501593 start.go:167] duration metric: took 567.702µs to libmachine.API.Create "minikube"
I1211 23:11:30.128772 501593 start.go:293] postStartSetup for "minikube" (driver="none")
I1211 23:11:30.128808 501593 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1211 23:11:30.128846 501593 exec_runner.go:51] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1211 23:11:30.139751 501593 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I1211 23:11:30.139779 501593 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1211 23:11:30.139788 501593 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I1211 23:11:30.141979 501593 out.go:177] * OS release is Ubuntu 20.04.6 LTS
I1211 23:11:30.143406 501593 filesync.go:126] Scanning /home/jenkins/minikube-integration/20083-490991/.minikube/addons for local assets ...
I1211 23:11:30.143496 501593 filesync.go:126] Scanning /home/jenkins/minikube-integration/20083-490991/.minikube/files for local assets ...
I1211 23:11:30.143519 501593 start.go:296] duration metric: took 14.738557ms for postStartSetup
I1211 23:11:30.144243 501593 profile.go:143] Saving config to /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/config.json ...
I1211 23:11:30.144391 501593 start.go:128] duration metric: took 21.880899ms to createHost
I1211 23:11:30.144407 501593 start.go:83] releasing machines lock for "minikube", held for 21.974684ms
I1211 23:11:30.144830 501593 exec_runner.go:51] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I1211 23:11:30.144923 501593 exec_runner.go:51] Run: curl -sS -m 2 https://registry.k8s.io/
W1211 23:11:30.147006 501593 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1211 23:11:30.147063 501593 exec_runner.go:51] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1211 23:11:30.157239 501593 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1211 23:11:30.157279 501593 start.go:495] detecting cgroup driver to use...
I1211 23:11:30.157316 501593 detect.go:187] detected "cgroupfs" cgroup driver on host os
I1211 23:11:30.157431 501593 exec_runner.go:51] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I1211 23:11:30.178957 501593 exec_runner.go:51] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I1211 23:11:30.189083 501593 exec_runner.go:51] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I1211 23:11:30.201267 501593 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I1211 23:11:30.201332 501593 exec_runner.go:51] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I1211 23:11:30.212350 501593 exec_runner.go:51] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1211 23:11:30.223248 501593 exec_runner.go:51] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I1211 23:11:30.233394 501593 exec_runner.go:51] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I1211 23:11:30.243732 501593 exec_runner.go:51] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1211 23:11:30.253109 501593 exec_runner.go:51] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I1211 23:11:30.263801 501593 exec_runner.go:51] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I1211 23:11:30.274021 501593 exec_runner.go:51] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I1211 23:11:30.284203 501593 exec_runner.go:51] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1211 23:11:30.293020 501593 exec_runner.go:51] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1211 23:11:30.301659 501593 exec_runner.go:51] Run: sudo systemctl daemon-reload
I1211 23:11:30.521127 501593 exec_runner.go:51] Run: sudo systemctl restart containerd
I1211 23:11:30.586981 501593 start.go:495] detecting cgroup driver to use...
I1211 23:11:30.587038 501593 detect.go:187] detected "cgroupfs" cgroup driver on host os
I1211 23:11:30.587180 501593 exec_runner.go:51] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I1211 23:11:30.609151 501593 exec_runner.go:51] Run: which cri-dockerd
I1211 23:11:30.610313 501593 exec_runner.go:51] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I1211 23:11:30.619386 501593 exec_runner.go:144] found /etc/systemd/system/cri-docker.service.d/10-cni.conf, removing ...
I1211 23:11:30.619418 501593 exec_runner.go:203] rm: /etc/systemd/system/cri-docker.service.d/10-cni.conf
I1211 23:11:30.619463 501593 exec_runner.go:51] Run: sudo rm -f /etc/systemd/system/cri-docker.service.d/10-cni.conf
I1211 23:11:30.627519 501593 exec_runner.go:151] cp: memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)
I1211 23:11:30.627703 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube461293498 /etc/systemd/system/cri-docker.service.d/10-cni.conf
I1211 23:11:30.636961 501593 exec_runner.go:51] Run: sudo systemctl unmask docker.service
I1211 23:11:30.899106 501593 exec_runner.go:51] Run: sudo systemctl enable docker.socket
I1211 23:11:31.129246 501593 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I1211 23:11:31.129438 501593 exec_runner.go:144] found /etc/docker/daemon.json, removing ...
I1211 23:11:31.129460 501593 exec_runner.go:203] rm: /etc/docker/daemon.json
I1211 23:11:31.129569 501593 exec_runner.go:51] Run: sudo rm -f /etc/docker/daemon.json
I1211 23:11:31.139806 501593 exec_runner.go:151] cp: memory --> /etc/docker/daemon.json (130 bytes)
I1211 23:11:31.140679 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2720528334 /etc/docker/daemon.json
I1211 23:11:31.150210 501593 exec_runner.go:51] Run: sudo systemctl daemon-reload
I1211 23:11:31.362971 501593 exec_runner.go:51] Run: sudo systemctl restart docker
I1211 23:11:31.678151 501593 exec_runner.go:51] Run: sudo systemctl is-active --quiet service cri-docker.socket
I1211 23:11:31.689737 501593 exec_runner.go:51] Run: sudo systemctl stop cri-docker.socket
I1211 23:11:31.707809 501593 exec_runner.go:51] Run: sudo systemctl is-active --quiet service cri-docker.service
I1211 23:11:31.720369 501593 exec_runner.go:51] Run: sudo systemctl unmask cri-docker.socket
I1211 23:11:31.917013 501593 exec_runner.go:51] Run: sudo systemctl enable cri-docker.socket
I1211 23:11:32.122849 501593 exec_runner.go:51] Run: sudo systemctl daemon-reload
I1211 23:11:32.326626 501593 exec_runner.go:51] Run: sudo systemctl restart cri-docker.socket
I1211 23:11:32.342673 501593 exec_runner.go:51] Run: sudo systemctl is-active --quiet service cri-docker.service
I1211 23:11:32.354551 501593 exec_runner.go:51] Run: sudo systemctl daemon-reload
I1211 23:11:32.574959 501593 exec_runner.go:51] Run: sudo systemctl restart cri-docker.service
I1211 23:11:32.651414 501593 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
I1211 23:11:32.651540 501593 exec_runner.go:51] Run: stat /var/run/cri-dockerd.sock
I1211 23:11:32.653046 501593 start.go:563] Will wait 60s for crictl version
I1211 23:11:32.653113 501593 exec_runner.go:51] Run: which crictl
I1211 23:11:32.654111 501593 exec_runner.go:51] Run: sudo /usr/local/bin/crictl version
I1211 23:11:32.685963 501593 start.go:579] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 27.4.0
RuntimeApiVersion: v1
I1211 23:11:32.686041 501593 exec_runner.go:51] Run: docker version --format {{.Server.Version}}
I1211 23:11:32.708049 501593 exec_runner.go:51] Run: docker version --format {{.Server.Version}}
I1211 23:11:32.734953 501593 out.go:235] * Preparing Kubernetes v1.31.2 on Docker 27.4.0 ...
I1211 23:11:32.735089 501593 exec_runner.go:51] Run: grep 127.0.0.1 host.minikube.internal$ /etc/hosts
I1211 23:11:32.739076 501593 out.go:177] - kubelet.resolv-conf=/run/systemd/resolve/resolv.conf
I1211 23:11:32.740703 501593 kubeadm.go:883] updating cluster {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:4000 CPUs:2 DiskSize:20000 Driver:none HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APISe
rverIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:resolv-conf Value:/run/systemd/resolve/resolv.conf}] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.128.15.240 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMir
ror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1211 23:11:32.740857 501593 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime docker
I1211 23:11:32.740875 501593 kubeadm.go:934] updating node { 10.128.15.240 8443 v1.31.2 docker true true} ...
I1211 23:11:32.741000 501593 kubeadm.go:946] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ubuntu-20-agent-15 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=10.128.15.240 --resolv-conf=/run/systemd/resolve/resolv.conf
[Install]
config:
{KubernetesVersion:v1.31.2 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:resolv-conf Value:/run/systemd/resolve/resolv.conf}] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:}
I1211 23:11:32.741067 501593 exec_runner.go:51] Run: docker info --format {{.CgroupDriver}}
I1211 23:11:32.792979 501593 cni.go:84] Creating CNI manager for ""
I1211 23:11:32.793035 501593 cni.go:158] "none" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I1211 23:11:32.793047 501593 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I1211 23:11:32.793077 501593 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:10.128.15.240 APIServerPort:8443 KubernetesVersion:v1.31.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:minikube NodeName:ubuntu-20-agent-15 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "10.128.15.240"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:10.128.15.240 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/ku
bernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1211 23:11:32.793210 501593 kubeadm.go:195] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 10.128.15.240
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/cri-dockerd.sock
name: "ubuntu-20-agent-15"
kubeletExtraArgs:
- name: "node-ip"
value: "10.128.15.240"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "10.128.15.240"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
- name: "proxy-refresh-interval"
value: "70000"
kubernetesVersion: v1.31.2
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1211 23:11:32.793279 501593 exec_runner.go:51] Run: sudo ls /var/lib/minikube/binaries/v1.31.2
I1211 23:11:32.802091 501593 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.31.2: exit status 2
stdout:
stderr:
ls: cannot access '/var/lib/minikube/binaries/v1.31.2': No such file or directory
Initiating transfer...
I1211 23:11:32.802151 501593 exec_runner.go:51] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.31.2
I1211 23:11:32.811404 501593 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubectl.sha256
I1211 23:11:32.811453 501593 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubeadm.sha256
I1211 23:11:32.811463 501593 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20083-490991/.minikube/cache/linux/amd64/v1.31.2/kubectl --> /var/lib/minikube/binaries/v1.31.2/kubectl (56381592 bytes)
I1211 23:11:32.811490 501593 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubelet.sha256
I1211 23:11:32.811515 501593 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20083-490991/.minikube/cache/linux/amd64/v1.31.2/kubeadm --> /var/lib/minikube/binaries/v1.31.2/kubeadm (58290328 bytes)
I1211 23:11:32.811555 501593 exec_runner.go:51] Run: sudo systemctl is-active --quiet service kubelet
I1211 23:11:32.823274 501593 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20083-490991/.minikube/cache/linux/amd64/v1.31.2/kubelet --> /var/lib/minikube/binaries/v1.31.2/kubelet (76902744 bytes)
I1211 23:11:32.872615 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2322623693 /var/lib/minikube/binaries/v1.31.2/kubeadm
I1211 23:11:32.880329 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2808735405 /var/lib/minikube/binaries/v1.31.2/kubectl
I1211 23:11:32.913564 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube717911975 /var/lib/minikube/binaries/v1.31.2/kubelet
I1211 23:11:32.987298 501593 exec_runner.go:51] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1211 23:11:32.996646 501593 exec_runner.go:144] found /etc/systemd/system/kubelet.service.d/10-kubeadm.conf, removing ...
I1211 23:11:32.996673 501593 exec_runner.go:203] rm: /etc/systemd/system/kubelet.service.d/10-kubeadm.conf
I1211 23:11:32.996730 501593 exec_runner.go:51] Run: sudo rm -f /etc/systemd/system/kubelet.service.d/10-kubeadm.conf
I1211 23:11:33.005363 501593 exec_runner.go:151] cp: memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (365 bytes)
I1211 23:11:33.005555 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2120716792 /etc/systemd/system/kubelet.service.d/10-kubeadm.conf
I1211 23:11:33.014991 501593 exec_runner.go:144] found /lib/systemd/system/kubelet.service, removing ...
I1211 23:11:33.015020 501593 exec_runner.go:203] rm: /lib/systemd/system/kubelet.service
I1211 23:11:33.015059 501593 exec_runner.go:51] Run: sudo rm -f /lib/systemd/system/kubelet.service
I1211 23:11:33.023143 501593 exec_runner.go:151] cp: memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1211 23:11:33.023993 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1378251883 /lib/systemd/system/kubelet.service
I1211 23:11:33.033493 501593 exec_runner.go:151] cp: memory --> /var/tmp/minikube/kubeadm.yaml.new (2299 bytes)
I1211 23:11:33.034319 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube147677792 /var/tmp/minikube/kubeadm.yaml.new
I1211 23:11:33.043004 501593 exec_runner.go:51] Run: grep 10.128.15.240 control-plane.minikube.internal$ /etc/hosts
I1211 23:11:33.044436 501593 exec_runner.go:51] Run: sudo systemctl daemon-reload
I1211 23:11:33.269650 501593 exec_runner.go:51] Run: sudo systemctl start kubelet
I1211 23:11:33.285206 501593 certs.go:68] Setting up /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube for IP: 10.128.15.240
I1211 23:11:33.285235 501593 certs.go:194] generating shared ca certs ...
I1211 23:11:33.285254 501593 certs.go:226] acquiring lock for ca certs: {Name:mkb9e4fd4b750ad9303ef65c92a5b36bb1dcf97d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1211 23:11:33.285417 501593 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20083-490991/.minikube/ca.key
I1211 23:11:33.285467 501593 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20083-490991/.minikube/proxy-client-ca.key
I1211 23:11:33.285477 501593 certs.go:256] generating profile certs ...
I1211 23:11:33.285535 501593 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/client.key
I1211 23:11:33.285557 501593 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/client.crt with IP's: []
I1211 23:11:33.403906 501593 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/client.crt ...
I1211 23:11:33.403939 501593 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/client.crt: {Name:mk3ae17fface32ed92fbd5a1fb2d6259e5d0baa5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1211 23:11:33.404118 501593 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/client.key ...
I1211 23:11:33.404141 501593 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/client.key: {Name:mkfe0ce4312384e8093bfbca5c702e91fd3e7d88 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1211 23:11:33.404239 501593 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/apiserver.key.271ff23d
I1211 23:11:33.404268 501593 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/apiserver.crt.271ff23d with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 10.128.15.240]
I1211 23:11:33.643940 501593 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/apiserver.crt.271ff23d ...
I1211 23:11:33.643974 501593 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/apiserver.crt.271ff23d: {Name:mke6cd18e8dbf482d1c9a6ba087d0cabeeb8db7b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1211 23:11:33.644133 501593 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/apiserver.key.271ff23d ...
I1211 23:11:33.644155 501593 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/apiserver.key.271ff23d: {Name:mk3ff7e81fa4d528dffd7924b0429adcb0d41048 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1211 23:11:33.644271 501593 certs.go:381] copying /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/apiserver.crt.271ff23d -> /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/apiserver.crt
I1211 23:11:33.644397 501593 certs.go:385] copying /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/apiserver.key.271ff23d -> /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/apiserver.key
I1211 23:11:33.644476 501593 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/proxy-client.key
I1211 23:11:33.644501 501593 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/proxy-client.crt with IP's: []
I1211 23:11:33.860417 501593 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/proxy-client.crt ...
I1211 23:11:33.860455 501593 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/proxy-client.crt: {Name:mk3db15d52b0b0362b84068bafb39907f32bc24e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1211 23:11:33.860621 501593 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/proxy-client.key ...
I1211 23:11:33.860645 501593 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/proxy-client.key: {Name:mk867061d288712c784a085f71f11f4fd7b83dfb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1211 23:11:33.860877 501593 certs.go:484] found cert: /home/jenkins/minikube-integration/20083-490991/.minikube/certs/ca-key.pem (1675 bytes)
I1211 23:11:33.860934 501593 certs.go:484] found cert: /home/jenkins/minikube-integration/20083-490991/.minikube/certs/ca.pem (1078 bytes)
I1211 23:11:33.860970 501593 certs.go:484] found cert: /home/jenkins/minikube-integration/20083-490991/.minikube/certs/cert.pem (1123 bytes)
I1211 23:11:33.861009 501593 certs.go:484] found cert: /home/jenkins/minikube-integration/20083-490991/.minikube/certs/key.pem (1679 bytes)
I1211 23:11:33.861718 501593 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20083-490991/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1211 23:11:33.862659 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1410372174 /var/lib/minikube/certs/ca.crt
I1211 23:11:33.873924 501593 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20083-490991/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1211 23:11:33.874081 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube3206723446 /var/lib/minikube/certs/ca.key
I1211 23:11:33.883408 501593 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20083-490991/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1211 23:11:33.883586 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2769931008 /var/lib/minikube/certs/proxy-client-ca.crt
I1211 23:11:33.892184 501593 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20083-490991/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I1211 23:11:33.892418 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube3423060741 /var/lib/minikube/certs/proxy-client-ca.key
I1211 23:11:33.901070 501593 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1411 bytes)
I1211 23:11:33.901826 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube144255104 /var/lib/minikube/certs/apiserver.crt
I1211 23:11:33.911735 501593 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1211 23:11:33.911874 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1049814709 /var/lib/minikube/certs/apiserver.key
I1211 23:11:33.919788 501593 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1211 23:11:33.919954 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube4274411777 /var/lib/minikube/certs/proxy-client.crt
I1211 23:11:33.927878 501593 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20083-490991/.minikube/profiles/minikube/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1211 23:11:33.928046 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1136328513 /var/lib/minikube/certs/proxy-client.key
I1211 23:11:33.936088 501593 exec_runner.go:144] found /usr/share/ca-certificates/minikubeCA.pem, removing ...
I1211 23:11:33.936115 501593 exec_runner.go:203] rm: /usr/share/ca-certificates/minikubeCA.pem
I1211 23:11:33.936172 501593 exec_runner.go:51] Run: sudo rm -f /usr/share/ca-certificates/minikubeCA.pem
I1211 23:11:33.944275 501593 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20083-490991/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1211 23:11:33.944471 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube3848212343 /usr/share/ca-certificates/minikubeCA.pem
I1211 23:11:33.954114 501593 exec_runner.go:151] cp: memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1211 23:11:33.954248 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1474595233 /var/lib/minikube/kubeconfig
I1211 23:11:33.963204 501593 exec_runner.go:51] Run: openssl version
I1211 23:11:33.966350 501593 exec_runner.go:51] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1211 23:11:33.976567 501593 exec_runner.go:51] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1211 23:11:33.978076 501593 certs.go:528] hashing: -rw-r--r-- 1 jenkins jenkins 1111 Dec 11 23:11 /usr/share/ca-certificates/minikubeCA.pem
I1211 23:11:33.978137 501593 exec_runner.go:51] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1211 23:11:33.981132 501593 exec_runner.go:51] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1211 23:11:33.990763 501593 exec_runner.go:51] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1211 23:11:33.991974 501593 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: exit status 1
stdout:
stderr:
stat: cannot stat '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I1211 23:11:33.992061 501593 kubeadm.go:392] StartCluster: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1733912881-20083@sha256:64d8b27f78fd269d886e21ba8fc88be20de183ba5cc5bce33d0810e8a65f1df2 Memory:4000 CPUs:2 DiskSize:20000 Driver:none HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServe
rIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:resolv-conf Value:/run/systemd/resolve/resolv.conf}] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:10.128.15.240 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror
: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1211 23:11:33.992210 501593 exec_runner.go:51] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I1211 23:11:34.009212 501593 exec_runner.go:51] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1211 23:11:34.017832 501593 exec_runner.go:51] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1211 23:11:34.026267 501593 exec_runner.go:51] Run: docker version --format {{.Server.Version}}
I1211 23:11:34.049486 501593 exec_runner.go:51] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1211 23:11:34.058182 501593 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: exit status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1211 23:11:34.058206 501593 kubeadm.go:157] found existing configuration files:
I1211 23:11:34.058251 501593 exec_runner.go:51] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1211 23:11:34.067816 501593 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: exit status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I1211 23:11:34.067896 501593 exec_runner.go:51] Run: sudo rm -f /etc/kubernetes/admin.conf
I1211 23:11:34.075760 501593 exec_runner.go:51] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1211 23:11:34.084589 501593 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: exit status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I1211 23:11:34.084652 501593 exec_runner.go:51] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I1211 23:11:34.094940 501593 exec_runner.go:51] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1211 23:11:34.103013 501593 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: exit status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I1211 23:11:34.103085 501593 exec_runner.go:51] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I1211 23:11:34.112576 501593 exec_runner.go:51] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1211 23:11:34.121089 501593 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: exit status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I1211 23:11:34.121150 501593 exec_runner.go:51] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1211 23:11:34.130508 501593 exec_runner.go:97] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"
I1211 23:11:34.169377 501593 kubeadm.go:310] [init] Using Kubernetes version: v1.31.2
I1211 23:11:34.169441 501593 kubeadm.go:310] [preflight] Running pre-flight checks
I1211 23:11:34.264074 501593 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I1211 23:11:34.264146 501593 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I1211 23:11:34.264153 501593 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I1211 23:11:34.264156 501593 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I1211 23:11:34.274553 501593 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I1211 23:11:34.278521 501593 out.go:235] - Generating certificates and keys ...
I1211 23:11:34.278575 501593 kubeadm.go:310] [certs] Using existing ca certificate authority
I1211 23:11:34.278591 501593 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I1211 23:11:34.486163 501593 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I1211 23:11:34.684984 501593 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I1211 23:11:34.815998 501593 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I1211 23:11:35.110347 501593 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I1211 23:11:35.318168 501593 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I1211 23:11:35.318289 501593 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [localhost ubuntu-20-agent-15] and IPs [10.128.15.240 127.0.0.1 ::1]
I1211 23:11:35.559389 501593 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I1211 23:11:35.559427 501593 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [localhost ubuntu-20-agent-15] and IPs [10.128.15.240 127.0.0.1 ::1]
I1211 23:11:35.686779 501593 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I1211 23:11:35.774818 501593 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I1211 23:11:35.906830 501593 kubeadm.go:310] [certs] Generating "sa" key and public key
I1211 23:11:35.907041 501593 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I1211 23:11:36.112092 501593 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I1211 23:11:36.355022 501593 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I1211 23:11:36.482391 501593 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I1211 23:11:36.573260 501593 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I1211 23:11:36.890667 501593 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I1211 23:11:36.891163 501593 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I1211 23:11:36.893446 501593 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I1211 23:11:36.895697 501593 out.go:235] - Booting up control plane ...
I1211 23:11:36.895726 501593 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I1211 23:11:36.895744 501593 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I1211 23:11:36.896139 501593 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I1211 23:11:36.913766 501593 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I1211 23:11:36.918591 501593 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I1211 23:11:36.918650 501593 kubeadm.go:310] [kubelet-start] Starting the kubelet
I1211 23:11:37.148267 501593 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I1211 23:11:37.148292 501593 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I1211 23:11:37.650114 501593 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 501.819288ms
I1211 23:11:37.650142 501593 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I1211 23:11:42.652228 501593 kubeadm.go:310] [api-check] The API server is healthy after 5.002101086s
I1211 23:11:42.665158 501593 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I1211 23:11:42.680747 501593 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I1211 23:11:42.702984 501593 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I1211 23:11:42.703013 501593 kubeadm.go:310] [mark-control-plane] Marking the node ubuntu-20-agent-15 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I1211 23:11:42.712040 501593 kubeadm.go:310] [bootstrap-token] Using token: y25s7z.vjmgsp47xb0oy4b9
I1211 23:11:42.713501 501593 out.go:235] - Configuring RBAC rules ...
I1211 23:11:42.713535 501593 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I1211 23:11:42.718037 501593 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I1211 23:11:42.725559 501593 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I1211 23:11:42.728915 501593 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I1211 23:11:42.732522 501593 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I1211 23:11:42.735865 501593 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I1211 23:11:43.058325 501593 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I1211 23:11:43.507471 501593 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I1211 23:11:44.060212 501593 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I1211 23:11:44.061071 501593 kubeadm.go:310]
I1211 23:11:44.061085 501593 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I1211 23:11:44.061090 501593 kubeadm.go:310]
I1211 23:11:44.061094 501593 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I1211 23:11:44.061098 501593 kubeadm.go:310]
I1211 23:11:44.061102 501593 kubeadm.go:310] mkdir -p $HOME/.kube
I1211 23:11:44.061107 501593 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I1211 23:11:44.061111 501593 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I1211 23:11:44.061115 501593 kubeadm.go:310]
I1211 23:11:44.061118 501593 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I1211 23:11:44.061122 501593 kubeadm.go:310]
I1211 23:11:44.061125 501593 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I1211 23:11:44.061128 501593 kubeadm.go:310]
I1211 23:11:44.061131 501593 kubeadm.go:310] You should now deploy a pod network to the cluster.
I1211 23:11:44.061134 501593 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I1211 23:11:44.061138 501593 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I1211 23:11:44.061142 501593 kubeadm.go:310]
I1211 23:11:44.061146 501593 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I1211 23:11:44.061150 501593 kubeadm.go:310] and service account keys on each node and then running the following as root:
I1211 23:11:44.061154 501593 kubeadm.go:310]
I1211 23:11:44.061158 501593 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token y25s7z.vjmgsp47xb0oy4b9 \
I1211 23:11:44.061162 501593 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:82d76273b8d9856573ae323084d7d68f4149628c4677337998a44a54fd65d60e \
I1211 23:11:44.061166 501593 kubeadm.go:310] --control-plane
I1211 23:11:44.061187 501593 kubeadm.go:310]
I1211 23:11:44.061192 501593 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I1211 23:11:44.061196 501593 kubeadm.go:310]
I1211 23:11:44.061200 501593 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token y25s7z.vjmgsp47xb0oy4b9 \
I1211 23:11:44.061203 501593 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:82d76273b8d9856573ae323084d7d68f4149628c4677337998a44a54fd65d60e
I1211 23:11:44.064965 501593 cni.go:84] Creating CNI manager for ""
I1211 23:11:44.065003 501593 cni.go:158] "none" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I1211 23:11:44.066848 501593 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I1211 23:11:44.068434 501593 exec_runner.go:51] Run: sudo mkdir -p /etc/cni/net.d
I1211 23:11:44.079334 501593 exec_runner.go:151] cp: memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
I1211 23:11:44.079511 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1170208297 /etc/cni/net.d/1-k8s.conflist
I1211 23:11:44.090519 501593 exec_runner.go:51] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1211 23:11:44.090583 501593 exec_runner.go:51] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1211 23:11:44.090635 501593 exec_runner.go:51] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ubuntu-20-agent-15 minikube.k8s.io/updated_at=2024_12_11T23_11_44_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=7fa9733e2a94b345defa62bfa3d9dc225cfbd458 minikube.k8s.io/name=minikube minikube.k8s.io/primary=true
I1211 23:11:44.100067 501593 ops.go:34] apiserver oom_adj: -16
I1211 23:11:44.168518 501593 exec_runner.go:51] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1211 23:11:44.669570 501593 exec_runner.go:51] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1211 23:11:45.169346 501593 exec_runner.go:51] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1211 23:11:45.669332 501593 exec_runner.go:51] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1211 23:11:46.169604 501593 exec_runner.go:51] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1211 23:11:46.669303 501593 exec_runner.go:51] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1211 23:11:47.168985 501593 exec_runner.go:51] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1211 23:11:47.669837 501593 exec_runner.go:51] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1211 23:11:48.169231 501593 exec_runner.go:51] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1211 23:11:48.669088 501593 exec_runner.go:51] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1211 23:11:49.169024 501593 exec_runner.go:51] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I1211 23:11:49.263718 501593 kubeadm.go:1113] duration metric: took 5.173186484s to wait for elevateKubeSystemPrivileges
I1211 23:11:49.263761 501593 kubeadm.go:394] duration metric: took 15.271709118s to StartCluster
I1211 23:11:49.263786 501593 settings.go:142] acquiring lock: {Name:mk1c58e3d4804d0e9bb90c56c60a1ff1b6d01fba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1211 23:11:49.263876 501593 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/20083-490991/kubeconfig
I1211 23:11:49.264587 501593 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20083-490991/kubeconfig: {Name:mkf970072a6c85e62178e7023f29f8616f46c66b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1211 23:11:49.264826 501593 exec_runner.go:51] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I1211 23:11:49.264935 501593 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:true auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:true volumesnapshots:true yakd:true]
I1211 23:11:49.265096 501593 addons.go:69] Setting yakd=true in profile "minikube"
I1211 23:11:49.265110 501593 config.go:182] Loaded profile config "minikube": Driver=none, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1211 23:11:49.265128 501593 addons.go:69] Setting amd-gpu-device-plugin=true in profile "minikube"
I1211 23:11:49.265145 501593 addons.go:234] Setting addon amd-gpu-device-plugin=true in "minikube"
I1211 23:11:49.265118 501593 addons.go:234] Setting addon yakd=true in "minikube"
I1211 23:11:49.265185 501593 host.go:66] Checking if "minikube" exists ...
I1211 23:11:49.265197 501593 host.go:66] Checking if "minikube" exists ...
I1211 23:11:49.265801 501593 kubeconfig.go:125] found "minikube" server: "https://10.128.15.240:8443"
I1211 23:11:49.265824 501593 api_server.go:166] Checking apiserver status ...
I1211 23:11:49.265865 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1211 23:11:49.265959 501593 addons.go:69] Setting metrics-server=true in profile "minikube"
I1211 23:11:49.265989 501593 addons.go:234] Setting addon metrics-server=true in "minikube"
I1211 23:11:49.265983 501593 addons.go:69] Setting default-storageclass=true in profile "minikube"
I1211 23:11:49.266008 501593 addons.go:69] Setting cloud-spanner=true in profile "minikube"
I1211 23:11:49.266012 501593 addons.go:69] Setting gcp-auth=true in profile "minikube"
I1211 23:11:49.266032 501593 host.go:66] Checking if "minikube" exists ...
I1211 23:11:49.266036 501593 addons.go:234] Setting addon cloud-spanner=true in "minikube"
I1211 23:11:49.266041 501593 addons.go:69] Setting nvidia-device-plugin=true in profile "minikube"
I1211 23:11:49.266040 501593 addons.go:69] Setting csi-hostpath-driver=true in profile "minikube"
I1211 23:11:49.266060 501593 addons.go:69] Setting registry=true in profile "minikube"
I1211 23:11:49.266064 501593 addons.go:69] Setting inspektor-gadget=true in profile "minikube"
I1211 23:11:49.266071 501593 addons.go:234] Setting addon registry=true in "minikube"
I1211 23:11:49.266071 501593 host.go:66] Checking if "minikube" exists ...
I1211 23:11:49.266076 501593 addons.go:234] Setting addon inspektor-gadget=true in "minikube"
I1211 23:11:49.266090 501593 host.go:66] Checking if "minikube" exists ...
I1211 23:11:49.266098 501593 addons.go:234] Setting addon csi-hostpath-driver=true in "minikube"
I1211 23:11:49.266109 501593 host.go:66] Checking if "minikube" exists ...
I1211 23:11:49.266134 501593 host.go:66] Checking if "minikube" exists ...
I1211 23:11:49.266684 501593 kubeconfig.go:125] found "minikube" server: "https://10.128.15.240:8443"
I1211 23:11:49.266702 501593 api_server.go:166] Checking apiserver status ...
I1211 23:11:49.266710 501593 kubeconfig.go:125] found "minikube" server: "https://10.128.15.240:8443"
I1211 23:11:49.266724 501593 addons.go:69] Setting storage-provisioner=true in profile "minikube"
I1211 23:11:49.266739 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1211 23:11:49.266738 501593 addons.go:69] Setting volcano=true in profile "minikube"
I1211 23:11:49.266747 501593 addons.go:69] Setting volumesnapshots=true in profile "minikube"
I1211 23:11:49.266752 501593 addons.go:234] Setting addon volcano=true in "minikube"
I1211 23:11:49.266757 501593 addons.go:234] Setting addon volumesnapshots=true in "minikube"
I1211 23:11:49.266774 501593 host.go:66] Checking if "minikube" exists ...
I1211 23:11:49.266783 501593 kubeconfig.go:125] found "minikube" server: "https://10.128.15.240:8443"
I1211 23:11:49.266799 501593 api_server.go:166] Checking apiserver status ...
I1211 23:11:49.266798 501593 kubeconfig.go:125] found "minikube" server: "https://10.128.15.240:8443"
I1211 23:11:49.266813 501593 api_server.go:166] Checking apiserver status ...
I1211 23:11:49.266833 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1211 23:11:49.266844 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1211 23:11:49.266052 501593 mustload.go:65] Loading cluster: minikube
I1211 23:11:49.267055 501593 config.go:182] Loaded profile config "minikube": Driver=none, ContainerRuntime=docker, KubernetesVersion=v1.31.2
I1211 23:11:49.267383 501593 kubeconfig.go:125] found "minikube" server: "https://10.128.15.240:8443"
I1211 23:11:49.267402 501593 api_server.go:166] Checking apiserver status ...
I1211 23:11:49.267433 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1211 23:11:49.267503 501593 kubeconfig.go:125] found "minikube" server: "https://10.128.15.240:8443"
I1211 23:11:49.267522 501593 api_server.go:166] Checking apiserver status ...
I1211 23:11:49.267549 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1211 23:11:49.266710 501593 kubeconfig.go:125] found "minikube" server: "https://10.128.15.240:8443"
I1211 23:11:49.267741 501593 api_server.go:166] Checking apiserver status ...
I1211 23:11:49.267802 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1211 23:11:49.266774 501593 host.go:66] Checking if "minikube" exists ...
I1211 23:11:49.266738 501593 addons.go:234] Setting addon storage-provisioner=true in "minikube"
I1211 23:11:49.268178 501593 host.go:66] Checking if "minikube" exists ...
I1211 23:11:49.268661 501593 kubeconfig.go:125] found "minikube" server: "https://10.128.15.240:8443"
I1211 23:11:49.268683 501593 api_server.go:166] Checking apiserver status ...
I1211 23:11:49.268720 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1211 23:11:49.266028 501593 kubeconfig.go:125] found "minikube" server: "https://10.128.15.240:8443"
I1211 23:11:49.268816 501593 api_server.go:166] Checking apiserver status ...
I1211 23:11:49.268878 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1211 23:11:49.269827 501593 out.go:177] * Configuring local host environment ...
I1211 23:11:49.266053 501593 addons.go:234] Setting addon nvidia-device-plugin=true in "minikube"
I1211 23:11:49.270156 501593 host.go:66] Checking if "minikube" exists ...
I1211 23:11:49.270831 501593 kubeconfig.go:125] found "minikube" server: "https://10.128.15.240:8443"
I1211 23:11:49.270852 501593 api_server.go:166] Checking apiserver status ...
I1211 23:11:49.270883 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1211 23:11:49.266726 501593 api_server.go:166] Checking apiserver status ...
I1211 23:11:49.271728 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1211 23:11:49.266019 501593 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "minikube"
I1211 23:11:49.272372 501593 kubeconfig.go:125] found "minikube" server: "https://10.128.15.240:8443"
I1211 23:11:49.272399 501593 api_server.go:166] Checking apiserver status ...
I1211 23:11:49.272450 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
W1211 23:11:49.272634 501593 out.go:270] *
W1211 23:11:49.272654 501593 out.go:270] ! The 'none' driver is designed for experts who need to integrate with an existing VM
W1211 23:11:49.272680 501593 out.go:270] * Most users should use the newer 'docker' driver instead, which does not require root!
W1211 23:11:49.272689 501593 out.go:270] * For more information, see: https://minikube.sigs.k8s.io/docs/reference/drivers/none/
W1211 23:11:49.272695 501593 out.go:270] *
W1211 23:11:49.272755 501593 out.go:270] ! kubectl and minikube configuration will be stored in /home/jenkins
W1211 23:11:49.272767 501593 out.go:270] ! To use kubectl or minikube commands as your own user, you may need to relocate them. For example, to overwrite your own settings, run:
W1211 23:11:49.272792 501593 out.go:270] *
W1211 23:11:49.272850 501593 out.go:270] - sudo mv /home/jenkins/.kube /home/jenkins/.minikube $HOME
W1211 23:11:49.272883 501593 out.go:270] - sudo chown -R $USER $HOME/.kube $HOME/.minikube
W1211 23:11:49.272891 501593 out.go:270] *
W1211 23:11:49.272916 501593 out.go:270] * This can also be done automatically by setting the env var CHANGE_MINIKUBE_NONE_USER=true
I1211 23:11:49.272953 501593 start.go:235] Will wait 6m0s for node &{Name: IP:10.128.15.240 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:docker ControlPlane:true Worker:true}
I1211 23:11:49.278932 501593 out.go:177] * Verifying Kubernetes components...
I1211 23:11:49.281111 501593 exec_runner.go:51] Run: sudo systemctl daemon-reload
I1211 23:11:49.295127 501593 kubeconfig.go:125] found "minikube" server: "https://10.128.15.240:8443"
I1211 23:11:49.295161 501593 api_server.go:166] Checking apiserver status ...
I1211 23:11:49.295198 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1211 23:11:49.295476 501593 exec_runner.go:51] Run: sudo egrep ^[0-9]+:freezer: /proc/502962/cgroup
I1211 23:11:49.302443 501593 exec_runner.go:51] Run: sudo egrep ^[0-9]+:freezer: /proc/502962/cgroup
I1211 23:11:49.304356 501593 exec_runner.go:51] Run: sudo egrep ^[0-9]+:freezer: /proc/502962/cgroup
I1211 23:11:49.310121 501593 exec_runner.go:51] Run: sudo egrep ^[0-9]+:freezer: /proc/502962/cgroup
I1211 23:11:49.311872 501593 exec_runner.go:51] Run: sudo egrep ^[0-9]+:freezer: /proc/502962/cgroup
I1211 23:11:49.319566 501593 exec_runner.go:51] Run: sudo egrep ^[0-9]+:freezer: /proc/502962/cgroup
I1211 23:11:49.320104 501593 exec_runner.go:51] Run: sudo egrep ^[0-9]+:freezer: /proc/502962/cgroup
I1211 23:11:49.333129 501593 api_server.go:182] apiserver freezer: "10:freezer:/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae"
I1211 23:11:49.333210 501593 exec_runner.go:51] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae/freezer.state
I1211 23:11:49.334084 501593 api_server.go:182] apiserver freezer: "10:freezer:/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae"
I1211 23:11:49.334162 501593 exec_runner.go:51] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae/freezer.state
I1211 23:11:49.334502 501593 api_server.go:182] apiserver freezer: "10:freezer:/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae"
I1211 23:11:49.334673 501593 exec_runner.go:51] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae/freezer.state
I1211 23:11:49.334673 501593 api_server.go:182] apiserver freezer: "10:freezer:/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae"
I1211 23:11:49.334916 501593 exec_runner.go:51] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae/freezer.state
I1211 23:11:49.337029 501593 exec_runner.go:51] Run: sudo egrep ^[0-9]+:freezer: /proc/502962/cgroup
I1211 23:11:49.341759 501593 exec_runner.go:51] Run: sudo egrep ^[0-9]+:freezer: /proc/502962/cgroup
I1211 23:11:49.347078 501593 exec_runner.go:51] Run: sudo egrep ^[0-9]+:freezer: /proc/502962/cgroup
I1211 23:11:49.348160 501593 exec_runner.go:51] Run: sudo egrep ^[0-9]+:freezer: /proc/502962/cgroup
I1211 23:11:49.358070 501593 api_server.go:182] apiserver freezer: "10:freezer:/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae"
I1211 23:11:49.358148 501593 exec_runner.go:51] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae/freezer.state
I1211 23:11:49.360115 501593 exec_runner.go:51] Run: sudo egrep ^[0-9]+:freezer: /proc/502962/cgroup
I1211 23:11:49.366530 501593 api_server.go:204] freezer state: "THAWED"
I1211 23:11:49.366568 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:49.367833 501593 exec_runner.go:51] Run: sudo egrep ^[0-9]+:freezer: /proc/502962/cgroup
I1211 23:11:49.369724 501593 api_server.go:182] apiserver freezer: "10:freezer:/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae"
I1211 23:11:49.369778 501593 exec_runner.go:51] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae/freezer.state
I1211 23:11:49.382158 501593 api_server.go:204] freezer state: "THAWED"
I1211 23:11:49.382173 501593 api_server.go:182] apiserver freezer: "10:freezer:/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae"
I1211 23:11:49.382201 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:49.382205 501593 api_server.go:182] apiserver freezer: "10:freezer:/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae"
I1211 23:11:49.382246 501593 exec_runner.go:51] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae/freezer.state
I1211 23:11:49.382253 501593 exec_runner.go:51] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae/freezer.state
I1211 23:11:49.382537 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:49.382173 501593 api_server.go:182] apiserver freezer: "10:freezer:/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae"
I1211 23:11:49.382830 501593 exec_runner.go:51] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae/freezer.state
I1211 23:11:49.384950 501593 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I1211 23:11:49.385060 501593 api_server.go:182] apiserver freezer: "10:freezer:/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae"
I1211 23:11:49.385157 501593 exec_runner.go:51] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae/freezer.state
I1211 23:11:49.386438 501593 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I1211 23:11:49.386484 501593 exec_runner.go:151] cp: yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I1211 23:11:49.387699 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube4114108156 /etc/kubernetes/addons/yakd-ns.yaml
I1211 23:11:49.388590 501593 api_server.go:182] apiserver freezer: "10:freezer:/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae"
I1211 23:11:49.388626 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:49.388643 501593 exec_runner.go:51] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae/freezer.state
I1211 23:11:49.388738 501593 api_server.go:204] freezer state: "THAWED"
I1211 23:11:49.388764 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:49.390988 501593 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.25
I1211 23:11:49.392577 501593 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I1211 23:11:49.392607 501593 exec_runner.go:151] cp: memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I1211 23:11:49.393449 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1013871506 /etc/kubernetes/addons/deployment.yaml
I1211 23:11:49.393591 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:49.395491 501593 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I1211 23:11:49.396761 501593 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I1211 23:11:49.396818 501593 exec_runner.go:151] cp: metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I1211 23:11:49.397011 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube3456915661 /etc/kubernetes/addons/metrics-apiservice.yaml
I1211 23:11:49.402470 501593 api_server.go:182] apiserver freezer: "10:freezer:/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae"
I1211 23:11:49.402545 501593 exec_runner.go:51] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae/freezer.state
I1211 23:11:49.404183 501593 api_server.go:204] freezer state: "THAWED"
I1211 23:11:49.404214 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:49.407600 501593 api_server.go:204] freezer state: "THAWED"
I1211 23:11:49.407632 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:49.409544 501593 api_server.go:204] freezer state: "THAWED"
I1211 23:11:49.409623 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:49.411801 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:49.413012 501593 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I1211 23:11:49.413098 501593 exec_runner.go:151] cp: memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I1211 23:11:49.413290 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube107504917 /etc/kubernetes/addons/metrics-server-deployment.yaml
I1211 23:11:49.413477 501593 addons.go:234] Setting addon default-storageclass=true in "minikube"
I1211 23:11:49.413521 501593 host.go:66] Checking if "minikube" exists ...
I1211 23:11:49.414262 501593 kubeconfig.go:125] found "minikube" server: "https://10.128.15.240:8443"
I1211 23:11:49.414283 501593 api_server.go:166] Checking apiserver status ...
I1211 23:11:49.414325 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1211 23:11:49.414739 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:49.416607 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:49.416823 501593 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I1211 23:11:49.418121 501593 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I1211 23:11:49.418154 501593 exec_runner.go:151] cp: volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I1211 23:11:49.418313 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2382780391 /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I1211 23:11:49.418562 501593 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I1211 23:11:49.418753 501593 api_server.go:204] freezer state: "THAWED"
I1211 23:11:49.418775 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:49.420252 501593 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I1211 23:11:49.420277 501593 exec_runner.go:144] found /etc/kubernetes/addons/storage-provisioner.yaml, removing ...
I1211 23:11:49.420285 501593 exec_runner.go:203] rm: /etc/kubernetes/addons/storage-provisioner.yaml
I1211 23:11:49.420325 501593 exec_runner.go:51] Run: sudo rm -f /etc/kubernetes/addons/storage-provisioner.yaml
I1211 23:11:49.422898 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:49.424545 501593 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.8
I1211 23:11:49.426185 501593 out.go:177] - Using image docker.io/registry:2.8.3
I1211 23:11:49.427041 501593 exec_runner.go:51] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I1211 23:11:49.427639 501593 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I1211 23:11:49.427676 501593 exec_runner.go:151] cp: memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I1211 23:11:49.427838 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube875739328 /etc/kubernetes/addons/registry-rc.yaml
I1211 23:11:49.434166 501593 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I1211 23:11:49.434203 501593 exec_runner.go:151] cp: yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I1211 23:11:49.434222 501593 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I1211 23:11:49.434236 501593 exec_runner.go:151] cp: metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I1211 23:11:49.434350 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube785115263 /etc/kubernetes/addons/metrics-server-rbac.yaml
I1211 23:11:49.434350 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube380142661 /etc/kubernetes/addons/yakd-sa.yaml
I1211 23:11:49.434169 501593 api_server.go:204] freezer state: "THAWED"
I1211 23:11:49.434573 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:49.435490 501593 api_server.go:204] freezer state: "THAWED"
I1211 23:11:49.435514 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:49.435762 501593 api_server.go:204] freezer state: "THAWED"
I1211 23:11:49.435779 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:49.436662 501593 exec_runner.go:151] cp: memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I1211 23:11:49.436905 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube384063023 /etc/kubernetes/addons/storage-provisioner.yaml
I1211 23:11:49.437778 501593 api_server.go:204] freezer state: "THAWED"
I1211 23:11:49.437798 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:49.441974 501593 api_server.go:204] freezer state: "THAWED"
I1211 23:11:49.442003 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:49.443159 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:49.443201 501593 host.go:66] Checking if "minikube" exists ...
I1211 23:11:49.443514 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:49.444125 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:49.445613 501593 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I1211 23:11:49.445647 501593 exec_runner.go:151] cp: registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I1211 23:11:49.445721 501593 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I1211 23:11:49.445747 501593 exec_runner.go:151] cp: volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I1211 23:11:49.445785 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2346394218 /etc/kubernetes/addons/registry-svc.yaml
I1211 23:11:49.445868 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube92712505 /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I1211 23:11:49.446047 501593 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.17.0
I1211 23:11:49.447678 501593 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I1211 23:11:49.447706 501593 exec_runner.go:151] cp: memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I1211 23:11:49.447829 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2879686456 /etc/kubernetes/addons/nvidia-device-plugin.yaml
I1211 23:11:49.449627 501593 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I1211 23:11:49.449649 501593 exec_runner.go:151] cp: yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I1211 23:11:49.449735 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1928536162 /etc/kubernetes/addons/yakd-crb.yaml
I1211 23:11:49.451974 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:49.452765 501593 api_server.go:182] apiserver freezer: "10:freezer:/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae"
I1211 23:11:49.452832 501593 exec_runner.go:51] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae/freezer.state
I1211 23:11:49.452836 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:49.452937 501593 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.35.0
I1211 23:11:49.452989 501593 exec_runner.go:51] Run: sudo egrep ^[0-9]+:freezer: /proc/502962/cgroup
I1211 23:11:49.454662 501593 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I1211 23:11:49.454696 501593 exec_runner.go:151] cp: inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5248 bytes)
I1211 23:11:49.454733 501593 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I1211 23:11:49.454952 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube3933946394 /etc/kubernetes/addons/ig-crd.yaml
I1211 23:11:49.455258 501593 out.go:177] - Using image docker.io/rocm/k8s-device-plugin:1.25.2.8
I1211 23:11:49.457348 501593 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I1211 23:11:49.457513 501593 addons.go:431] installing /etc/kubernetes/addons/amd-gpu-device-plugin.yaml
I1211 23:11:49.457535 501593 exec_runner.go:151] cp: memory --> /etc/kubernetes/addons/amd-gpu-device-plugin.yaml (1868 bytes)
I1211 23:11:49.458350 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube3337417567 /etc/kubernetes/addons/amd-gpu-device-plugin.yaml
I1211 23:11:49.460660 501593 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I1211 23:11:49.462217 501593 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I1211 23:11:49.464085 501593 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I1211 23:11:49.465123 501593 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I1211 23:11:49.465228 501593 exec_runner.go:151] cp: volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I1211 23:11:49.465383 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube3988183690 /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I1211 23:11:49.466910 501593 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I1211 23:11:49.466938 501593 exec_runner.go:151] cp: metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I1211 23:11:49.467199 501593 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I1211 23:11:49.467580 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1768956599 /etc/kubernetes/addons/metrics-server-service.yaml
I1211 23:11:49.468870 501593 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I1211 23:11:49.468904 501593 exec_runner.go:151] cp: yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I1211 23:11:49.469025 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube731982755 /etc/kubernetes/addons/yakd-svc.yaml
I1211 23:11:49.471296 501593 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I1211 23:11:49.472575 501593 exec_runner.go:51] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I1211 23:11:49.479341 501593 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I1211 23:11:49.480112 501593 api_server.go:204] freezer state: "THAWED"
I1211 23:11:49.480144 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:49.482937 501593 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I1211 23:11:49.483026 501593 exec_runner.go:151] cp: csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I1211 23:11:49.483745 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube4100876244 /etc/kubernetes/addons/rbac-external-attacher.yaml
I1211 23:11:49.487231 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:49.487961 501593 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I1211 23:11:49.487998 501593 exec_runner.go:151] cp: memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I1211 23:11:49.489148 501593 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.10.0
I1211 23:11:49.490606 501593 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.10.0
I1211 23:11:49.490855 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2367243067 /etc/kubernetes/addons/registry-proxy.yaml
I1211 23:11:49.494059 501593 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.10.0
I1211 23:11:49.496280 501593 exec_runner.go:51] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I1211 23:11:49.497501 501593 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I1211 23:11:49.497544 501593 exec_runner.go:151] cp: memory --> /etc/kubernetes/addons/volcano-deployment.yaml (471825 bytes)
I1211 23:11:49.498265 501593 addons.go:431] installing /etc/kubernetes/addons/ig-deployment.yaml
I1211 23:11:49.498301 501593 exec_runner.go:151] cp: memory --> /etc/kubernetes/addons/ig-deployment.yaml (14576 bytes)
I1211 23:11:49.498449 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2354941553 /etc/kubernetes/addons/volcano-deployment.yaml
I1211 23:11:49.498455 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube3966245172 /etc/kubernetes/addons/ig-deployment.yaml
I1211 23:11:49.499301 501593 exec_runner.go:51] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I1211 23:11:49.503066 501593 exec_runner.go:51] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/amd-gpu-device-plugin.yaml
I1211 23:11:49.503442 501593 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I1211 23:11:49.503472 501593 exec_runner.go:151] cp: csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I1211 23:11:49.504405 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube4061055791 /etc/kubernetes/addons/rbac-hostpath.yaml
I1211 23:11:49.506986 501593 exec_runner.go:51] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 127.0.0.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I1211 23:11:49.514680 501593 exec_runner.go:51] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I1211 23:11:49.515907 501593 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I1211 23:11:49.515940 501593 exec_runner.go:151] cp: volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I1211 23:11:49.516915 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube3704389490 /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I1211 23:11:49.522712 501593 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I1211 23:11:49.522752 501593 exec_runner.go:151] cp: memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I1211 23:11:49.523010 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1194388749 /etc/kubernetes/addons/yakd-dp.yaml
I1211 23:11:49.530679 501593 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I1211 23:11:49.530767 501593 exec_runner.go:151] cp: volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I1211 23:11:49.530932 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1163755934 /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I1211 23:11:49.532402 501593 api_server.go:182] apiserver freezer: "10:freezer:/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae"
I1211 23:11:49.532478 501593 exec_runner.go:51] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae/freezer.state
I1211 23:11:49.538456 501593 exec_runner.go:51] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I1211 23:11:49.539383 501593 exec_runner.go:51] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I1211 23:11:49.539710 501593 exec_runner.go:51] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
I1211 23:11:49.541885 501593 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I1211 23:11:49.541931 501593 exec_runner.go:151] cp: csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I1211 23:11:49.542072 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube384584613 /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I1211 23:11:49.551486 501593 api_server.go:204] freezer state: "THAWED"
I1211 23:11:49.551525 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:49.556486 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:49.556550 501593 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I1211 23:11:49.556571 501593 exec_runner.go:144] found /etc/kubernetes/addons/storageclass.yaml, removing ...
I1211 23:11:49.556580 501593 exec_runner.go:203] rm: /etc/kubernetes/addons/storageclass.yaml
I1211 23:11:49.556631 501593 exec_runner.go:51] Run: sudo rm -f /etc/kubernetes/addons/storageclass.yaml
I1211 23:11:49.580430 501593 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1211 23:11:49.580475 501593 exec_runner.go:151] cp: memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I1211 23:11:49.580629 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube3676735578 /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1211 23:11:49.592558 501593 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I1211 23:11:49.592608 501593 exec_runner.go:151] cp: csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I1211 23:11:49.593409 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2485817370 /etc/kubernetes/addons/rbac-external-provisioner.yaml
I1211 23:11:49.595739 501593 exec_runner.go:151] cp: storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I1211 23:11:49.595913 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube951156891 /etc/kubernetes/addons/storageclass.yaml
I1211 23:11:49.612885 501593 exec_runner.go:51] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I1211 23:11:49.652538 501593 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I1211 23:11:49.652577 501593 exec_runner.go:151] cp: csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I1211 23:11:49.652720 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube3603201238 /etc/kubernetes/addons/rbac-external-resizer.yaml
I1211 23:11:49.688882 501593 exec_runner.go:51] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1211 23:11:49.708578 501593 exec_runner.go:51] Run: sudo systemctl start kubelet
I1211 23:11:49.751478 501593 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I1211 23:11:49.751517 501593 exec_runner.go:151] cp: csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I1211 23:11:49.751668 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2466744400 /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I1211 23:11:49.785317 501593 node_ready.go:35] waiting up to 6m0s for node "ubuntu-20-agent-15" to be "Ready" ...
I1211 23:11:49.788792 501593 node_ready.go:49] node "ubuntu-20-agent-15" has status "Ready":"True"
I1211 23:11:49.788828 501593 node_ready.go:38] duration metric: took 3.449128ms for node "ubuntu-20-agent-15" to be "Ready" ...
I1211 23:11:49.788842 501593 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1211 23:11:49.807200 501593 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-8gxlb" in "kube-system" namespace to be "Ready" ...
I1211 23:11:49.991512 501593 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I1211 23:11:49.991548 501593 exec_runner.go:151] cp: memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I1211 23:11:49.991698 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube4047429334 /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I1211 23:11:50.079842 501593 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I1211 23:11:50.079885 501593 exec_runner.go:151] cp: csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I1211 23:11:50.080045 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube829469676 /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I1211 23:11:50.174940 501593 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I1211 23:11:50.175000 501593 exec_runner.go:151] cp: memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I1211 23:11:50.176576 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube764854295 /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I1211 23:11:50.249571 501593 addons.go:475] Verifying addon registry=true in "minikube"
I1211 23:11:50.251190 501593 out.go:177] * Verifying registry addon...
I1211 23:11:50.258275 501593 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I1211 23:11:50.264099 501593 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I1211 23:11:50.264124 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:50.285574 501593 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I1211 23:11:50.285612 501593 exec_runner.go:151] cp: memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I1211 23:11:50.285753 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube4111245919 /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I1211 23:11:50.323879 501593 start.go:971] {"host.minikube.internal": 127.0.0.1} host record injected into CoreDNS's ConfigMap
I1211 23:11:50.373677 501593 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I1211 23:11:50.373716 501593 exec_runner.go:151] cp: csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I1211 23:11:50.373867 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube4042559999 /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I1211 23:11:50.489947 501593 exec_runner.go:51] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I1211 23:11:50.697050 501593 exec_runner.go:84] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (1.200705955s)
I1211 23:11:50.697095 501593 addons.go:475] Verifying addon metrics-server=true in "minikube"
I1211 23:11:50.767679 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:50.827838 501593 kapi.go:214] "coredns" deployment in "kube-system" namespace and "minikube" context rescaled to 1 replicas
I1211 23:11:50.895206 501593 exec_runner.go:84] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (1.356680755s)
I1211 23:11:50.896940 501593 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube service yakd-dashboard -n yakd-dashboard
I1211 23:11:50.985719 501593 exec_runner.go:84] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: (1.445967513s)
I1211 23:11:51.264773 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:51.494684 501593 exec_runner.go:84] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.805713799s)
W1211 23:11:51.494763 501593 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: exit status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I1211 23:11:51.494796 501593 retry.go:31] will retry after 278.172111ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: exit status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I1211 23:11:51.763561 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:51.774145 501593 exec_runner.go:51] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I1211 23:11:51.813178 501593 pod_ready.go:103] pod "coredns-7c65d6cfc9-8gxlb" in "kube-system" namespace has status "Ready":"False"
I1211 23:11:52.269379 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:52.595987 501593 exec_runner.go:84] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (3.056551304s)
I1211 23:11:52.768089 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:52.768300 501593 exec_runner.go:84] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (2.278284526s)
I1211 23:11:52.768328 501593 addons.go:475] Verifying addon csi-hostpath-driver=true in "minikube"
I1211 23:11:52.771213 501593 out.go:177] * Verifying csi-hostpath-driver addon...
I1211 23:11:52.778561 501593 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I1211 23:11:52.805733 501593 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I1211 23:11:52.805761 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:11:53.263427 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:53.285010 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:11:53.763895 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:53.784598 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:11:53.815478 501593 pod_ready.go:103] pod "coredns-7c65d6cfc9-8gxlb" in "kube-system" namespace has status "Ready":"False"
I1211 23:11:54.288330 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:54.289183 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:11:54.574171 501593 exec_runner.go:84] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.799954254s)
I1211 23:11:54.763181 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:54.784223 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:11:55.263296 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:55.283261 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:11:55.763179 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:55.784577 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:11:56.262511 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:56.283982 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:11:56.314406 501593 pod_ready.go:103] pod "coredns-7c65d6cfc9-8gxlb" in "kube-system" namespace has status "Ready":"False"
I1211 23:11:56.503562 501593 exec_runner.go:151] cp: memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I1211 23:11:56.504268 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2335684592 /var/lib/minikube/google_application_credentials.json
I1211 23:11:56.516971 501593 exec_runner.go:151] cp: memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I1211 23:11:56.517133 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube4093132205 /var/lib/minikube/google_cloud_project
I1211 23:11:56.529605 501593 addons.go:234] Setting addon gcp-auth=true in "minikube"
I1211 23:11:56.529684 501593 host.go:66] Checking if "minikube" exists ...
I1211 23:11:56.530493 501593 kubeconfig.go:125] found "minikube" server: "https://10.128.15.240:8443"
I1211 23:11:56.530520 501593 api_server.go:166] Checking apiserver status ...
I1211 23:11:56.530565 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1211 23:11:56.552106 501593 exec_runner.go:51] Run: sudo egrep ^[0-9]+:freezer: /proc/502962/cgroup
I1211 23:11:56.565574 501593 api_server.go:182] apiserver freezer: "10:freezer:/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae"
I1211 23:11:56.565645 501593 exec_runner.go:51] Run: sudo cat /sys/fs/cgroup/freezer/kubepods/burstable/podcb519627eb85f5ecd7d5a34384dec33a/3109488ffe3633ce5eed11b849cac8791e6830b2297b4adc5da25150d928ddae/freezer.state
I1211 23:11:56.576629 501593 api_server.go:204] freezer state: "THAWED"
I1211 23:11:56.576665 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:56.582260 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:56.582344 501593 exec_runner.go:51] Run: cat /var/lib/minikube/google_application_credentials.json
I1211 23:11:56.620559 501593 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4
I1211 23:11:56.682492 501593 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.3
I1211 23:11:56.746542 501593 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I1211 23:11:56.746687 501593 exec_runner.go:151] cp: gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I1211 23:11:56.761535 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2965376114 /etc/kubernetes/addons/gcp-auth-ns.yaml
I1211 23:11:56.762561 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:56.773647 501593 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I1211 23:11:56.773691 501593 exec_runner.go:151] cp: gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I1211 23:11:56.773808 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube3914811278 /etc/kubernetes/addons/gcp-auth-service.yaml
I1211 23:11:56.782840 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:11:56.784213 501593 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I1211 23:11:56.784248 501593 exec_runner.go:151] cp: memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I1211 23:11:56.784390 501593 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2716271171 /etc/kubernetes/addons/gcp-auth-webhook.yaml
I1211 23:11:56.795114 501593 exec_runner.go:51] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I1211 23:11:57.191431 501593 addons.go:475] Verifying addon gcp-auth=true in "minikube"
I1211 23:11:57.193454 501593 out.go:177] * Verifying gcp-auth addon...
I1211 23:11:57.196233 501593 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I1211 23:11:57.198832 501593 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I1211 23:11:57.292298 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:57.293135 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:11:57.314714 501593 pod_ready.go:98] pod "coredns-7c65d6cfc9-8gxlb" in "kube-system" namespace has status phase "Succeeded" (skipping!): {Phase:Succeeded Conditions:[{Type:PodReadyToStartContainers Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-12-11 23:11:57 +0000 UTC Reason: Message:} {Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-12-11 23:11:48 +0000 UTC Reason:PodCompleted Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-12-11 23:11:48 +0000 UTC Reason:PodCompleted Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-12-11 23:11:48 +0000 UTC Reason:PodCompleted Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-12-11 23:11:48 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.128.15.240 HostIPs:[{IP:10.128.15.2
40}] PodIP:10.244.0.3 PodIPs:[{IP:10.244.0.3}] StartTime:2024-12-11 23:11:48 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2024-12-11 23:11:50 +0000 UTC,FinishedAt:2024-12-11 23:11:56 +0000 UTC,ContainerID:docker://2031f8b5c7d777b4608edd15bc533fd881af04f79030ab3e637e3a31593402f1,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.11.3 ImageID:docker-pullable://registry.k8s.io/coredns/coredns@sha256:9caabbf6238b189a65d0d6e6ac138de60d6a1c419e5a341fbbb7c78382559c6e ContainerID:docker://2031f8b5c7d777b4608edd15bc533fd881af04f79030ab3e637e3a31593402f1 Started:0xc002342fe0 AllocatedResources:map[] Resources:nil VolumeMounts:[{Name:config-volume MountPath:/etc/coredns ReadOnly:true RecursiveReadOnly:0xc0018a2ef0} {Name:kube-api-access-6ksc8 MountPath:/var/run/secrets/kubernetes.io/serviceaccou
nt ReadOnly:true RecursiveReadOnly:0xc0018a2f00}] User:nil AllocatedResourcesStatus:[]}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}
I1211 23:11:57.314744 501593 pod_ready.go:82] duration metric: took 7.507463344s for pod "coredns-7c65d6cfc9-8gxlb" in "kube-system" namespace to be "Ready" ...
E1211 23:11:57.314761 501593 pod_ready.go:67] WaitExtra: waitPodCondition: pod "coredns-7c65d6cfc9-8gxlb" in "kube-system" namespace has status phase "Succeeded" (skipping!): {Phase:Succeeded Conditions:[{Type:PodReadyToStartContainers Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-12-11 23:11:57 +0000 UTC Reason: Message:} {Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-12-11 23:11:48 +0000 UTC Reason:PodCompleted Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-12-11 23:11:48 +0000 UTC Reason:PodCompleted Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-12-11 23:11:48 +0000 UTC Reason:PodCompleted Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-12-11 23:11:48 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.128.15
.240 HostIPs:[{IP:10.128.15.240}] PodIP:10.244.0.3 PodIPs:[{IP:10.244.0.3}] StartTime:2024-12-11 23:11:48 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2024-12-11 23:11:50 +0000 UTC,FinishedAt:2024-12-11 23:11:56 +0000 UTC,ContainerID:docker://2031f8b5c7d777b4608edd15bc533fd881af04f79030ab3e637e3a31593402f1,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.11.3 ImageID:docker-pullable://registry.k8s.io/coredns/coredns@sha256:9caabbf6238b189a65d0d6e6ac138de60d6a1c419e5a341fbbb7c78382559c6e ContainerID:docker://2031f8b5c7d777b4608edd15bc533fd881af04f79030ab3e637e3a31593402f1 Started:0xc002342fe0 AllocatedResources:map[] Resources:nil VolumeMounts:[{Name:config-volume MountPath:/etc/coredns ReadOnly:true RecursiveReadOnly:0xc0018a2ef0} {Name:kube-api-access-6ksc8 MountPath:/var/run/secre
ts/kubernetes.io/serviceaccount ReadOnly:true RecursiveReadOnly:0xc0018a2f00}] User:nil AllocatedResourcesStatus:[]}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}
I1211 23:11:57.314773 501593 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-r7h74" in "kube-system" namespace to be "Ready" ...
I1211 23:11:57.319873 501593 pod_ready.go:93] pod "coredns-7c65d6cfc9-r7h74" in "kube-system" namespace has status "Ready":"True"
I1211 23:11:57.319901 501593 pod_ready.go:82] duration metric: took 5.118199ms for pod "coredns-7c65d6cfc9-r7h74" in "kube-system" namespace to be "Ready" ...
I1211 23:11:57.319914 501593 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ubuntu-20-agent-15" in "kube-system" namespace to be "Ready" ...
I1211 23:11:57.324565 501593 pod_ready.go:93] pod "etcd-ubuntu-20-agent-15" in "kube-system" namespace has status "Ready":"True"
I1211 23:11:57.324584 501593 pod_ready.go:82] duration metric: took 4.661974ms for pod "etcd-ubuntu-20-agent-15" in "kube-system" namespace to be "Ready" ...
I1211 23:11:57.324594 501593 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ubuntu-20-agent-15" in "kube-system" namespace to be "Ready" ...
I1211 23:11:57.330832 501593 pod_ready.go:93] pod "kube-apiserver-ubuntu-20-agent-15" in "kube-system" namespace has status "Ready":"True"
I1211 23:11:57.330851 501593 pod_ready.go:82] duration metric: took 6.251375ms for pod "kube-apiserver-ubuntu-20-agent-15" in "kube-system" namespace to be "Ready" ...
I1211 23:11:57.330860 501593 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ubuntu-20-agent-15" in "kube-system" namespace to be "Ready" ...
I1211 23:11:57.335637 501593 pod_ready.go:93] pod "kube-controller-manager-ubuntu-20-agent-15" in "kube-system" namespace has status "Ready":"True"
I1211 23:11:57.335661 501593 pod_ready.go:82] duration metric: took 4.792502ms for pod "kube-controller-manager-ubuntu-20-agent-15" in "kube-system" namespace to be "Ready" ...
I1211 23:11:57.335674 501593 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-9r5nc" in "kube-system" namespace to be "Ready" ...
I1211 23:11:57.711078 501593 pod_ready.go:93] pod "kube-proxy-9r5nc" in "kube-system" namespace has status "Ready":"True"
I1211 23:11:57.711111 501593 pod_ready.go:82] duration metric: took 375.427974ms for pod "kube-proxy-9r5nc" in "kube-system" namespace to be "Ready" ...
I1211 23:11:57.711126 501593 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ubuntu-20-agent-15" in "kube-system" namespace to be "Ready" ...
I1211 23:11:57.762625 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:57.783684 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:11:58.111938 501593 pod_ready.go:93] pod "kube-scheduler-ubuntu-20-agent-15" in "kube-system" namespace has status "Ready":"True"
I1211 23:11:58.111965 501593 pod_ready.go:82] duration metric: took 400.829723ms for pod "kube-scheduler-ubuntu-20-agent-15" in "kube-system" namespace to be "Ready" ...
I1211 23:11:58.111977 501593 pod_ready.go:39] duration metric: took 8.323120062s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I1211 23:11:58.112006 501593 api_server.go:52] waiting for apiserver process to appear ...
I1211 23:11:58.112079 501593 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1211 23:11:58.131496 501593 api_server.go:72] duration metric: took 8.858457702s to wait for apiserver process to appear ...
I1211 23:11:58.131531 501593 api_server.go:88] waiting for apiserver healthz status ...
I1211 23:11:58.131561 501593 api_server.go:253] Checking apiserver healthz at https://10.128.15.240:8443/healthz ...
I1211 23:11:58.135751 501593 api_server.go:279] https://10.128.15.240:8443/healthz returned 200:
ok
I1211 23:11:58.136935 501593 api_server.go:141] control plane version: v1.31.2
I1211 23:11:58.136966 501593 api_server.go:131] duration metric: took 5.42567ms to wait for apiserver health ...
I1211 23:11:58.136977 501593 system_pods.go:43] waiting for kube-system pods to appear ...
I1211 23:11:58.262181 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:58.284287 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:11:58.317997 501593 system_pods.go:59] 17 kube-system pods found
I1211 23:11:58.318051 501593 system_pods.go:61] "amd-gpu-device-plugin-smq5q" [87724716-9f04-403d-9c59-a8a943541c21] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
I1211 23:11:58.318060 501593 system_pods.go:61] "coredns-7c65d6cfc9-r7h74" [778cffa8-c371-4979-a785-81d83ac63512] Running
I1211 23:11:58.318071 501593 system_pods.go:61] "csi-hostpath-attacher-0" [e117a237-de40-44b3-b2aa-fb96f27c15e5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1211 23:11:58.318080 501593 system_pods.go:61] "csi-hostpath-resizer-0" [04632c29-a6de-4c45-874d-e5f8822ab70f] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1211 23:11:58.318102 501593 system_pods.go:61] "csi-hostpathplugin-8jhdx" [9959bda5-8db4-4547-860f-1c9482b706c8] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1211 23:11:58.318112 501593 system_pods.go:61] "etcd-ubuntu-20-agent-15" [fecfb499-611a-4ce6-a84d-163baf2b0a41] Running
I1211 23:11:58.318119 501593 system_pods.go:61] "kube-apiserver-ubuntu-20-agent-15" [145c2c67-33de-4343-9c45-87e838eaea68] Running
I1211 23:11:58.318125 501593 system_pods.go:61] "kube-controller-manager-ubuntu-20-agent-15" [d7b8a90a-fe2b-4d2c-a5cd-eb501c93df02] Running
I1211 23:11:58.318130 501593 system_pods.go:61] "kube-proxy-9r5nc" [b401cf25-114d-43c2-81d6-bb33d27beb92] Running
I1211 23:11:58.318135 501593 system_pods.go:61] "kube-scheduler-ubuntu-20-agent-15" [a5e512cd-6f44-4ac4-a3f4-248e662b7da9] Running
I1211 23:11:58.318149 501593 system_pods.go:61] "metrics-server-84c5f94fbc-r5cpf" [4499061c-ef26-4bd2-9539-d37d4798f378] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1211 23:11:58.318159 501593 system_pods.go:61] "nvidia-device-plugin-daemonset-tz4pr" [a6d6897d-332f-4d65-a20f-0f840fcd2917] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1211 23:11:58.318167 501593 system_pods.go:61] "registry-5cc95cd69-68q8r" [856f7c1e-6ad8-46e8-9b2a-78040325bce0] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1211 23:11:58.318179 501593 system_pods.go:61] "registry-proxy-rqnmj" [34d23068-c120-416f-b135-fa43cc0a53c1] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1211 23:11:58.318214 501593 system_pods.go:61] "snapshot-controller-56fcc65765-wzlbp" [faf3a283-a756-40e0-956b-5ae3752bf2a6] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1211 23:11:58.318227 501593 system_pods.go:61] "snapshot-controller-56fcc65765-x2c66" [5c57fe98-78d7-4408-8c35-98a7b5abbc49] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1211 23:11:58.318233 501593 system_pods.go:61] "storage-provisioner" [c5fd4606-626b-4277-96de-a0da44cb3251] Running
I1211 23:11:58.318243 501593 system_pods.go:74] duration metric: took 181.256275ms to wait for pod list to return data ...
I1211 23:11:58.318255 501593 default_sa.go:34] waiting for default service account to be created ...
I1211 23:11:58.510304 501593 default_sa.go:45] found service account: "default"
I1211 23:11:58.510331 501593 default_sa.go:55] duration metric: took 192.068726ms for default service account to be created ...
I1211 23:11:58.510341 501593 system_pods.go:116] waiting for k8s-apps to be running ...
I1211 23:11:58.718222 501593 system_pods.go:86] 17 kube-system pods found
I1211 23:11:58.718266 501593 system_pods.go:89] "amd-gpu-device-plugin-smq5q" [87724716-9f04-403d-9c59-a8a943541c21] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
I1211 23:11:58.718275 501593 system_pods.go:89] "coredns-7c65d6cfc9-r7h74" [778cffa8-c371-4979-a785-81d83ac63512] Running
I1211 23:11:58.718288 501593 system_pods.go:89] "csi-hostpath-attacher-0" [e117a237-de40-44b3-b2aa-fb96f27c15e5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I1211 23:11:58.718297 501593 system_pods.go:89] "csi-hostpath-resizer-0" [04632c29-a6de-4c45-874d-e5f8822ab70f] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I1211 23:11:58.718309 501593 system_pods.go:89] "csi-hostpathplugin-8jhdx" [9959bda5-8db4-4547-860f-1c9482b706c8] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I1211 23:11:58.718319 501593 system_pods.go:89] "etcd-ubuntu-20-agent-15" [fecfb499-611a-4ce6-a84d-163baf2b0a41] Running
I1211 23:11:58.718329 501593 system_pods.go:89] "kube-apiserver-ubuntu-20-agent-15" [145c2c67-33de-4343-9c45-87e838eaea68] Running
I1211 23:11:58.718340 501593 system_pods.go:89] "kube-controller-manager-ubuntu-20-agent-15" [d7b8a90a-fe2b-4d2c-a5cd-eb501c93df02] Running
I1211 23:11:58.718356 501593 system_pods.go:89] "kube-proxy-9r5nc" [b401cf25-114d-43c2-81d6-bb33d27beb92] Running
I1211 23:11:58.718364 501593 system_pods.go:89] "kube-scheduler-ubuntu-20-agent-15" [a5e512cd-6f44-4ac4-a3f4-248e662b7da9] Running
I1211 23:11:58.718383 501593 system_pods.go:89] "metrics-server-84c5f94fbc-r5cpf" [4499061c-ef26-4bd2-9539-d37d4798f378] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I1211 23:11:58.718395 501593 system_pods.go:89] "nvidia-device-plugin-daemonset-tz4pr" [a6d6897d-332f-4d65-a20f-0f840fcd2917] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I1211 23:11:58.718407 501593 system_pods.go:89] "registry-5cc95cd69-68q8r" [856f7c1e-6ad8-46e8-9b2a-78040325bce0] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I1211 23:11:58.718418 501593 system_pods.go:89] "registry-proxy-rqnmj" [34d23068-c120-416f-b135-fa43cc0a53c1] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I1211 23:11:58.718441 501593 system_pods.go:89] "snapshot-controller-56fcc65765-wzlbp" [faf3a283-a756-40e0-956b-5ae3752bf2a6] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1211 23:11:58.718453 501593 system_pods.go:89] "snapshot-controller-56fcc65765-x2c66" [5c57fe98-78d7-4408-8c35-98a7b5abbc49] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I1211 23:11:58.718462 501593 system_pods.go:89] "storage-provisioner" [c5fd4606-626b-4277-96de-a0da44cb3251] Running
I1211 23:11:58.718475 501593 system_pods.go:126] duration metric: took 208.127564ms to wait for k8s-apps to be running ...
I1211 23:11:58.718488 501593 system_svc.go:44] waiting for kubelet service to be running ....
I1211 23:11:58.718549 501593 exec_runner.go:51] Run: sudo systemctl is-active --quiet service kubelet
I1211 23:11:58.732508 501593 system_svc.go:56] duration metric: took 14.005163ms WaitForService to wait for kubelet
I1211 23:11:58.732547 501593 kubeadm.go:582] duration metric: took 9.459517398s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1211 23:11:58.732575 501593 node_conditions.go:102] verifying NodePressure condition ...
I1211 23:11:58.762448 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:58.783808 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:11:58.912480 501593 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I1211 23:11:58.912515 501593 node_conditions.go:123] node cpu capacity is 8
I1211 23:11:58.912530 501593 node_conditions.go:105] duration metric: took 179.948716ms to run NodePressure ...
I1211 23:11:58.912547 501593 start.go:241] waiting for startup goroutines ...
I1211 23:11:59.262485 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:59.283658 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:11:59.802157 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:11:59.802948 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:00.263365 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:00.390641 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:00.761835 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:00.783233 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:01.262543 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:01.283497 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:01.762936 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:01.784234 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:02.263206 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:02.283641 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:02.762131 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:02.782903 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:03.262089 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:03.283318 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:03.761937 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:03.783900 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:04.302246 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:04.302889 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:04.763065 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:04.784571 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:05.262834 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:05.283991 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:05.762234 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:05.784552 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:06.302979 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:06.303853 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:06.763058 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:06.783746 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:07.301570 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:07.302584 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:07.763174 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:07.784311 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:08.262489 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:08.283672 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:08.793955 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:08.794630 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:09.262385 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:09.283649 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:09.762573 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:09.783612 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:10.266005 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:10.302931 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:10.763088 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:10.783732 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:11.262522 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:11.284947 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:11.762477 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:11.783428 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:12.301482 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:12.302481 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:12.761836 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:12.783949 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:13.262343 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:13.283306 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:13.762812 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:13.801396 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:14.262656 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:14.283936 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:14.762689 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:14.784320 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:15.302122 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:15.302563 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:15.762986 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:15.784011 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:16.300985 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:16.301921 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:16.762674 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:16.784035 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:17.294138 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:17.294776 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:17.801815 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:17.803115 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:18.261649 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:18.302534 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I1211 23:12:18.762083 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:18.783916 501593 kapi.go:107] duration metric: took 26.005356826s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I1211 23:12:19.262075 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:19.762601 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:20.262058 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:20.761933 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:21.261605 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:21.761775 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:22.261797 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:22.762661 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:23.261826 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:23.762278 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:24.262157 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:24.762634 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:25.261881 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:25.762561 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:26.262134 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:26.762165 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:27.262432 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:27.761806 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:28.264158 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:28.762417 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:29.262587 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:29.762666 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:30.262070 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:30.762699 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:31.261988 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:31.762140 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:32.263272 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:32.762344 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:33.262167 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:33.763446 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:34.262308 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:34.761932 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:35.262456 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:35.800814 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:36.261861 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:36.762322 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:37.262303 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:37.762810 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:38.262563 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:38.762205 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:39.262365 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:39.801235 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:40.261602 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:40.761934 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:41.262515 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:41.762630 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:42.262138 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:42.762243 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:43.261996 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:43.763291 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:44.262463 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:44.761914 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:45.261527 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:45.801073 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:46.262801 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:46.762658 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:47.261754 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:47.762848 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:48.262229 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:48.762655 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:49.261835 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:49.762368 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:50.262758 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:50.762401 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:51.262418 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:51.762333 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:52.262793 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:52.762202 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:53.262347 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:53.762182 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:54.262375 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:54.762611 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:55.262387 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:55.761957 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:56.262563 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:56.762530 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:57.262562 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:57.762295 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:58.262837 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:58.762493 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:59.262512 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:12:59.763139 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:00.301697 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:00.762649 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:01.261969 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:01.762117 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:02.262324 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:02.762864 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:03.262008 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:03.762799 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:04.262102 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:04.761946 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:05.262782 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:05.761916 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:06.262741 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:06.762092 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:07.262049 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:07.761961 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:08.262208 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:08.762118 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:09.262005 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:09.762486 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:10.262290 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:10.762945 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:11.262127 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:11.762656 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:12.262048 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:12.762764 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:13.262043 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:13.762316 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:14.262937 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:14.762455 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:15.262156 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:15.762876 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:16.262488 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:16.762353 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:17.262505 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:17.761768 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:18.262733 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:18.762650 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:19.262223 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:19.762489 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:20.262630 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:20.762636 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:21.262014 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:21.761929 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:22.262552 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:22.762456 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:23.262710 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:23.762387 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:24.262043 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:24.761942 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:25.262228 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:25.762412 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:26.261793 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:26.762091 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:27.262264 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:27.762360 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:28.261384 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:28.762250 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:29.262653 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:29.762675 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:30.262108 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:30.761851 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:31.262174 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:31.762927 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:32.262411 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:32.762209 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:33.262170 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:33.761790 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:34.261947 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:34.762616 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:35.262595 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:35.762223 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:36.261807 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:36.762153 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:37.262863 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:37.761854 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:38.261942 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:38.762425 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:39.262329 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:39.763307 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:40.261915 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:40.762652 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:41.261822 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:41.762186 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:42.262103 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:42.762654 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:43.262028 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:43.763197 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:44.262090 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:44.762429 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:45.262204 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:45.802985 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:46.262156 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:46.761982 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:47.262111 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:47.762339 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:48.262097 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:48.762573 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:49.262648 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:49.762476 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:50.262175 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:50.761854 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:51.262042 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:51.762432 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:52.261585 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:52.761793 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:53.262529 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:53.762804 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:54.262792 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:54.762083 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:55.262049 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:55.762513 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:56.262081 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:56.762074 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:57.262232 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:57.762649 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:58.262047 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:58.761958 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:59.262042 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:13:59.762237 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:00.301399 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:00.761822 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:01.261851 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:01.761995 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:02.262337 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:02.762614 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:03.262494 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:03.762867 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:04.262107 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:04.761847 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:05.262238 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:05.762387 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:06.262361 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:06.762678 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:07.261421 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:07.762224 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:08.261916 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:08.761763 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:09.262691 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:09.762612 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:10.262298 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:10.761934 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:11.262655 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:11.762427 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:12.262190 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:12.762516 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:13.262432 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:13.762089 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:14.262521 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:14.761857 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:15.261867 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:15.762404 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:16.262424 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:16.762018 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:17.262327 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:17.762192 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:18.262464 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:18.762335 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:19.261907 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:19.762074 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:20.261519 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:20.762693 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:21.261657 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:21.762802 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:22.262490 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:22.762213 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:23.262074 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:23.762003 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:24.262551 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:24.761990 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:25.262731 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:25.761852 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:26.262080 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:26.762438 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:27.261694 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:27.762848 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:28.262016 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:28.762382 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:29.262538 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:29.762800 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:30.262274 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:30.762398 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:31.262494 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:31.762421 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:32.261820 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:32.762371 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:33.262177 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:33.762571 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:34.261737 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:34.762102 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:35.262285 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:35.761923 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:36.301546 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:36.762304 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:37.262532 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:37.762319 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:38.262557 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:38.762523 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:39.261829 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:39.762195 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:40.262012 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:40.762378 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:41.302435 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:41.762467 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:42.262416 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:42.762671 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:43.263034 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:43.762255 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:44.262242 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:44.762383 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:45.261974 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:45.762277 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:46.262243 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:46.762766 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:47.263288 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:47.762414 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:48.262604 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:48.762773 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:49.261577 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:49.762458 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:50.262389 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:50.762277 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:51.262330 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:51.762433 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:52.262486 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:52.762055 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:53.261794 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:53.763049 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:54.262743 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:54.761616 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:55.261929 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:55.761998 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:56.261861 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:56.761823 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:57.261660 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:57.762145 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:58.261932 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:58.761565 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:59.262740 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:14:59.762040 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:00.262760 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:00.801330 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:01.262739 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:01.762181 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:02.263050 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:02.763046 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:03.262592 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:03.763142 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:04.262651 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:04.762017 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:05.262841 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:05.763294 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:06.262999 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:06.762615 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:07.262954 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:07.762975 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:08.262432 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:08.762005 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:09.261470 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:09.762929 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:10.262731 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:10.802283 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:11.262486 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:11.762196 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:12.262404 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:12.762253 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:13.262545 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:13.762320 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:14.262736 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:14.762840 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:15.261627 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:15.801685 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:16.262602 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:16.762187 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:17.262448 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:17.762683 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:18.261981 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:18.762530 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:19.262666 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:19.762396 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:20.262753 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:20.762701 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:21.262173 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:21.762492 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:22.262175 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:22.761770 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:23.262361 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:23.761617 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:24.262967 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:24.762598 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:25.261827 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:25.801727 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:26.262539 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:26.762544 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:27.262393 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:27.762509 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:28.262752 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:28.762417 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:29.262397 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:29.762435 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:30.261686 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:30.800827 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:31.261484 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:31.761915 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:32.262129 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:32.762501 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:33.262405 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:33.762586 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:34.262482 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:34.762375 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:35.262146 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:35.762209 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:36.262299 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:36.762661 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:37.262510 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:37.762182 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:38.261755 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:38.761736 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:39.261502 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:39.761628 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:40.262948 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:40.762263 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:41.261846 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:41.761681 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:42.262764 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:42.762477 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:43.262892 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:43.762464 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:44.261849 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:44.762278 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:45.262217 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:45.761820 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:46.261838 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:46.762267 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:47.262505 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:47.762410 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:48.262240 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:48.763099 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:49.261663 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:49.763062 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:50.262504 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:50.762478 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:51.262016 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:51.762105 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:52.261534 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:52.761914 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:53.262311 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:53.762628 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:54.262167 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:54.762728 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:55.262175 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:55.762437 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:56.262545 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:56.761714 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:57.262587 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:57.762256 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:58.261946 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:58.762002 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:59.262065 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:15:59.762691 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:00.261495 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:00.762603 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:01.262156 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:01.761681 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:02.261965 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:02.762423 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:03.262415 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:03.764169 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:04.262405 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:04.762655 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:05.262614 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:05.762652 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:06.261770 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:06.762096 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:07.262078 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:07.762196 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:08.262262 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:08.762356 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:09.262171 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:09.762417 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:10.261814 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:10.762345 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:11.262671 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:11.762021 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:12.262058 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:12.761853 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:13.261840 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:13.762306 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:14.262219 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:14.761677 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:15.262552 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:15.763019 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:16.301791 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:16.761605 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:17.262135 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:17.762491 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:18.262188 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:18.762583 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:19.262498 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:19.762744 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:20.262081 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:20.762499 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:21.261882 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:21.762251 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:22.262510 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:22.761990 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:23.262110 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:23.762380 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:24.261766 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:24.762420 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:25.262347 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:25.762516 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:26.261789 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:26.762234 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:27.262196 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:27.762372 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:28.262326 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:28.762448 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:29.262375 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:29.761811 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:30.262234 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:30.761814 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:31.262654 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:31.761859 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:32.262234 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:32.762533 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:33.262403 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:33.762827 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:34.263096 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:34.762523 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:35.261668 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:35.762742 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:36.262368 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:36.762757 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:37.262702 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:37.761870 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:38.261385 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:38.762004 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:39.262085 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:39.761730 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:40.262338 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:40.762789 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:41.262081 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:41.762774 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:42.262486 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:42.762083 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:43.261778 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:43.762181 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:44.262392 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:44.761920 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:45.261733 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:45.761804 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:46.262189 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:46.763532 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:47.261919 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:47.761881 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:48.261826 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:48.761555 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:49.262398 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:49.762967 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:50.262515 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:50.762428 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:51.261820 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:51.762266 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:52.261729 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:52.801414 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:53.261951 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:53.762368 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:54.262600 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:54.762824 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:55.262703 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:55.762813 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:56.262775 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:56.801182 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:57.261581 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:57.761787 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:58.261641 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:58.762492 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:59.262485 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:16:59.762599 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:00.300638 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:00.763305 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:01.262535 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:01.762381 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:02.262282 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:02.806444 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:03.262221 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:03.762882 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:04.262358 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:04.802543 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:05.262574 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:05.762517 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:06.262102 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:06.801235 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:07.261784 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:07.761972 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:08.262216 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:08.761950 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:09.262010 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:09.762167 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:10.262324 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:10.762151 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:11.262478 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:11.761848 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:12.262808 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:12.762111 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:13.262647 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:13.762576 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:14.261735 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:14.762335 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:15.261817 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:15.762708 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:16.262913 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:16.762599 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:17.262527 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:17.762032 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:18.262178 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:18.762205 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:19.262540 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:19.761815 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:20.262800 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:20.762394 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:21.262706 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:21.762634 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:22.262317 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:22.762496 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:23.261839 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:23.761767 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:24.262513 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:24.761999 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:25.262641 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:25.762698 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:26.261819 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:26.762192 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:27.261783 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:27.761755 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:28.262597 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:28.762377 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:29.261727 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:29.762305 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:30.261923 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:30.762582 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:31.261969 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:31.762344 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:32.262140 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:32.762533 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:33.261654 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:33.762751 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:34.261802 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:34.761579 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:35.262294 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:35.762579 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:36.262010 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:36.762079 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:37.262245 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:37.762537 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:38.261989 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:38.762201 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:39.262099 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:39.762661 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:40.262571 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:40.762185 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:41.261923 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:41.762237 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:42.262337 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:42.762337 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:43.261932 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:43.762516 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:44.261773 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:44.762001 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:45.262307 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:45.762409 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:46.262507 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:46.761606 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:47.262091 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:47.762606 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:48.262015 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:48.761960 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:49.261777 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:49.761990 501593 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I1211 23:17:50.258959 501593 kapi.go:81] temporary error: getting Pods with label selector "kubernetes.io/minikube-addons=registry" : [client rate limiter Wait returned an error: context deadline exceeded]
I1211 23:17:50.258992 501593 kapi.go:107] duration metric: took 6m0.000724651s to wait for kubernetes.io/minikube-addons=registry ...
W1211 23:17:50.259108 501593 out.go:270] ! Enabling 'registry' returned an error: running callbacks: [waiting for kubernetes.io/minikube-addons=registry pods: context deadline exceeded]
I1211 23:17:57.196610 501593 kapi.go:81] temporary error: getting Pods with label selector "kubernetes.io/minikube-addons=gcp-auth" : [client rate limiter Wait returned an error: context deadline exceeded]
I1211 23:17:57.196642 501593 kapi.go:107] duration metric: took 6m0.000415577s to wait for kubernetes.io/minikube-addons=gcp-auth ...
W1211 23:17:57.196734 501593 out.go:270] ! Enabling 'gcp-auth' returned an error: running callbacks: [waiting for kubernetes.io/minikube-addons=gcp-auth pods: context deadline exceeded]
I1211 23:17:57.198520 501593 out.go:177] * Enabled addons: nvidia-device-plugin, amd-gpu-device-plugin, cloud-spanner, storage-provisioner, default-storageclass, metrics-server, yakd, inspektor-gadget, volcano, volumesnapshots, csi-hostpath-driver
I1211 23:17:57.200054 501593 addons.go:510] duration metric: took 6m7.935128851s for enable addons: enabled=[nvidia-device-plugin amd-gpu-device-plugin cloud-spanner storage-provisioner default-storageclass metrics-server yakd inspektor-gadget volcano volumesnapshots csi-hostpath-driver]
I1211 23:17:57.200106 501593 start.go:246] waiting for cluster config update ...
I1211 23:17:57.200133 501593 start.go:255] writing updated cluster config ...
I1211 23:17:57.200474 501593 exec_runner.go:51] Run: rm -f paused
I1211 23:17:57.250720 501593 start.go:600] kubectl: 1.32.0, cluster: 1.31.2 (minor skew: 1)
I1211 23:17:57.252754 501593 out.go:177] * Done! kubectl is now configured to use "minikube" cluster and "default" namespace by default
==> Docker <==
-- Logs begin at Tue 2024-10-29 03:28:06 UTC, end at Wed 2024-12-11 23:23:58 UTC. --
Dec 11 23:17:59 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:17:59.763794058Z" level=error msg="Handler for POST /v1.43/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=50b303ff2091d816 traceID=417db1cbb20094198f694dcb2804f270
Dec 11 23:18:00 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:18:00.575129265Z" level=warning msg="reference for unknown type: " digest="sha256:5084bdd1edee7c7d676fc1713e02051b975f69839be4a8278a59d4a7a59ad8de" remote="docker.io/volcanosh/vc-controller-manager@sha256:5084bdd1edee7c7d676fc1713e02051b975f69839be4a8278a59d4a7a59ad8de" spanID=fd310ec282b0e527 traceID=c4edfb1caf185423af5c7c9fd3494abc
Dec 11 23:18:00 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:18:00.756714199Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=fd310ec282b0e527 traceID=c4edfb1caf185423af5c7c9fd3494abc
Dec 11 23:18:00 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:18:00.758341855Z" level=error msg="Handler for POST /v1.43/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=fd310ec282b0e527 traceID=c4edfb1caf185423af5c7c9fd3494abc
Dec 11 23:18:02 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:18:02.575830207Z" level=warning msg="reference for unknown type: " digest="sha256:f56fecf20af14dd9ebea12eb6390014b51a44c552742d4e15d25876438c46e1e" remote="docker.io/volcanosh/vc-webhook-manager@sha256:f56fecf20af14dd9ebea12eb6390014b51a44c552742d4e15d25876438c46e1e" spanID=6af93d76f6009a52 traceID=a8f55cdb54a5a50b1d1256be421aa156
Dec 11 23:18:02 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:18:02.757010904Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=6af93d76f6009a52 traceID=a8f55cdb54a5a50b1d1256be421aa156
Dec 11 23:18:02 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:18:02.758999147Z" level=error msg="Handler for POST /v1.43/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=6af93d76f6009a52 traceID=a8f55cdb54a5a50b1d1256be421aa156
Dec 11 23:22:51 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:22:51.593456632Z" level=warning msg="reference for unknown type: " digest="sha256:f3835498cf2274e0a07c32b38c166c05a876f8eb776d756cc06805e599a3ba5f" remote="docker.io/rocm/k8s-device-plugin@sha256:f3835498cf2274e0a07c32b38c166c05a876f8eb776d756cc06805e599a3ba5f" spanID=8ccf4bb73928d5d2 traceID=8ff73bf4626dc9a11aa2dd9d1670df5b
Dec 11 23:22:51 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:22:51.776064015Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=8ccf4bb73928d5d2 traceID=8ff73bf4626dc9a11aa2dd9d1670df5b
Dec 11 23:22:51 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:22:51.778229782Z" level=error msg="Handler for POST /v1.43/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=8ccf4bb73928d5d2 traceID=8ff73bf4626dc9a11aa2dd9d1670df5b
Dec 11 23:22:52 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:22:52.572474511Z" level=warning msg="reference for unknown type: " digest="sha256:c5414196116a2266ad097b0468833b73ef1d6c7922241115fe203fb826381624" remote="docker.io/marcnuri/yakd@sha256:c5414196116a2266ad097b0468833b73ef1d6c7922241115fe203fb826381624" spanID=6ed9c74e30d2f03e traceID=8a3b76793e1b69e92676d662d76d4249
Dec 11 23:22:52 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:22:52.750806402Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=6ed9c74e30d2f03e traceID=8a3b76793e1b69e92676d662d76d4249
Dec 11 23:22:52 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:22:52.753353616Z" level=error msg="Handler for POST /v1.43/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=6ed9c74e30d2f03e traceID=8a3b76793e1b69e92676d662d76d4249
Dec 11 23:22:57 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:22:57.574286928Z" level=warning msg="reference for unknown type: " digest="sha256:b618879e2ff768f69fb94084f0c644d2278d31e4fa17c898b8763fc7e1648882" remote="docker.io/volcanosh/vc-scheduler@sha256:b618879e2ff768f69fb94084f0c644d2278d31e4fa17c898b8763fc7e1648882" spanID=e19a0553b164f397 traceID=fca56cb744afa44b916ef19b643a0fbb
Dec 11 23:22:57 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:22:57.754126670Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=e19a0553b164f397 traceID=fca56cb744afa44b916ef19b643a0fbb
Dec 11 23:22:57 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:22:57.756319352Z" level=error msg="Handler for POST /v1.43/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=e19a0553b164f397 traceID=fca56cb744afa44b916ef19b643a0fbb
Dec 11 23:23:02 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:23:02.574615342Z" level=warning msg="reference for unknown type: " digest="sha256:5084bdd1edee7c7d676fc1713e02051b975f69839be4a8278a59d4a7a59ad8de" remote="docker.io/volcanosh/vc-controller-manager@sha256:5084bdd1edee7c7d676fc1713e02051b975f69839be4a8278a59d4a7a59ad8de" spanID=6631c76e4da82eb6 traceID=9edc25c5d989fd79a9af2efdb98bb61c
Dec 11 23:23:02 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:23:02.751636726Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=6631c76e4da82eb6 traceID=9edc25c5d989fd79a9af2efdb98bb61c
Dec 11 23:23:02 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:23:02.753490455Z" level=error msg="Handler for POST /v1.43/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=6631c76e4da82eb6 traceID=9edc25c5d989fd79a9af2efdb98bb61c
Dec 11 23:23:10 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:23:10.592241822Z" level=warning msg="reference for unknown type: " digest="sha256:543dade69668e02e5768d7ea2b0aa4fae6aa7384c9a5a8dbecc2be5136079ddb" remote="docker.io/library/registry@sha256:543dade69668e02e5768d7ea2b0aa4fae6aa7384c9a5a8dbecc2be5136079ddb" spanID=8435531869ff0f33 traceID=e36bb8e4c05e7490f244bef77664a7e6
Dec 11 23:23:10 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:23:10.774451566Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=8435531869ff0f33 traceID=e36bb8e4c05e7490f244bef77664a7e6
Dec 11 23:23:10 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:23:10.776511315Z" level=error msg="Handler for POST /v1.43/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=8435531869ff0f33 traceID=e36bb8e4c05e7490f244bef77664a7e6
Dec 11 23:23:13 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:23:13.576104038Z" level=warning msg="reference for unknown type: " digest="sha256:f56fecf20af14dd9ebea12eb6390014b51a44c552742d4e15d25876438c46e1e" remote="docker.io/volcanosh/vc-webhook-manager@sha256:f56fecf20af14dd9ebea12eb6390014b51a44c552742d4e15d25876438c46e1e" spanID=78e8fc3a6fe70d77 traceID=cc09efba112e39a2643cd67e365b483f
Dec 11 23:23:13 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:23:13.757734698Z" level=error msg="Not continuing with pull after error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=78e8fc3a6fe70d77 traceID=cc09efba112e39a2643cd67e365b483f
Dec 11 23:23:13 ubuntu-20-agent-15 dockerd[501831]: time="2024-12-11T23:23:13.759895502Z" level=error msg="Handler for POST /v1.43/images/create returned error: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" spanID=78e8fc3a6fe70d77 traceID=cc09efba112e39a2643cd67e365b483f
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
7e564d66c12c7 registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f 11 minutes ago Running csi-snapshotter 0 48622860d3070 csi-hostpathplugin-8jhdx
d9b3aa124764d registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 11 minutes ago Running csi-provisioner 0 48622860d3070 csi-hostpathplugin-8jhdx
6d190aca55243 registry.k8s.io/sig-storage/livenessprobe@sha256:cacee2b5c36dd59d4c7e8469c05c9e4ef53ecb2df9025fa8c10cdaf61bce62f0 11 minutes ago Running liveness-probe 0 48622860d3070 csi-hostpathplugin-8jhdx
851ac2bd9d6f8 registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 11 minutes ago Running hostpath 0 48622860d3070 csi-hostpathplugin-8jhdx
a49158844ee5d registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f1c25991bac2fbb7f5fcf91ed9438df31e30edee6bed5a780464238aa09ad24c 11 minutes ago Running node-driver-registrar 0 48622860d3070 csi-hostpathplugin-8jhdx
0dcb7a3ab3e0b registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 11 minutes ago Running csi-resizer 0 4c793be93fdb4 csi-hostpath-resizer-0
56132babf3943 registry.k8s.io/sig-storage/csi-external-health-monitor-controller@sha256:80b9ba94aa2afe24553d69bd165a6a51552d1582d68618ec00d3b804a7d9193c 11 minutes ago Running csi-external-health-monitor-controller 0 48622860d3070 csi-hostpathplugin-8jhdx
a067f9ff6d289 registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b 11 minutes ago Running csi-attacher 0 036363927dc34 csi-hostpath-attacher-0
065be7a27305a registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 11 minutes ago Running volume-snapshot-controller 0 c3be735af8686 snapshot-controller-56fcc65765-wzlbp
62111652365d0 registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 11 minutes ago Running volume-snapshot-controller 0 fbeb2bda579f6 snapshot-controller-56fcc65765-x2c66
7ca97f6933038 ghcr.io/inspektor-gadget/inspektor-gadget@sha256:102216c464091f4d9e07d825eba0b681f0d7e0ce108957028443441d3843d1fa 11 minutes ago Running gadget 0 a5b33c5819570 gadget-v7pmc
6a0e2e109960b gcr.io/k8s-minikube/kube-registry-proxy@sha256:60ab3508367ad093b4b891231572577371a29f838d61e64d7f7d093d961c862c 11 minutes ago Running registry-proxy 0 b092e69910f93 registry-proxy-rqnmj
a1f881525692e registry.k8s.io/metrics-server/metrics-server@sha256:ffcb2bf004d6aa0a17d90e0247cf94f2865c8901dcab4427034c341951c239f9 11 minutes ago Running metrics-server 0 ce2bb2eb5ca55 metrics-server-84c5f94fbc-r5cpf
97cd0a86a146d gcr.io/cloud-spanner-emulator/emulator@sha256:8fae494dce81f5167703b16f943dda76109195b8fc06bad1f3e952fe90a0b8d0 11 minutes ago Running cloud-spanner-emulator 0 7a7a5805926bc cloud-spanner-emulator-dc5db94f4-5z2pk
291ceb2235490 nvcr.io/nvidia/k8s-device-plugin@sha256:7089559ce6153018806857f5049085bae15b3bf6f1c8bd19d8b12f707d087dea 11 minutes ago Running nvidia-device-plugin-ctr 0 1a595ec7a4dd4 nvidia-device-plugin-daemonset-tz4pr
f9e40c5aefb76 6e38f40d628db 12 minutes ago Running storage-provisioner 0 43eaab821b149 storage-provisioner
823833b5030eb c69fa2e9cbf5f 12 minutes ago Running coredns 0 a89283b81d6fb coredns-7c65d6cfc9-r7h74
261999dc50370 505d571f5fd56 12 minutes ago Running kube-proxy 0 2899f26e9c1ec kube-proxy-9r5nc
3109488ffe363 9499c9960544e 12 minutes ago Running kube-apiserver 0 5f1f1d0d1b371 kube-apiserver-ubuntu-20-agent-15
991a0259d3639 2e96e5913fc06 12 minutes ago Running etcd 0 03c4eca48d965 etcd-ubuntu-20-agent-15
cf07579765e59 847c7bc1a5418 12 minutes ago Running kube-scheduler 0 b89522324bbd3 kube-scheduler-ubuntu-20-agent-15
836e9d218442c 0486b6c53a1b5 12 minutes ago Running kube-controller-manager 0 469db204464dc kube-controller-manager-ubuntu-20-agent-15
==> coredns [823833b5030e] <==
[INFO] 10.244.0.7:37870 - 14688 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 85 false 1232" NXDOMAIN qr,aa,rd 167 0.000083899s
[INFO] 10.244.0.7:37870 - 63751 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 81 false 1232" NXDOMAIN qr,aa,rd 163 0.000085709s
[INFO] 10.244.0.7:37870 - 60476 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 81 false 1232" NXDOMAIN qr,aa,rd 163 0.000122591s
[INFO] 10.244.0.7:37870 - 38663 "AAAA IN registry.kube-system.svc.cluster.local.us-central1-a.c.k8s-minikube.internal. udp 105 false 1232" NXDOMAIN qr,aa,rd,ra 204 0.000079557s
[INFO] 10.244.0.7:37870 - 51646 "A IN registry.kube-system.svc.cluster.local.us-central1-a.c.k8s-minikube.internal. udp 105 false 1232" NXDOMAIN qr,aa,rd,ra 204 0.000116305s
[INFO] 10.244.0.7:37870 - 27501 "AAAA IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 91 false 1232" NXDOMAIN qr,aa,rd,ra 185 0.00008089s
[INFO] 10.244.0.7:37870 - 29823 "A IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 91 false 1232" NXDOMAIN qr,aa,rd,ra 185 0.000114519s
[INFO] 10.244.0.7:37870 - 15395 "A IN registry.kube-system.svc.cluster.local.google.internal. udp 83 false 1232" NXDOMAIN qr,aa,rd,ra 177 0.000066605s
[INFO] 10.244.0.7:37870 - 43620 "AAAA IN registry.kube-system.svc.cluster.local.google.internal. udp 83 false 1232" NXDOMAIN qr,aa,rd,ra 177 0.000068736s
[INFO] 10.244.0.7:37870 - 36987 "A IN registry.kube-system.svc.cluster.local. udp 67 false 1232" NOERROR qr,aa,rd 110 0.000092461s
[INFO] 10.244.0.7:37870 - 14979 "AAAA IN registry.kube-system.svc.cluster.local. udp 67 false 1232" NOERROR qr,aa,rd 149 0.000115246s
[INFO] 10.244.0.7:55738 - 53286 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 109 false 1232" NXDOMAIN qr,aa,rd 179 0.000157529s
[INFO] 10.244.0.7:55738 - 42552 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 109 false 1232" NXDOMAIN qr,aa,rd 179 0.000218468s
[INFO] 10.244.0.7:55738 - 35523 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 85 false 1232" NXDOMAIN qr,aa,rd 167 0.000067509s
[INFO] 10.244.0.7:55738 - 27601 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 85 false 1232" NXDOMAIN qr,aa,rd 167 0.000106898s
[INFO] 10.244.0.7:55738 - 45245 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 81 false 1232" NXDOMAIN qr,aa,rd 163 0.000064718s
[INFO] 10.244.0.7:55738 - 53255 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 81 false 1232" NXDOMAIN qr,aa,rd 163 0.000102582s
[INFO] 10.244.0.7:55738 - 20070 "A IN registry.kube-system.svc.cluster.local.us-central1-a.c.k8s-minikube.internal. udp 105 false 1232" NXDOMAIN qr,aa,rd,ra 204 0.00009411s
[INFO] 10.244.0.7:55738 - 4096 "AAAA IN registry.kube-system.svc.cluster.local.us-central1-a.c.k8s-minikube.internal. udp 105 false 1232" NXDOMAIN qr,aa,rd,ra 204 0.000101036s
[INFO] 10.244.0.7:55738 - 42653 "AAAA IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 91 false 1232" NXDOMAIN qr,aa,rd,ra 185 0.000067561s
[INFO] 10.244.0.7:55738 - 42457 "A IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 91 false 1232" NXDOMAIN qr,aa,rd,ra 185 0.0000777s
[INFO] 10.244.0.7:55738 - 26538 "A IN registry.kube-system.svc.cluster.local.google.internal. udp 83 false 1232" NXDOMAIN qr,aa,rd,ra 177 0.000042668s
[INFO] 10.244.0.7:55738 - 27520 "AAAA IN registry.kube-system.svc.cluster.local.google.internal. udp 83 false 1232" NXDOMAIN qr,aa,rd,ra 177 0.000079206s
[INFO] 10.244.0.7:55738 - 31310 "A IN registry.kube-system.svc.cluster.local. udp 67 false 1232" NOERROR qr,aa,rd 110 0.000089755s
[INFO] 10.244.0.7:55738 - 30258 "AAAA IN registry.kube-system.svc.cluster.local. udp 67 false 1232" NOERROR qr,aa,rd 149 0.000124881s
==> describe nodes <==
Name: ubuntu-20-agent-15
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=ubuntu-20-agent-15
kubernetes.io/os=linux
minikube.k8s.io/commit=7fa9733e2a94b345defa62bfa3d9dc225cfbd458
minikube.k8s.io/name=minikube
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_12_11T23_11_44_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=ubuntu-20-agent-15
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"ubuntu-20-agent-15"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 11 Dec 2024 23:11:41 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ubuntu-20-agent-15
AcquireTime: <unset>
RenewTime: Wed, 11 Dec 2024 23:23:57 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 11 Dec 2024 23:22:58 +0000 Wed, 11 Dec 2024 23:11:40 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 11 Dec 2024 23:22:58 +0000 Wed, 11 Dec 2024 23:11:40 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 11 Dec 2024 23:22:58 +0000 Wed, 11 Dec 2024 23:11:40 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 11 Dec 2024 23:22:58 +0000 Wed, 11 Dec 2024 23:11:41 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 10.128.15.240
Hostname: ubuntu-20-agent-15
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32859308Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32859308Ki
pods: 110
System Info:
Machine ID: 591c9f1229383743e2bfc56a050d43d1
System UUID: b37db8a4-1476-dab1-7f0f-0d5cfb4ed197
Boot ID: 1a666141-538b-4607-aea4-3c5969285a4e
Kernel Version: 5.15.0-1071-gcp
OS Image: Ubuntu 20.04.6 LTS
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://27.4.0
Kubelet Version: v1.31.2
Kube-Proxy Version: v1.31.2
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (24 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-dc5db94f4-5z2pk 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
gadget gadget-v7pmc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system amd-gpu-device-plugin-smq5q 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system coredns-7c65d6cfc9-r7h74 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 12m
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system csi-hostpathplugin-8jhdx 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system etcd-ubuntu-20-agent-15 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 12m
kube-system kube-apiserver-ubuntu-20-agent-15 250m (3%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-controller-manager-ubuntu-20-agent-15 200m (2%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-proxy-9r5nc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-scheduler-ubuntu-20-agent-15 100m (1%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system metrics-server-84c5f94fbc-r5cpf 100m (1%) 0 (0%) 200Mi (0%) 0 (0%) 12m
kube-system nvidia-device-plugin-daemonset-tz4pr 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system registry-5cc95cd69-68q8r 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system registry-proxy-rqnmj 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system snapshot-controller-56fcc65765-wzlbp 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system snapshot-controller-56fcc65765-x2c66 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
volcano-system volcano-admission-5874dfdd79-gdw5h 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
volcano-system volcano-admission-init-4krgh 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
volcano-system volcano-controllers-789ffc5785-l4845 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
volcano-system volcano-scheduler-6c9778cbdf-48p4z 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
yakd-dashboard yakd-dashboard-67d98fc6b-8k4bb 0 (0%) 0 (0%) 128Mi (0%) 256Mi (0%) 12m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 850m (10%) 0 (0%)
memory 498Mi (1%) 426Mi (1%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 12m kube-proxy
Normal Starting 12m kubelet Starting kubelet.
Warning CgroupV1 12m kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 12m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 12m kubelet Node ubuntu-20-agent-15 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 12m kubelet Node ubuntu-20-agent-15 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 12m kubelet Node ubuntu-20-agent-15 status is now: NodeHasSufficientPID
Normal RegisteredNode 12m node-controller Node ubuntu-20-agent-15 event: Registered Node ubuntu-20-agent-15 in Controller
==> dmesg <==
[ +0.000004] ll header: 00000000: ff ff ff ff ff ff c2 db 43 f6 1c 1f 08 06
[Dec11 23:11] IPv4: martian source 10.244.0.1 from 10.244.0.2, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 0a 49 40 aa b9 00 08 06
[ +30.396973] IPv4: martian source 10.244.0.1 from 10.244.0.3, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff aa 5f 0f e5 5c 11 08 06
[ +0.072530] IPv4: martian source 10.244.0.1 from 10.244.0.4, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff fe ea 5f b4 37 b9 08 06
[Dec11 23:12] IPv4: martian source 10.244.0.1 from 10.244.0.10, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff 3e d8 25 e8 c7 e1 08 06
[ +0.593811] IPv4: martian source 10.244.0.1 from 10.244.0.7, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 52 05 63 c6 56 b5 08 06
[ +0.000645] IPv4: martian source 10.244.0.7 from 10.244.0.4, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff fe ea 5f b4 37 b9 08 06
[ +3.854124] IPv4: martian source 10.244.0.1 from 10.244.0.13, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff 32 47 28 f6 09 38 08 06
[ +0.019312] IPv4: martian source 10.244.0.1 from 10.244.0.14, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 8a e2 2c 6b 6e ff 08 06
[ +0.125564] IPv4: martian source 10.244.0.1 from 10.244.0.12, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff 8a 85 43 9d 71 35 08 06
[ +5.327454] IPv4: martian source 10.244.0.1 from 10.244.0.19, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff ce 90 d7 41 d9 e2 08 06
[ +0.075469] IPv4: martian source 10.244.0.1 from 10.244.0.20, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff d2 d9 fe 66 63 e8 08 06
[ +0.192468] IPv4: martian source 10.244.0.1 from 10.244.0.18, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 4a 4c 5b e7 54 61 08 06
==> etcd [991a0259d363] <==
{"level":"info","ts":"2024-12-11T23:11:40.124674Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"13f0e7e2a3d8cc98 received MsgPreVoteResp from 13f0e7e2a3d8cc98 at term 1"}
{"level":"info","ts":"2024-12-11T23:11:40.124690Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"13f0e7e2a3d8cc98 became candidate at term 2"}
{"level":"info","ts":"2024-12-11T23:11:40.124696Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"13f0e7e2a3d8cc98 received MsgVoteResp from 13f0e7e2a3d8cc98 at term 2"}
{"level":"info","ts":"2024-12-11T23:11:40.124705Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"13f0e7e2a3d8cc98 became leader at term 2"}
{"level":"info","ts":"2024-12-11T23:11:40.124712Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 13f0e7e2a3d8cc98 elected leader 13f0e7e2a3d8cc98 at term 2"}
{"level":"info","ts":"2024-12-11T23:11:40.125750Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"13f0e7e2a3d8cc98","local-member-attributes":"{Name:ubuntu-20-agent-15 ClientURLs:[https://10.128.15.240:2379]}","request-path":"/0/members/13f0e7e2a3d8cc98/attributes","cluster-id":"3112ce273fbe8262","publish-timeout":"7s"}
{"level":"info","ts":"2024-12-11T23:11:40.125794Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-12-11T23:11:40.125815Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-12-11T23:11:40.125976Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-12-11T23:11:40.126004Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-12-11T23:11:40.126101Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-12-11T23:11:40.126817Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"3112ce273fbe8262","local-member-id":"13f0e7e2a3d8cc98","cluster-version":"3.5"}
{"level":"info","ts":"2024-12-11T23:11:40.126923Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-12-11T23:11:40.126958Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-12-11T23:11:40.127119Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-12-11T23:11:40.127173Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-12-11T23:11:40.127959Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-12-11T23:11:40.128031Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"10.128.15.240:2379"}
{"level":"info","ts":"2024-12-11T23:12:00.384947Z","caller":"traceutil/trace.go:171","msg":"trace[1512558479] linearizableReadLoop","detail":"{readStateIndex:881; appliedIndex:880; }","duration":"104.420081ms","start":"2024-12-11T23:12:00.280499Z","end":"2024-12-11T23:12:00.384919Z","steps":["trace[1512558479] 'read index received' (duration: 44.481985ms)","trace[1512558479] 'applied index is now lower than readState.Index' (duration: 59.937153ms)"],"step_count":2}
{"level":"info","ts":"2024-12-11T23:12:00.385037Z","caller":"traceutil/trace.go:171","msg":"trace[718350892] transaction","detail":"{read_only:false; response_revision:862; number_of_response:1; }","duration":"119.479868ms","start":"2024-12-11T23:12:00.265527Z","end":"2024-12-11T23:12:00.385007Z","steps":["trace[718350892] 'process raft request' (duration: 59.47623ms)","trace[718350892] 'compare' (duration: 59.76659ms)"],"step_count":2}
{"level":"warn","ts":"2024-12-11T23:12:00.385190Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"104.63883ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}
{"level":"info","ts":"2024-12-11T23:12:00.385274Z","caller":"traceutil/trace.go:171","msg":"trace[1181525663] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:862; }","duration":"104.771848ms","start":"2024-12-11T23:12:00.280489Z","end":"2024-12-11T23:12:00.385261Z","steps":["trace[1181525663] 'agreement among raft nodes before linearized reading' (duration: 104.530072ms)"],"step_count":1}
{"level":"info","ts":"2024-12-11T23:21:40.144178Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1526}
{"level":"info","ts":"2024-12-11T23:21:40.169157Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1526,"took":"24.463555ms","hash":585884205,"current-db-size-bytes":7491584,"current-db-size":"7.5 MB","current-db-size-in-use-bytes":3567616,"current-db-size-in-use":"3.6 MB"}
{"level":"info","ts":"2024-12-11T23:21:40.169228Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":585884205,"revision":1526,"compact-revision":-1}
==> kernel <==
23:23:58 up 2:06, 0 users, load average: 0.24, 5.82, 31.09
Linux ubuntu-20-agent-15 5.15.0-1071-gcp #79~20.04.1-Ubuntu SMP Thu Oct 17 21:59:34 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
PRETTY_NAME="Ubuntu 20.04.6 LTS"
==> kube-apiserver [3109488ffe36] <==
W1211 23:20:00.282525 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.163.239:443: connect: connection refused
E1211 23:20:00.282614 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.163.239:443: connect: connection refused" logger="UnhandledError"
W1211 23:20:00.284187 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.109.163.137:443: connect: connection refused
W1211 23:20:00.284189 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.109.163.137:443: connect: connection refused
W1211 23:21:00.292483 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.163.239:443: connect: connection refused
E1211 23:21:00.292546 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.163.239:443: connect: connection refused" logger="UnhandledError"
W1211 23:21:00.292483 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.163.239:443: connect: connection refused
E1211 23:21:00.292576 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.163.239:443: connect: connection refused" logger="UnhandledError"
W1211 23:21:00.295040 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.109.163.137:443: connect: connection refused
W1211 23:21:00.295074 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.109.163.137:443: connect: connection refused
W1211 23:22:00.303761 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.163.239:443: connect: connection refused
E1211 23:22:00.303809 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.163.239:443: connect: connection refused" logger="UnhandledError"
W1211 23:22:00.303843 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.163.239:443: connect: connection refused
E1211 23:22:00.303880 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.163.239:443: connect: connection refused" logger="UnhandledError"
W1211 23:22:00.305311 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.109.163.137:443: connect: connection refused
W1211 23:22:00.305458 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.109.163.137:443: connect: connection refused
W1211 23:22:52.643949 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.163.239:443: connect: connection refused
E1211 23:22:52.643987 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.163.239:443: connect: connection refused" logger="UnhandledError"
W1211 23:22:52.645666 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.109.163.137:443: connect: connection refused
W1211 23:23:00.312246 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.163.239:443: connect: connection refused
E1211 23:23:00.312287 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.163.239:443: connect: connection refused" logger="UnhandledError"
W1211 23:23:00.312251 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.105.163.239:443: connect: connection refused
E1211 23:23:00.312320 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.105.163.239:443: connect: connection refused" logger="UnhandledError"
W1211 23:23:00.313919 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.109.163.137:443: connect: connection refused
W1211 23:23:00.313924 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.109.163.137:443: connect: connection refused
==> kube-controller-manager [836e9d218442] <==
E1211 23:21:00.295700 1 job_controller.go:1709] "Unhandled Error" err="Internal error occurred: failed calling webhook \"mutatepod.volcano.sh\": failed to call webhook: Post \"https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s\": dial tcp 10.109.163.137:443: connect: connection refused" logger="UnhandledError"
E1211 23:21:00.295700 1 job_controller.go:1709] "Unhandled Error" err="Internal error occurred: failed calling webhook \"mutatepod.volcano.sh\": failed to call webhook: Post \"https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s\": dial tcp 10.109.163.137:443: connect: connection refused" logger="UnhandledError"
E1211 23:21:00.296923 1 job_controller.go:601] "Unhandled Error" err="syncing job: Internal error occurred: failed calling webhook \"mutatepod.volcano.sh\": failed to call webhook: Post \"https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s\": dial tcp 10.109.163.137:443: connect: connection refused" logger="UnhandledError"
E1211 23:21:00.296929 1 job_controller.go:601] "Unhandled Error" err="syncing job: Internal error occurred: failed calling webhook \"mutatepod.volcano.sh\": failed to call webhook: Post \"https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s\": dial tcp 10.109.163.137:443: connect: connection refused" logger="UnhandledError"
E1211 23:22:00.306042 1 job_controller.go:1709] "Unhandled Error" err="Internal error occurred: failed calling webhook \"mutatepod.volcano.sh\": failed to call webhook: Post \"https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s\": dial tcp 10.109.163.137:443: connect: connection refused" logger="UnhandledError"
E1211 23:22:00.306049 1 job_controller.go:1709] "Unhandled Error" err="Internal error occurred: failed calling webhook \"mutatepod.volcano.sh\": failed to call webhook: Post \"https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s\": dial tcp 10.109.163.137:443: connect: connection refused" logger="UnhandledError"
E1211 23:22:00.307268 1 job_controller.go:601] "Unhandled Error" err="syncing job: Internal error occurred: failed calling webhook \"mutatepod.volcano.sh\": failed to call webhook: Post \"https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s\": dial tcp 10.109.163.137:443: connect: connection refused" logger="UnhandledError"
E1211 23:22:00.307273 1 job_controller.go:601] "Unhandled Error" err="syncing job: Internal error occurred: failed calling webhook \"mutatepod.volcano.sh\": failed to call webhook: Post \"https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s\": dial tcp 10.109.163.137:443: connect: connection refused" logger="UnhandledError"
I1211 23:22:52.646424 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-c684cb797" duration="7.012779ms"
E1211 23:22:52.646462 1 replica_set.go:560] "Unhandled Error" err="sync \"gcp-auth/gcp-auth-c684cb797\" failed with Internal error occurred: failed calling webhook \"mutatepod.volcano.sh\": failed to call webhook: Post \"https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s\": dial tcp 10.109.163.137:443: connect: connection refused" logger="UnhandledError"
I1211 23:22:58.792796 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ubuntu-20-agent-15"
E1211 23:23:00.314654 1 job_controller.go:1709] "Unhandled Error" err="Internal error occurred: failed calling webhook \"mutatepod.volcano.sh\": failed to call webhook: Post \"https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s\": dial tcp 10.109.163.137:443: connect: connection refused" logger="UnhandledError"
E1211 23:23:00.314691 1 job_controller.go:1709] "Unhandled Error" err="Internal error occurred: failed calling webhook \"mutatepod.volcano.sh\": failed to call webhook: Post \"https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s\": dial tcp 10.109.163.137:443: connect: connection refused" logger="UnhandledError"
E1211 23:23:00.315835 1 job_controller.go:601] "Unhandled Error" err="syncing job: Internal error occurred: failed calling webhook \"mutatepod.volcano.sh\": failed to call webhook: Post \"https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s\": dial tcp 10.109.163.137:443: connect: connection refused" logger="UnhandledError"
E1211 23:23:00.315867 1 job_controller.go:601] "Unhandled Error" err="syncing job: Internal error occurred: failed calling webhook \"mutatepod.volcano.sh\": failed to call webhook: Post \"https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s\": dial tcp 10.109.163.137:443: connect: connection refused" logger="UnhandledError"
I1211 23:23:03.493679 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="yakd-dashboard/yakd-dashboard-67d98fc6b" duration="102.288µs"
I1211 23:23:08.493566 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="volcano-system/volcano-scheduler-6c9778cbdf" duration="76.794µs"
I1211 23:23:15.492815 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="volcano-system/volcano-controllers-789ffc5785" duration="64.978µs"
I1211 23:23:18.494372 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="yakd-dashboard/yakd-dashboard-67d98fc6b" duration="108.63µs"
I1211 23:23:21.492404 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="volcano-system/volcano-scheduler-6c9778cbdf" duration="78.215µs"
I1211 23:23:25.492938 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/registry-5cc95cd69" duration="114.928µs"
I1211 23:23:26.491426 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="1s"
I1211 23:23:29.492032 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="volcano-system/volcano-controllers-789ffc5785" duration="66.113µs"
I1211 23:23:39.493430 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="1s"
I1211 23:23:39.503892 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/registry-5cc95cd69" duration="132.283µs"
==> kube-proxy [261999dc5037] <==
I1211 23:11:49.781419 1 server_linux.go:66] "Using iptables proxy"
I1211 23:11:50.054842 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["10.128.15.240"]
E1211 23:11:50.054933 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I1211 23:11:50.162652 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I1211 23:11:50.162722 1 server_linux.go:169] "Using iptables Proxier"
I1211 23:11:50.175181 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I1211 23:11:50.178844 1 server.go:483] "Version info" version="v1.31.2"
I1211 23:11:50.198268 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1211 23:11:50.205163 1 config.go:199] "Starting service config controller"
I1211 23:11:50.205204 1 shared_informer.go:313] Waiting for caches to sync for service config
I1211 23:11:50.205241 1 config.go:105] "Starting endpoint slice config controller"
I1211 23:11:50.205247 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I1211 23:11:50.206028 1 config.go:328] "Starting node config controller"
I1211 23:11:50.206040 1 shared_informer.go:313] Waiting for caches to sync for node config
I1211 23:11:50.305983 1 shared_informer.go:320] Caches are synced for endpoint slice config
I1211 23:11:50.306189 1 shared_informer.go:320] Caches are synced for service config
I1211 23:11:50.306528 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [cf07579765e5] <==
W1211 23:11:41.041533 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E1211 23:11:41.041561 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W1211 23:11:41.926935 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E1211 23:11:41.926993 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W1211 23:11:41.960944 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E1211 23:11:41.960988 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
W1211 23:11:41.977762 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E1211 23:11:41.977821 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W1211 23:11:42.004328 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E1211 23:11:42.004370 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W1211 23:11:42.010796 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E1211 23:11:42.010841 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W1211 23:11:42.049837 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E1211 23:11:42.049911 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W1211 23:11:42.067537 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E1211 23:11:42.067597 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W1211 23:11:42.114216 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E1211 23:11:42.114266 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W1211 23:11:42.126146 1 reflector.go:561] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E1211 23:11:42.126194 1 reflector.go:158] "Unhandled Error" err="runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
W1211 23:11:42.131613 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E1211 23:11:42.131659 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W1211 23:11:42.139168 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E1211 23:11:42.139224 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
I1211 23:11:45.338756 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
-- Logs begin at Tue 2024-10-29 03:28:06 UTC, end at Wed 2024-12-11 23:23:58 UTC. --
Dec 11 23:23:13 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:13.760579 503089 kuberuntime_image.go:55] "Failed to pull image" err="Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" image="docker.io/volcanosh/vc-webhook-manager:v1.10.0@sha256:f56fecf20af14dd9ebea12eb6390014b51a44c552742d4e15d25876438c46e1e"
Dec 11 23:23:13 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:13.760712 503089 kuberuntime_manager.go:1274] "Unhandled Error" err="container &Container{Name:main,Image:docker.io/volcanosh/vc-webhook-manager:v1.10.0@sha256:f56fecf20af14dd9ebea12eb6390014b51a44c552742d4e15d25876438c46e1e,Command:[./gen-admission-secret.sh --service volcano-admission-service --namespace volcano-system --secret volcano-admission-secret],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-qtt4k,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePoli
cy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod volcano-admission-init-4krgh_volcano-system(5f531011-e57b-45be-8dcd-6e40fe68364c): ErrImagePull: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" logger="UnhandledError"
Dec 11 23:23:13 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:13.761968 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with ErrImagePull: \"Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit\"" pod="volcano-system/volcano-admission-init-4krgh" podUID="5f531011-e57b-45be-8dcd-6e40fe68364c"
Dec 11 23:23:15 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:15.484070 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"volcano-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/volcanosh/vc-controller-manager:v1.10.0@sha256:5084bdd1edee7c7d676fc1713e02051b975f69839be4a8278a59d4a7a59ad8de\\\"\"" pod="volcano-system/volcano-controllers-789ffc5785-l4845" podUID="48bb1a47-6ed8-43a3-a88d-c377745e84fe"
Dec 11 23:23:17 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:17.483221 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"amd-gpu-device-plugin\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/rocm/k8s-device-plugin:1.25.2.8@sha256:f3835498cf2274e0a07c32b38c166c05a876f8eb776d756cc06805e599a3ba5f\\\"\"" pod="kube-system/amd-gpu-device-plugin-smq5q" podUID="87724716-9f04-403d-9c59-a8a943541c21"
Dec 11 23:23:18 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:18.484248 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"yakd\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/marcnuri/yakd:0.0.5@sha256:c5414196116a2266ad097b0468833b73ef1d6c7922241115fe203fb826381624\\\"\"" pod="yakd-dashboard/yakd-dashboard-67d98fc6b-8k4bb" podUID="520e954c-c7eb-465b-89de-8b3be10a69ce"
Dec 11 23:23:21 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:21.483437 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"volcano-scheduler\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/volcanosh/vc-scheduler:v1.10.0@sha256:b618879e2ff768f69fb94084f0c644d2278d31e4fa17c898b8763fc7e1648882\\\"\"" pod="volcano-system/volcano-scheduler-6c9778cbdf-48p4z" podUID="e9c3d04e-8237-42f7-8a07-245157f72d6e"
Dec 11 23:23:25 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:25.484084 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/registry:2.8.3@sha256:543dade69668e02e5768d7ea2b0aa4fae6aa7384c9a5a8dbecc2be5136079ddb\\\"\"" pod="kube-system/registry-5cc95cd69-68q8r" podUID="856f7c1e-6ad8-46e8-9b2a-78040325bce0"
Dec 11 23:23:26 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:26.483083 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/volcanosh/vc-webhook-manager:v1.10.0@sha256:f56fecf20af14dd9ebea12eb6390014b51a44c552742d4e15d25876438c46e1e\\\"\"" pod="volcano-system/volcano-admission-init-4krgh" podUID="5f531011-e57b-45be-8dcd-6e40fe68364c"
Dec 11 23:23:29 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:29.483594 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"volcano-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/volcanosh/vc-controller-manager:v1.10.0@sha256:5084bdd1edee7c7d676fc1713e02051b975f69839be4a8278a59d4a7a59ad8de\\\"\"" pod="volcano-system/volcano-controllers-789ffc5785-l4845" podUID="48bb1a47-6ed8-43a3-a88d-c377745e84fe"
Dec 11 23:23:30 ubuntu-20-agent-15 kubelet[503089]: I1211 23:23:30.481195 503089 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/cloud-spanner-emulator-dc5db94f4-5z2pk" secret="" err="secret \"gcp-auth\" not found"
Dec 11 23:23:31 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:31.484293 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"yakd\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/marcnuri/yakd:0.0.5@sha256:c5414196116a2266ad097b0468833b73ef1d6c7922241115fe203fb826381624\\\"\"" pod="yakd-dashboard/yakd-dashboard-67d98fc6b-8k4bb" podUID="520e954c-c7eb-465b-89de-8b3be10a69ce"
Dec 11 23:23:32 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:32.483141 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"amd-gpu-device-plugin\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/rocm/k8s-device-plugin:1.25.2.8@sha256:f3835498cf2274e0a07c32b38c166c05a876f8eb776d756cc06805e599a3ba5f\\\"\"" pod="kube-system/amd-gpu-device-plugin-smq5q" podUID="87724716-9f04-403d-9c59-a8a943541c21"
Dec 11 23:23:36 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:36.483752 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"volcano-scheduler\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/volcanosh/vc-scheduler:v1.10.0@sha256:b618879e2ff768f69fb94084f0c644d2278d31e4fa17c898b8763fc7e1648882\\\"\"" pod="volcano-system/volcano-scheduler-6c9778cbdf-48p4z" podUID="e9c3d04e-8237-42f7-8a07-245157f72d6e"
Dec 11 23:23:39 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:39.484875 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/volcanosh/vc-webhook-manager:v1.10.0@sha256:f56fecf20af14dd9ebea12eb6390014b51a44c552742d4e15d25876438c46e1e\\\"\"" pod="volcano-system/volcano-admission-init-4krgh" podUID="5f531011-e57b-45be-8dcd-6e40fe68364c"
Dec 11 23:23:39 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:39.484913 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/registry:2.8.3@sha256:543dade69668e02e5768d7ea2b0aa4fae6aa7384c9a5a8dbecc2be5136079ddb\\\"\"" pod="kube-system/registry-5cc95cd69-68q8r" podUID="856f7c1e-6ad8-46e8-9b2a-78040325bce0"
Dec 11 23:23:44 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:44.483039 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"volcano-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/volcanosh/vc-controller-manager:v1.10.0@sha256:5084bdd1edee7c7d676fc1713e02051b975f69839be4a8278a59d4a7a59ad8de\\\"\"" pod="volcano-system/volcano-controllers-789ffc5785-l4845" podUID="48bb1a47-6ed8-43a3-a88d-c377745e84fe"
Dec 11 23:23:45 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:45.482983 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"amd-gpu-device-plugin\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/rocm/k8s-device-plugin:1.25.2.8@sha256:f3835498cf2274e0a07c32b38c166c05a876f8eb776d756cc06805e599a3ba5f\\\"\"" pod="kube-system/amd-gpu-device-plugin-smq5q" podUID="87724716-9f04-403d-9c59-a8a943541c21"
Dec 11 23:23:46 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:46.483074 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"yakd\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/marcnuri/yakd:0.0.5@sha256:c5414196116a2266ad097b0468833b73ef1d6c7922241115fe203fb826381624\\\"\"" pod="yakd-dashboard/yakd-dashboard-67d98fc6b-8k4bb" podUID="520e954c-c7eb-465b-89de-8b3be10a69ce"
Dec 11 23:23:50 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:50.483400 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"volcano-scheduler\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/volcanosh/vc-scheduler:v1.10.0@sha256:b618879e2ff768f69fb94084f0c644d2278d31e4fa17c898b8763fc7e1648882\\\"\"" pod="volcano-system/volcano-scheduler-6c9778cbdf-48p4z" podUID="e9c3d04e-8237-42f7-8a07-245157f72d6e"
Dec 11 23:23:51 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:51.483381 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/registry:2.8.3@sha256:543dade69668e02e5768d7ea2b0aa4fae6aa7384c9a5a8dbecc2be5136079ddb\\\"\"" pod="kube-system/registry-5cc95cd69-68q8r" podUID="856f7c1e-6ad8-46e8-9b2a-78040325bce0"
Dec 11 23:23:52 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:52.483989 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/volcanosh/vc-webhook-manager:v1.10.0@sha256:f56fecf20af14dd9ebea12eb6390014b51a44c552742d4e15d25876438c46e1e\\\"\"" pod="volcano-system/volcano-admission-init-4krgh" podUID="5f531011-e57b-45be-8dcd-6e40fe68364c"
Dec 11 23:23:56 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:56.483468 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"amd-gpu-device-plugin\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/rocm/k8s-device-plugin:1.25.2.8@sha256:f3835498cf2274e0a07c32b38c166c05a876f8eb776d756cc06805e599a3ba5f\\\"\"" pod="kube-system/amd-gpu-device-plugin-smq5q" podUID="87724716-9f04-403d-9c59-a8a943541c21"
Dec 11 23:23:56 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:56.483499 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"volcano-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/volcanosh/vc-controller-manager:v1.10.0@sha256:5084bdd1edee7c7d676fc1713e02051b975f69839be4a8278a59d4a7a59ad8de\\\"\"" pod="volcano-system/volcano-controllers-789ffc5785-l4845" podUID="48bb1a47-6ed8-43a3-a88d-c377745e84fe"
Dec 11 23:23:57 ubuntu-20-agent-15 kubelet[503089]: E1211 23:23:57.483838 503089 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"yakd\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/marcnuri/yakd:0.0.5@sha256:c5414196116a2266ad097b0468833b73ef1d6c7922241115fe203fb826381624\\\"\"" pod="yakd-dashboard/yakd-dashboard-67d98fc6b-8k4bb" podUID="520e954c-c7eb-465b-89de-8b3be10a69ce"
==> storage-provisioner [f9e40c5aefb7] <==
I1211 23:11:51.473580 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I1211 23:11:51.485534 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I1211 23:11:51.485583 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I1211 23:11:51.495766 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I1211 23:11:51.496063 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_ubuntu-20-agent-15_3a6b6f63-4f31-4caf-870b-826e367bd507!
I1211 23:11:51.496469 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"aaefebbd-6b5d-4f62-bfd9-fb687ce1fe8e", APIVersion:"v1", ResourceVersion:"553", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' ubuntu-20-agent-15_3a6b6f63-4f31-4caf-870b-826e367bd507 became leader
I1211 23:11:51.596550 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_ubuntu-20-agent-15_3a6b6f63-4f31-4caf-870b-826e367bd507!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p minikube -n minikube
helpers_test.go:261: (dbg) Run: kubectl --context minikube get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: amd-gpu-device-plugin-smq5q registry-5cc95cd69-68q8r volcano-admission-5874dfdd79-gdw5h volcano-admission-init-4krgh volcano-controllers-789ffc5785-l4845 volcano-scheduler-6c9778cbdf-48p4z yakd-dashboard-67d98fc6b-8k4bb
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context minikube describe pod amd-gpu-device-plugin-smq5q registry-5cc95cd69-68q8r volcano-admission-5874dfdd79-gdw5h volcano-admission-init-4krgh volcano-controllers-789ffc5785-l4845 volcano-scheduler-6c9778cbdf-48p4z yakd-dashboard-67d98fc6b-8k4bb
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context minikube describe pod amd-gpu-device-plugin-smq5q registry-5cc95cd69-68q8r volcano-admission-5874dfdd79-gdw5h volcano-admission-init-4krgh volcano-controllers-789ffc5785-l4845 volcano-scheduler-6c9778cbdf-48p4z yakd-dashboard-67d98fc6b-8k4bb: exit status 1 (72.94515ms)
** stderr **
Error from server (NotFound): pods "amd-gpu-device-plugin-smq5q" not found
Error from server (NotFound): pods "registry-5cc95cd69-68q8r" not found
Error from server (NotFound): pods "volcano-admission-5874dfdd79-gdw5h" not found
Error from server (NotFound): pods "volcano-admission-init-4krgh" not found
Error from server (NotFound): pods "volcano-controllers-789ffc5785-l4845" not found
Error from server (NotFound): pods "volcano-scheduler-6c9778cbdf-48p4z" not found
Error from server (NotFound): pods "yakd-dashboard-67d98fc6b-8k4bb" not found
** /stderr **
helpers_test.go:279: kubectl --context minikube describe pod amd-gpu-device-plugin-smq5q registry-5cc95cd69-68q8r volcano-admission-5874dfdd79-gdw5h volcano-admission-init-4krgh volcano-controllers-789ffc5785-l4845 volcano-scheduler-6c9778cbdf-48p4z yakd-dashboard-67d98fc6b-8k4bb: exit status 1
addons_test.go:992: (dbg) Run: out/minikube-linux-amd64 -p minikube addons disable volcano --alsologtostderr -v=1
addons_test.go:992: (dbg) Done: out/minikube-linux-amd64 -p minikube addons disable volcano --alsologtostderr -v=1: (10.836181279s)
--- FAIL: TestAddons/serial/Volcano (372.96s)