=== RUN TestMultiControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:392: (dbg) Run: out/minikube-linux-arm64 profile list --output json
ha_test.go:415: expected profile "ha-278127" in json of 'profile list' to have "Degraded" status but have "Starting" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-278127\",\"Status\":\"Starting\",\"Config\":{\"Name\":\"ha-278127\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1764169655-21974@sha256:5caa2df9c71885b15a10c4769bf4c9c00c1759c0d87b1a7e0b5b61285526245b\",\"Memory\":3072,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"docker\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSS
haresRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.34.1\",\"ClusterName\":\"ha-278127\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.49.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"crio\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.49.2\",\"Port\":8443,\"KubernetesVersion\":\"v1.34.1\",\"ContainerRuntime\":\"crio\",\"ControlPlane\":true,\"Worker\":true},{
\"Name\":\"m02\",\"IP\":\"192.168.49.3\",\"Port\":8443,\"KubernetesVersion\":\"v1.34.1\",\"ContainerRuntime\":\"crio\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.49.5\",\"Port\":0,\"KubernetesVersion\":\"v1.34.1\",\"ContainerRuntime\":\"crio\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"amd-gpu-device-plugin\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kubetail\":false,\"kubevirt\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\
"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"MountString\":\"\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"DisableCoreDNSLog\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"Sta
ticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":true}]}"*. args: "out/minikube-linux-arm64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======> post-mortem[TestMultiControlPlane/serial/DegradedAfterClusterRestart]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======> post-mortem[TestMultiControlPlane/serial/DegradedAfterClusterRestart]: docker inspect <======
helpers_test.go:239: (dbg) Run: docker inspect ha-278127
helpers_test.go:243: (dbg) docker inspect ha-278127:
-- stdout --
[
{
"Id": "0081e5a17ed52117b4c7a79337cf9bbf7bd3f15756d06fdbc0f411993351e8dd",
"Created": "2025-11-26T19:57:51.94382214Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 60086,
"ExitCode": 0,
"Error": "",
"StartedAt": "2025-11-26T20:06:25.13540784Z",
"FinishedAt": "2025-11-26T20:06:24.397214575Z"
},
"Image": "sha256:ac919894123858c63a6b115b7a0677e38aafc32ba4f00c3ebbd7c61e958451be",
"ResolvConfPath": "/var/lib/docker/containers/0081e5a17ed52117b4c7a79337cf9bbf7bd3f15756d06fdbc0f411993351e8dd/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/0081e5a17ed52117b4c7a79337cf9bbf7bd3f15756d06fdbc0f411993351e8dd/hostname",
"HostsPath": "/var/lib/docker/containers/0081e5a17ed52117b4c7a79337cf9bbf7bd3f15756d06fdbc0f411993351e8dd/hosts",
"LogPath": "/var/lib/docker/containers/0081e5a17ed52117b4c7a79337cf9bbf7bd3f15756d06fdbc0f411993351e8dd/0081e5a17ed52117b4c7a79337cf9bbf7bd3f15756d06fdbc0f411993351e8dd-json.log",
"Name": "/ha-278127",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"ha-278127:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "ha-278127",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 3221225472,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 6442450944,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"ID": "0081e5a17ed52117b4c7a79337cf9bbf7bd3f15756d06fdbc0f411993351e8dd",
"LowerDir": "/var/lib/docker/overlay2/c12c2db9558baed8876313cf29ed50ad876225d492f5b6886eb14184b0d78501-init/diff:/var/lib/docker/overlay2/3a1bb6e86b241e6f18c70382297fe77231df431eb3db13a25905602860359c70/diff",
"MergedDir": "/var/lib/docker/overlay2/c12c2db9558baed8876313cf29ed50ad876225d492f5b6886eb14184b0d78501/merged",
"UpperDir": "/var/lib/docker/overlay2/c12c2db9558baed8876313cf29ed50ad876225d492f5b6886eb14184b0d78501/diff",
"WorkDir": "/var/lib/docker/overlay2/c12c2db9558baed8876313cf29ed50ad876225d492f5b6886eb14184b0d78501/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "ha-278127",
"Source": "/var/lib/docker/volumes/ha-278127/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "ha-278127",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1764169655-21974@sha256:5caa2df9c71885b15a10c4769bf4c9c00c1759c0d87b1a7e0b5b61285526245b",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "ha-278127",
"name.minikube.sigs.k8s.io": "ha-278127",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "cb3aaf333e9f66a1f0a54705c2952cf94a31e67f170d0e073ad505006b4613f7",
"SandboxKey": "/var/run/docker/netns/cb3aaf333e9f",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32828"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32829"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32832"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32830"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32831"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"ha-278127": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "f2:6e:15:9f:21:8c",
"DriverOpts": null,
"GwPriority": 0,
"NetworkID": "20cb65a83ad57cf8581cf982a5b25f381be527698b87a783139e32a436f750e9",
"EndpointID": "217fa13f4a876f9a733e9c88a45d94a8aabe2f981d6e4c092ca2c647767455d3",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"ha-278127",
"0081e5a17ed5"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p ha-278127 -n ha-278127
helpers_test.go:252: <<< TestMultiControlPlane/serial/DegradedAfterClusterRestart FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======> post-mortem[TestMultiControlPlane/serial/DegradedAfterClusterRestart]: minikube logs <======
helpers_test.go:255: (dbg) Run: out/minikube-linux-arm64 -p ha-278127 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-arm64 -p ha-278127 logs -n 25: (2.359843634s)
E1126 20:14:28.117789 4129 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/addons-152801/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:260: TestMultiControlPlane/serial/DegradedAfterClusterRestart logs:
-- stdout --
==> Audit <==
┌─────────┬──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬───────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
│ COMMAND │ ARGS │ PROFILE │ USER │ VERSION │ START TIME │ END TIME │
├─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼───────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
│ cp │ ha-278127 cp ha-278127-m03:/home/docker/cp-test.txt ha-278127-m04:/home/docker/cp-test_ha-278127-m03_ha-278127-m04.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ ssh │ ha-278127 ssh -n ha-278127-m03 sudo cat /home/docker/cp-test.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ ssh │ ha-278127 ssh -n ha-278127-m04 sudo cat /home/docker/cp-test_ha-278127-m03_ha-278127-m04.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ cp │ ha-278127 cp testdata/cp-test.txt ha-278127-m04:/home/docker/cp-test.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ ssh │ ha-278127 ssh -n ha-278127-m04 sudo cat /home/docker/cp-test.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ cp │ ha-278127 cp ha-278127-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile2837002730/001/cp-test_ha-278127-m04.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ ssh │ ha-278127 ssh -n ha-278127-m04 sudo cat /home/docker/cp-test.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ cp │ ha-278127 cp ha-278127-m04:/home/docker/cp-test.txt ha-278127:/home/docker/cp-test_ha-278127-m04_ha-278127.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ ssh │ ha-278127 ssh -n ha-278127-m04 sudo cat /home/docker/cp-test.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ ssh │ ha-278127 ssh -n ha-278127 sudo cat /home/docker/cp-test_ha-278127-m04_ha-278127.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ cp │ ha-278127 cp ha-278127-m04:/home/docker/cp-test.txt ha-278127-m02:/home/docker/cp-test_ha-278127-m04_ha-278127-m02.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ ssh │ ha-278127 ssh -n ha-278127-m04 sudo cat /home/docker/cp-test.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ ssh │ ha-278127 ssh -n ha-278127-m02 sudo cat /home/docker/cp-test_ha-278127-m04_ha-278127-m02.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ cp │ ha-278127 cp ha-278127-m04:/home/docker/cp-test.txt ha-278127-m03:/home/docker/cp-test_ha-278127-m04_ha-278127-m03.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ ssh │ ha-278127 ssh -n ha-278127-m04 sudo cat /home/docker/cp-test.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ ssh │ ha-278127 ssh -n ha-278127-m03 sudo cat /home/docker/cp-test_ha-278127-m04_ha-278127-m03.txt │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ node │ ha-278127 node stop m02 --alsologtostderr -v 5 │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:02 UTC │
│ node │ ha-278127 node start m02 --alsologtostderr -v 5 │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:02 UTC │ 26 Nov 25 20:03 UTC │
│ node │ ha-278127 node list --alsologtostderr -v 5 │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:03 UTC │ │
│ stop │ ha-278127 stop --alsologtostderr -v 5 │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:03 UTC │ 26 Nov 25 20:04 UTC │
│ start │ ha-278127 start --wait true --alsologtostderr -v 5 │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:04 UTC │ 26 Nov 25 20:05 UTC │
│ node │ ha-278127 node list --alsologtostderr -v 5 │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:05 UTC │ │
│ node │ ha-278127 node delete m03 --alsologtostderr -v 5 │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:05 UTC │ 26 Nov 25 20:05 UTC │
│ stop │ ha-278127 stop --alsologtostderr -v 5 │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:05 UTC │ 26 Nov 25 20:06 UTC │
│ start │ ha-278127 start --wait true --alsologtostderr -v 5 --driver=docker --container-runtime=crio │ ha-278127 │ jenkins │ v1.37.0 │ 26 Nov 25 20:06 UTC │ │
└─────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴───────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
==> Last Start <==
Log file created at: 2025/11/26 20:06:24
Running on machine: ip-172-31-21-244
Binary: Built with gc go1.25.3 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1126 20:06:24.854734 59960 out.go:360] Setting OutFile to fd 1 ...
I1126 20:06:24.854900 59960 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1126 20:06:24.854911 59960 out.go:374] Setting ErrFile to fd 2...
I1126 20:06:24.854917 59960 out.go:408] TERM=,COLORTERM=, which probably does not support color
I1126 20:06:24.855178 59960 root.go:338] Updating PATH: /home/jenkins/minikube-integration/21974-2326/.minikube/bin
I1126 20:06:24.855529 59960 out.go:368] Setting JSON to false
I1126 20:06:24.856339 59960 start.go:133] hostinfo: {"hostname":"ip-172-31-21-244","uptime":2915,"bootTime":1764184670,"procs":153,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1084-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I1126 20:06:24.856415 59960 start.go:143] virtualization:
I1126 20:06:24.859567 59960 out.go:179] * [ha-278127] minikube v1.37.0 on Ubuntu 20.04 (arm64)
I1126 20:06:24.863328 59960 out.go:179] - MINIKUBE_LOCATION=21974
I1126 20:06:24.863432 59960 notify.go:221] Checking for updates...
I1126 20:06:24.869239 59960 out.go:179] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I1126 20:06:24.872146 59960 out.go:179] - KUBECONFIG=/home/jenkins/minikube-integration/21974-2326/kubeconfig
I1126 20:06:24.874915 59960 out.go:179] - MINIKUBE_HOME=/home/jenkins/minikube-integration/21974-2326/.minikube
I1126 20:06:24.877742 59960 out.go:179] - MINIKUBE_BIN=out/minikube-linux-arm64
I1126 20:06:24.880612 59960 out.go:179] - MINIKUBE_FORCE_SYSTEMD=
I1126 20:06:24.883943 59960 config.go:182] Loaded profile config "ha-278127": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1126 20:06:24.884479 59960 driver.go:422] Setting default libvirt URI to qemu:///system
I1126 20:06:24.917824 59960 docker.go:124] docker version: linux-28.1.1:Docker Engine - Community
I1126 20:06:24.917967 59960 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1126 20:06:24.982581 59960 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:3 ContainersRunning:0 ContainersPaused:0 ContainersStopped:3 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:28 OomKillDisable:true NGoroutines:42 SystemTime:2025-11-26 20:06:24.973603153 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1084-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:28.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx P
ath:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.23.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.35.1]] Warnings:<nil>}}
I1126 20:06:24.982686 59960 docker.go:319] overlay module found
I1126 20:06:24.986072 59960 out.go:179] * Using the docker driver based on existing profile
I1126 20:06:24.989065 59960 start.go:309] selected driver: docker
I1126 20:06:24.989102 59960 start.go:927] validating driver "docker" against &{Name:ha-278127 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1764169655-21974@sha256:5caa2df9c71885b15a10c4769bf4c9c00c1759c0d87b1a7e0b5b61285526245b Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:ha-278127 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName
:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.49.5 Port:0 KubernetesVersion:v1.34.1 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow
:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:
SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1126 20:06:24.989232 59960 start.go:938] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1126 20:06:24.989341 59960 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I1126 20:06:25.048426 59960 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:3 ContainersRunning:0 ContainersPaused:0 ContainersStopped:3 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:28 OomKillDisable:true NGoroutines:42 SystemTime:2025-11-26 20:06:25.038525674 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1084-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:28.1.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx P
ath:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.23.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.35.1]] Warnings:<nil>}}
I1126 20:06:25.048890 59960 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I1126 20:06:25.048924 59960 cni.go:84] Creating CNI manager for ""
I1126 20:06:25.048991 59960 cni.go:136] multinode detected (3 nodes found), recommending kindnet
I1126 20:06:25.049039 59960 start.go:353] cluster config:
{Name:ha-278127 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1764169655-21974@sha256:5caa2df9c71885b15a10c4769bf4c9c00c1759c0d87b1a7e0b5b61285526245b Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:ha-278127 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR
untime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.49.5 Port:0 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-s
erver:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1126 20:06:25.052236 59960 out.go:179] * Starting "ha-278127" primary control-plane node in "ha-278127" cluster
I1126 20:06:25.055057 59960 cache.go:134] Beginning downloading kic base image for docker with crio
I1126 20:06:25.058039 59960 out.go:179] * Pulling base image v0.0.48-1764169655-21974 ...
I1126 20:06:25.061008 59960 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1126 20:06:25.061089 59960 preload.go:203] Found local preload: /home/jenkins/minikube-integration/21974-2326/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-arm64.tar.lz4
I1126 20:06:25.061106 59960 cache.go:65] Caching tarball of preloaded images
I1126 20:06:25.061005 59960 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1764169655-21974@sha256:5caa2df9c71885b15a10c4769bf4c9c00c1759c0d87b1a7e0b5b61285526245b in local docker daemon
I1126 20:06:25.061198 59960 preload.go:238] Found /home/jenkins/minikube-integration/21974-2326/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I1126 20:06:25.061210 59960 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on crio
I1126 20:06:25.061353 59960 profile.go:143] Saving config to /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/config.json ...
I1126 20:06:25.080808 59960 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1764169655-21974@sha256:5caa2df9c71885b15a10c4769bf4c9c00c1759c0d87b1a7e0b5b61285526245b in local docker daemon, skipping pull
I1126 20:06:25.080831 59960 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1764169655-21974@sha256:5caa2df9c71885b15a10c4769bf4c9c00c1759c0d87b1a7e0b5b61285526245b exists in daemon, skipping load
I1126 20:06:25.080846 59960 cache.go:243] Successfully downloaded all kic artifacts
I1126 20:06:25.080876 59960 start.go:360] acquireMachinesLock for ha-278127: {Name:mkb106a4eb425a1b9d0e59976741b3f940666d17 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1126 20:06:25.080933 59960 start.go:364] duration metric: took 35.659µs to acquireMachinesLock for "ha-278127"
I1126 20:06:25.080951 59960 start.go:96] Skipping create...Using existing machine configuration
I1126 20:06:25.080956 59960 fix.go:54] fixHost starting:
I1126 20:06:25.081217 59960 cli_runner.go:164] Run: docker container inspect ha-278127 --format={{.State.Status}}
I1126 20:06:25.097737 59960 fix.go:112] recreateIfNeeded on ha-278127: state=Stopped err=<nil>
W1126 20:06:25.097772 59960 fix.go:138] unexpected machine state, will restart: <nil>
I1126 20:06:25.101061 59960 out.go:252] * Restarting existing docker container for "ha-278127" ...
I1126 20:06:25.101155 59960 cli_runner.go:164] Run: docker start ha-278127
I1126 20:06:25.385420 59960 cli_runner.go:164] Run: docker container inspect ha-278127 --format={{.State.Status}}
I1126 20:06:25.411970 59960 kic.go:430] container "ha-278127" state is running.
I1126 20:06:25.412392 59960 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-278127
I1126 20:06:25.431941 59960 profile.go:143] Saving config to /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/config.json ...
I1126 20:06:25.432192 59960 machine.go:94] provisionDockerMachine start ...
I1126 20:06:25.432251 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127
I1126 20:06:25.452939 59960 main.go:143] libmachine: Using SSH client type: native
I1126 20:06:25.453252 59960 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x3dad70] 0x3dd270 <nil> [] 0s} 127.0.0.1 32828 <nil> <nil>}
I1126 20:06:25.453261 59960 main.go:143] libmachine: About to run SSH command:
hostname
I1126 20:06:25.454097 59960 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:44664->127.0.0.1:32828: read: connection reset by peer
I1126 20:06:28.605461 59960 main.go:143] libmachine: SSH cmd err, output: <nil>: ha-278127
I1126 20:06:28.605490 59960 ubuntu.go:182] provisioning hostname "ha-278127"
I1126 20:06:28.605558 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127
I1126 20:06:28.623455 59960 main.go:143] libmachine: Using SSH client type: native
I1126 20:06:28.623769 59960 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x3dad70] 0x3dd270 <nil> [] 0s} 127.0.0.1 32828 <nil> <nil>}
I1126 20:06:28.623786 59960 main.go:143] libmachine: About to run SSH command:
sudo hostname ha-278127 && echo "ha-278127" | sudo tee /etc/hostname
I1126 20:06:28.778155 59960 main.go:143] libmachine: SSH cmd err, output: <nil>: ha-278127
I1126 20:06:28.778256 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127
I1126 20:06:28.794949 59960 main.go:143] libmachine: Using SSH client type: native
I1126 20:06:28.795250 59960 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x3dad70] 0x3dd270 <nil> [] 0s} 127.0.0.1 32828 <nil> <nil>}
I1126 20:06:28.795271 59960 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\sha-278127' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-278127/g' /etc/hosts;
else
echo '127.0.1.1 ha-278127' | sudo tee -a /etc/hosts;
fi
fi
I1126 20:06:28.942212 59960 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1126 20:06:28.942238 59960 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21974-2326/.minikube CaCertPath:/home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21974-2326/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21974-2326/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21974-2326/.minikube}
I1126 20:06:28.942272 59960 ubuntu.go:190] setting up certificates
I1126 20:06:28.942281 59960 provision.go:84] configureAuth start
I1126 20:06:28.942355 59960 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-278127
I1126 20:06:28.960559 59960 provision.go:143] copyHostCerts
I1126 20:06:28.960617 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/21974-2326/.minikube/ca.pem
I1126 20:06:28.960653 59960 exec_runner.go:144] found /home/jenkins/minikube-integration/21974-2326/.minikube/ca.pem, removing ...
I1126 20:06:28.960666 59960 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21974-2326/.minikube/ca.pem
I1126 20:06:28.960744 59960 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21974-2326/.minikube/ca.pem (1078 bytes)
I1126 20:06:28.960844 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/21974-2326/.minikube/cert.pem
I1126 20:06:28.960866 59960 exec_runner.go:144] found /home/jenkins/minikube-integration/21974-2326/.minikube/cert.pem, removing ...
I1126 20:06:28.960877 59960 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21974-2326/.minikube/cert.pem
I1126 20:06:28.960906 59960 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21974-2326/.minikube/cert.pem (1123 bytes)
I1126 20:06:28.960964 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/21974-2326/.minikube/key.pem
I1126 20:06:28.960985 59960 exec_runner.go:144] found /home/jenkins/minikube-integration/21974-2326/.minikube/key.pem, removing ...
I1126 20:06:28.960993 59960 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21974-2326/.minikube/key.pem
I1126 20:06:28.961023 59960 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21974-2326/.minikube/key.pem (1675 bytes)
I1126 20:06:28.961088 59960 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21974-2326/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca-key.pem org=jenkins.ha-278127 san=[127.0.0.1 192.168.49.2 ha-278127 localhost minikube]
I1126 20:06:29.153972 59960 provision.go:177] copyRemoteCerts
I1126 20:06:29.154049 59960 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1126 20:06:29.154092 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127
I1126 20:06:29.171236 59960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/machines/ha-278127/id_rsa Username:docker}
I1126 20:06:29.273352 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I1126 20:06:29.273420 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1126 20:06:29.290237 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/machines/server.pem -> /etc/docker/server.pem
I1126 20:06:29.290299 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)
I1126 20:06:29.307794 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I1126 20:06:29.307855 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1126 20:06:29.325356 59960 provision.go:87] duration metric: took 383.045342ms to configureAuth
I1126 20:06:29.325387 59960 ubuntu.go:206] setting minikube options for container-runtime
I1126 20:06:29.325626 59960 config.go:182] Loaded profile config "ha-278127": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1126 20:06:29.325742 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127
I1126 20:06:29.342790 59960 main.go:143] libmachine: Using SSH client type: native
I1126 20:06:29.343103 59960 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x3dad70] 0x3dd270 <nil> [] 0s} 127.0.0.1 32828 <nil> <nil>}
I1126 20:06:29.343131 59960 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1126 20:06:29.721722 59960 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1126 20:06:29.721744 59960 machine.go:97] duration metric: took 4.28954331s to provisionDockerMachine
I1126 20:06:29.721770 59960 start.go:293] postStartSetup for "ha-278127" (driver="docker")
I1126 20:06:29.721791 59960 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1126 20:06:29.721855 59960 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1126 20:06:29.721907 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127
I1126 20:06:29.742288 59960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/machines/ha-278127/id_rsa Username:docker}
I1126 20:06:29.845365 59960 ssh_runner.go:195] Run: cat /etc/os-release
I1126 20:06:29.848307 59960 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1126 20:06:29.848344 59960 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1126 20:06:29.848355 59960 filesync.go:126] Scanning /home/jenkins/minikube-integration/21974-2326/.minikube/addons for local assets ...
I1126 20:06:29.848405 59960 filesync.go:126] Scanning /home/jenkins/minikube-integration/21974-2326/.minikube/files for local assets ...
I1126 20:06:29.848509 59960 filesync.go:149] local asset: /home/jenkins/minikube-integration/21974-2326/.minikube/files/etc/ssl/certs/41292.pem -> 41292.pem in /etc/ssl/certs
I1126 20:06:29.848521 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/files/etc/ssl/certs/41292.pem -> /etc/ssl/certs/41292.pem
I1126 20:06:29.848614 59960 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1126 20:06:29.855777 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/files/etc/ssl/certs/41292.pem --> /etc/ssl/certs/41292.pem (1708 bytes)
I1126 20:06:29.872505 59960 start.go:296] duration metric: took 150.71913ms for postStartSetup
I1126 20:06:29.872582 59960 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1126 20:06:29.872629 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127
I1126 20:06:29.889019 59960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/machines/ha-278127/id_rsa Username:docker}
I1126 20:06:29.990934 59960 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1126 20:06:29.995268 59960 fix.go:56] duration metric: took 4.914304894s for fixHost
I1126 20:06:29.995338 59960 start.go:83] releasing machines lock for "ha-278127", held for 4.914396494s
I1126 20:06:29.995443 59960 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-278127
I1126 20:06:30.012377 59960 ssh_runner.go:195] Run: cat /version.json
I1126 20:06:30.012396 59960 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1126 20:06:30.012433 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127
I1126 20:06:30.012448 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127
I1126 20:06:30.031079 59960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/machines/ha-278127/id_rsa Username:docker}
I1126 20:06:30.032530 59960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/machines/ha-278127/id_rsa Username:docker}
I1126 20:06:30.145909 59960 ssh_runner.go:195] Run: systemctl --version
I1126 20:06:30.239511 59960 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1126 20:06:30.276317 59960 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1126 20:06:30.280821 59960 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1126 20:06:30.280919 59960 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1126 20:06:30.288826 59960 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1126 20:06:30.288852 59960 start.go:496] detecting cgroup driver to use...
I1126 20:06:30.288908 59960 detect.go:187] detected "cgroupfs" cgroup driver on host os
I1126 20:06:30.288973 59960 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1126 20:06:30.304277 59960 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1126 20:06:30.316900 59960 docker.go:218] disabling cri-docker service (if available) ...
I1126 20:06:30.316968 59960 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1126 20:06:30.332722 59960 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1126 20:06:30.345857 59960 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1126 20:06:30.458910 59960 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1126 20:06:30.568914 59960 docker.go:234] disabling docker service ...
I1126 20:06:30.568992 59960 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1126 20:06:30.584111 59960 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1126 20:06:30.596826 59960 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1126 20:06:30.712581 59960 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1126 20:06:30.831709 59960 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1126 20:06:30.843921 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1126 20:06:30.857895 59960 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1126 20:06:30.858007 59960 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1126 20:06:30.867693 59960 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I1126 20:06:30.867809 59960 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I1126 20:06:30.876639 59960 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1126 20:06:30.885174 59960 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1126 20:06:30.893801 59960 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1126 20:06:30.901606 59960 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1126 20:06:30.910405 59960 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1126 20:06:30.918408 59960 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1126 20:06:30.927292 59960 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1126 20:06:30.934726 59960 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1126 20:06:30.941996 59960 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1126 20:06:31.058637 59960 ssh_runner.go:195] Run: sudo systemctl restart crio
I1126 20:06:31.242820 59960 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1126 20:06:31.242889 59960 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1126 20:06:31.246945 59960 start.go:564] Will wait 60s for crictl version
I1126 20:06:31.247023 59960 ssh_runner.go:195] Run: which crictl
I1126 20:06:31.250523 59960 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1126 20:06:31.274233 59960 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1126 20:06:31.274317 59960 ssh_runner.go:195] Run: crio --version
I1126 20:06:31.302783 59960 ssh_runner.go:195] Run: crio --version
I1126 20:06:31.335292 59960 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1126 20:06:31.338152 59960 cli_runner.go:164] Run: docker network inspect ha-278127 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1126 20:06:31.354467 59960 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I1126 20:06:31.358251 59960 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1126 20:06:31.368693 59960 kubeadm.go:884] updating cluster {Name:ha-278127 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1764169655-21974@sha256:5caa2df9c71885b15a10c4769bf4c9c00c1759c0d87b1a7e0b5b61285526245b Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:ha-278127 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.49.5 Port:0 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubeta
il:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock:
SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I1126 20:06:31.368839 59960 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1126 20:06:31.368891 59960 ssh_runner.go:195] Run: sudo crictl images --output json
I1126 20:06:31.403727 59960 crio.go:514] all images are preloaded for cri-o runtime.
I1126 20:06:31.403752 59960 crio.go:433] Images already preloaded, skipping extraction
I1126 20:06:31.404010 59960 ssh_runner.go:195] Run: sudo crictl images --output json
I1126 20:06:31.431423 59960 crio.go:514] all images are preloaded for cri-o runtime.
I1126 20:06:31.431446 59960 cache_images.go:86] Images are preloaded, skipping loading
I1126 20:06:31.431457 59960 kubeadm.go:935] updating node { 192.168.49.2 8443 v1.34.1 crio true true} ...
I1126 20:06:31.431560 59960 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-278127 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:ha-278127 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1126 20:06:31.431642 59960 ssh_runner.go:195] Run: crio config
I1126 20:06:31.500147 59960 cni.go:84] Creating CNI manager for ""
I1126 20:06:31.500186 59960 cni.go:136] multinode detected (3 nodes found), recommending kindnet
I1126 20:06:31.500211 59960 kubeadm.go:85] Using pod CIDR: 10.244.0.0/16
I1126 20:06:31.500236 59960 kubeadm.go:190] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.34.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-278127 NodeName:ha-278127 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/mani
fests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I1126 20:06:31.500354 59960 kubeadm.go:196] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta4
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/crio/crio.sock
name: "ha-278127"
kubeletExtraArgs:
- name: "node-ip"
value: "192.168.49.2"
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta4
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
- name: "enable-admission-plugins"
value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
- name: "allocate-node-cidrs"
value: "true"
- name: "leader-elect"
value: "false"
scheduler:
extraArgs:
- name: "leader-elect"
value: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
kubernetesVersion: v1.34.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I1126 20:06:31.500372 59960 kube-vip.go:115] generating kube-vip config ...
I1126 20:06:31.500428 59960 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
I1126 20:06:31.512046 59960 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
stdout:
stderr:
I1126 20:06:31.512210 59960 kube-vip.go:137] kube-vip config:
apiVersion: v1
kind: Pod
metadata:
creationTimestamp: null
name: kube-vip
namespace: kube-system
spec:
containers:
- args:
- manager
env:
- name: vip_arp
value: "true"
- name: port
value: "8443"
- name: vip_nodename
valueFrom:
fieldRef:
fieldPath: spec.nodeName
- name: vip_interface
value: eth0
- name: vip_cidr
value: "32"
- name: dns_mode
value: first
- name: cp_enable
value: "true"
- name: cp_namespace
value: kube-system
- name: vip_leaderelection
value: "true"
- name: vip_leasename
value: plndr-cp-lock
- name: vip_leaseduration
value: "5"
- name: vip_renewdeadline
value: "3"
- name: vip_retryperiod
value: "1"
- name: address
value: 192.168.49.254
- name: prometheus_server
value: :2112
image: ghcr.io/kube-vip/kube-vip:v1.0.2
imagePullPolicy: IfNotPresent
name: kube-vip
resources: {}
securityContext:
capabilities:
add:
- NET_ADMIN
- NET_RAW
volumeMounts:
- mountPath: /etc/kubernetes/admin.conf
name: kubeconfig
hostAliases:
- hostnames:
- kubernetes
ip: 127.0.0.1
hostNetwork: true
volumes:
- hostPath:
path: "/etc/kubernetes/admin.conf"
name: kubeconfig
status: {}
I1126 20:06:31.512299 59960 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1126 20:06:31.519877 59960 binaries.go:51] Found k8s binaries, skipping transfer
I1126 20:06:31.519973 59960 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
I1126 20:06:31.527497 59960 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (359 bytes)
I1126 20:06:31.540828 59960 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1126 20:06:31.553623 59960 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2206 bytes)
I1126 20:06:31.566105 59960 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
I1126 20:06:31.578838 59960 ssh_runner.go:195] Run: grep 192.168.49.254 control-plane.minikube.internal$ /etc/hosts
I1126 20:06:31.582461 59960 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1126 20:06:31.592186 59960 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1126 20:06:31.707439 59960 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1126 20:06:31.722268 59960 certs.go:69] Setting up /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127 for IP: 192.168.49.2
I1126 20:06:31.722291 59960 certs.go:195] generating shared ca certs ...
I1126 20:06:31.722307 59960 certs.go:227] acquiring lock for ca certs: {Name:mk6624f5dc47de70a2a392df95b2ee1f3043c770 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1126 20:06:31.722445 59960 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21974-2326/.minikube/ca.key
I1126 20:06:31.722497 59960 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21974-2326/.minikube/proxy-client-ca.key
I1126 20:06:31.722508 59960 certs.go:257] generating profile certs ...
I1126 20:06:31.722593 59960 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/client.key
I1126 20:06:31.722624 59960 certs.go:364] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.key.628cddab
I1126 20:06:31.722643 59960 crypto.go:68] Generating cert /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.crt.628cddab with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.3 192.168.49.254]
I1126 20:06:32.010576 59960 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.crt.628cddab ...
I1126 20:06:32.010610 59960 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.crt.628cddab: {Name:mk952cf244227c47330a0f303648b46942398499 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1126 20:06:32.010819 59960 crypto.go:164] Writing key to /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.key.628cddab ...
I1126 20:06:32.010835 59960 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.key.628cddab: {Name:mk44577b028f8c1bee471863ff089cc458df619d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1126 20:06:32.010930 59960 certs.go:382] copying /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.crt.628cddab -> /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.crt
I1126 20:06:32.011078 59960 certs.go:386] copying /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.key.628cddab -> /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.key
I1126 20:06:32.011225 59960 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/proxy-client.key
I1126 20:06:32.011244 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I1126 20:06:32.011263 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I1126 20:06:32.011280 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I1126 20:06:32.011297 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I1126 20:06:32.011315 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I1126 20:06:32.011331 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I1126 20:06:32.011348 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I1126 20:06:32.011362 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I1126 20:06:32.011414 59960 certs.go:484] found cert: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/4129.pem (1338 bytes)
W1126 20:06:32.011456 59960 certs.go:480] ignoring /home/jenkins/minikube-integration/21974-2326/.minikube/certs/4129_empty.pem, impossibly tiny 0 bytes
I1126 20:06:32.011469 59960 certs.go:484] found cert: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca-key.pem (1675 bytes)
I1126 20:06:32.011501 59960 certs.go:484] found cert: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca.pem (1078 bytes)
I1126 20:06:32.011530 59960 certs.go:484] found cert: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/cert.pem (1123 bytes)
I1126 20:06:32.011558 59960 certs.go:484] found cert: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/key.pem (1675 bytes)
I1126 20:06:32.011608 59960 certs.go:484] found cert: /home/jenkins/minikube-integration/21974-2326/.minikube/files/etc/ssl/certs/41292.pem (1708 bytes)
I1126 20:06:32.011640 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/files/etc/ssl/certs/41292.pem -> /usr/share/ca-certificates/41292.pem
I1126 20:06:32.011656 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I1126 20:06:32.011666 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/4129.pem -> /usr/share/ca-certificates/4129.pem
I1126 20:06:32.012331 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1126 20:06:32.032881 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1126 20:06:32.054562 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1126 20:06:32.072828 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I1126 20:06:32.091195 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I1126 20:06:32.109160 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1126 20:06:32.126721 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1126 20:06:32.143729 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1126 20:06:32.162210 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/files/etc/ssl/certs/41292.pem --> /usr/share/ca-certificates/41292.pem (1708 bytes)
I1126 20:06:32.179022 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1126 20:06:32.196402 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/certs/4129.pem --> /usr/share/ca-certificates/4129.pem (1338 bytes)
I1126 20:06:32.213770 59960 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I1126 20:06:32.227414 59960 ssh_runner.go:195] Run: openssl version
I1126 20:06:32.233654 59960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/41292.pem && ln -fs /usr/share/ca-certificates/41292.pem /etc/ssl/certs/41292.pem"
I1126 20:06:32.243718 59960 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/41292.pem
I1126 20:06:32.247376 59960 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 26 19:43 /usr/share/ca-certificates/41292.pem
I1126 20:06:32.247448 59960 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/41292.pem
I1126 20:06:32.289532 59960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/41292.pem /etc/ssl/certs/3ec20f2e.0"
I1126 20:06:32.297668 59960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1126 20:06:32.306080 59960 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1126 20:06:32.309793 59960 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 26 19:37 /usr/share/ca-certificates/minikubeCA.pem
I1126 20:06:32.309880 59960 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1126 20:06:32.353652 59960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1126 20:06:32.364544 59960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4129.pem && ln -fs /usr/share/ca-certificates/4129.pem /etc/ssl/certs/4129.pem"
I1126 20:06:32.373430 59960 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/4129.pem
I1126 20:06:32.381651 59960 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 26 19:43 /usr/share/ca-certificates/4129.pem
I1126 20:06:32.381803 59960 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4129.pem
I1126 20:06:32.434961 59960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/4129.pem /etc/ssl/certs/51391683.0"
I1126 20:06:32.448704 59960 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1126 20:06:32.454552 59960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1126 20:06:32.518905 59960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1126 20:06:32.599420 59960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1126 20:06:32.673604 59960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1126 20:06:32.734602 59960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1126 20:06:32.794948 59960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1126 20:06:32.842245 59960 kubeadm.go:401] StartCluster: {Name:ha-278127 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1764169655-21974@sha256:5caa2df9c71885b15a10c4769bf4c9c00c1759c0d87b1a7e0b5b61285526245b Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.1 ClusterName:ha-278127 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServe
rNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP:192.168.49.5 Port:0 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:
false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SS
HAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1126 20:06:32.842417 59960 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
I1126 20:06:32.842512 59960 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I1126 20:06:32.887488 59960 cri.go:89] found id: "f5647f1652cc11a195a49a98906391e791c3136916a5e3c249907585088fad42"
I1126 20:06:32.887548 59960 cri.go:89] found id: "1ed2c42e7047cc402ab04fdadafa16acc5208b12eede0475826c97d34c9a071f"
I1126 20:06:32.887577 59960 cri.go:89] found id: "040a8549001808f2d3fce3d4cf9f8dff272706173960c5e8004af8b1ea042e80"
I1126 20:06:32.887595 59960 cri.go:89] found id: "106da3c0ad4fa03ae491f571375cda1a123fe52e6f7ef39170a84c273267c713"
I1126 20:06:32.887614 59960 cri.go:89] found id: "cdc1651fea8f10bd665928dcc7bb174b74385eb06e911da9629df17c0d9d29e8"
I1126 20:06:32.887650 59960 cri.go:89] found id: ""
I1126 20:06:32.887728 59960 ssh_runner.go:195] Run: sudo runc list -f json
W1126 20:06:32.910884 59960 kubeadm.go:408] unpause failed: list paused: runc: sudo runc list -f json: Process exited with status 1
stdout:
stderr:
time="2025-11-26T20:06:32Z" level=error msg="open /run/runc: no such file or directory"
I1126 20:06:32.911021 59960 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I1126 20:06:32.933474 59960 kubeadm.go:417] found existing configuration files, will attempt cluster restart
I1126 20:06:32.933554 59960 kubeadm.go:598] restartPrimaryControlPlane start ...
I1126 20:06:32.933631 59960 ssh_runner.go:195] Run: sudo test -d /data/minikube
I1126 20:06:32.956246 59960 kubeadm.go:131] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:
stderr:
I1126 20:06:32.956760 59960 kubeconfig.go:47] verify endpoint returned: get endpoint: "ha-278127" does not appear in /home/jenkins/minikube-integration/21974-2326/kubeconfig
I1126 20:06:32.956919 59960 kubeconfig.go:62] /home/jenkins/minikube-integration/21974-2326/kubeconfig needs updating (will repair): [kubeconfig missing "ha-278127" cluster setting kubeconfig missing "ha-278127" context setting]
I1126 20:06:32.957299 59960 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21974-2326/kubeconfig: {Name:mk31d3c3cd766bb0755a8ea89aea97c29670aa46 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1126 20:06:32.957946 59960 kapi.go:59] client config for ha-278127: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/client.crt", KeyFile:"/home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/client.key", CAFile:"/home/jenkins/minikube-integration/21974-2326/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, Us
erAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1fb33c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1126 20:06:32.958772 59960 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
I1126 20:06:32.958857 59960 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
I1126 20:06:32.958878 59960 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
I1126 20:06:32.958921 59960 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
I1126 20:06:32.958940 59960 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
I1126 20:06:32.958837 59960 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache"
I1126 20:06:32.959354 59960 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1126 20:06:32.974056 59960 kubeadm.go:635] The running cluster does not require reconfiguration: 192.168.49.2
I1126 20:06:32.974125 59960 kubeadm.go:602] duration metric: took 40.551528ms to restartPrimaryControlPlane
I1126 20:06:32.974150 59960 kubeadm.go:403] duration metric: took 131.91251ms to StartCluster
I1126 20:06:32.974180 59960 settings.go:142] acquiring lock: {Name:mkfa9769dd6cb90f9e6ab4e649174affc8c211c8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1126 20:06:32.974282 59960 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/21974-2326/kubeconfig
I1126 20:06:32.974978 59960 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/21974-2326/kubeconfig: {Name:mk31d3c3cd766bb0755a8ea89aea97c29670aa46 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1126 20:06:32.975243 59960 start.go:234] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1126 20:06:32.975297 59960 start.go:242] waiting for startup goroutines ...
I1126 20:06:32.975325 59960 addons.go:527] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
I1126 20:06:32.975918 59960 config.go:182] Loaded profile config "ha-278127": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1126 20:06:32.981231 59960 out.go:179] * Enabled addons:
I1126 20:06:32.984100 59960 addons.go:530] duration metric: took 8.777007ms for enable addons: enabled=[]
I1126 20:06:32.984180 59960 start.go:247] waiting for cluster config update ...
I1126 20:06:32.984203 59960 start.go:256] writing updated cluster config ...
I1126 20:06:32.987492 59960 out.go:203]
I1126 20:06:32.990613 59960 config.go:182] Loaded profile config "ha-278127": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1126 20:06:32.990800 59960 profile.go:143] Saving config to /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/config.json ...
I1126 20:06:32.994017 59960 out.go:179] * Starting "ha-278127-m02" control-plane node in "ha-278127" cluster
I1126 20:06:32.996802 59960 cache.go:134] Beginning downloading kic base image for docker with crio
I1126 20:06:32.999792 59960 out.go:179] * Pulling base image v0.0.48-1764169655-21974 ...
I1126 20:06:33.002700 59960 preload.go:188] Checking if preload exists for k8s version v1.34.1 and runtime crio
I1126 20:06:33.002740 59960 cache.go:65] Caching tarball of preloaded images
I1126 20:06:33.002860 59960 preload.go:238] Found /home/jenkins/minikube-integration/21974-2326/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.1-cri-o-overlay-arm64.tar.lz4 in cache, skipping download
I1126 20:06:33.002893 59960 cache.go:68] Finished verifying existence of preloaded tar for v1.34.1 on crio
I1126 20:06:33.003031 59960 profile.go:143] Saving config to /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/config.json ...
I1126 20:06:33.003254 59960 image.go:81] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1764169655-21974@sha256:5caa2df9c71885b15a10c4769bf4c9c00c1759c0d87b1a7e0b5b61285526245b in local docker daemon
I1126 20:06:33.039303 59960 image.go:100] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1764169655-21974@sha256:5caa2df9c71885b15a10c4769bf4c9c00c1759c0d87b1a7e0b5b61285526245b in local docker daemon, skipping pull
I1126 20:06:33.039323 59960 cache.go:158] gcr.io/k8s-minikube/kicbase-builds:v0.0.48-1764169655-21974@sha256:5caa2df9c71885b15a10c4769bf4c9c00c1759c0d87b1a7e0b5b61285526245b exists in daemon, skipping load
I1126 20:06:33.039336 59960 cache.go:243] Successfully downloaded all kic artifacts
I1126 20:06:33.039360 59960 start.go:360] acquireMachinesLock for ha-278127-m02: {Name:mkfa715e07e067116cf6c4854164186af5a39436 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1126 20:06:33.039417 59960 start.go:364] duration metric: took 41.518µs to acquireMachinesLock for "ha-278127-m02"
I1126 20:06:33.039439 59960 start.go:96] Skipping create...Using existing machine configuration
I1126 20:06:33.039445 59960 fix.go:54] fixHost starting: m02
I1126 20:06:33.039721 59960 cli_runner.go:164] Run: docker container inspect ha-278127-m02 --format={{.State.Status}}
I1126 20:06:33.071417 59960 fix.go:112] recreateIfNeeded on ha-278127-m02: state=Stopped err=<nil>
W1126 20:06:33.071449 59960 fix.go:138] unexpected machine state, will restart: <nil>
I1126 20:06:33.074580 59960 out.go:252] * Restarting existing docker container for "ha-278127-m02" ...
I1126 20:06:33.074664 59960 cli_runner.go:164] Run: docker start ha-278127-m02
I1126 20:06:33.452368 59960 cli_runner.go:164] Run: docker container inspect ha-278127-m02 --format={{.State.Status}}
I1126 20:06:33.483474 59960 kic.go:430] container "ha-278127-m02" state is running.
I1126 20:06:33.483869 59960 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-278127-m02
I1126 20:06:33.512602 59960 profile.go:143] Saving config to /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/config.json ...
I1126 20:06:33.512851 59960 machine.go:94] provisionDockerMachine start ...
I1126 20:06:33.512917 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127-m02
I1126 20:06:33.539611 59960 main.go:143] libmachine: Using SSH client type: native
I1126 20:06:33.539907 59960 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x3dad70] 0x3dd270 <nil> [] 0s} 127.0.0.1 32833 <nil> <nil>}
I1126 20:06:33.539915 59960 main.go:143] libmachine: About to run SSH command:
hostname
I1126 20:06:33.540557 59960 main.go:143] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:35216->127.0.0.1:32833: read: connection reset by peer
I1126 20:06:36.755151 59960 main.go:143] libmachine: SSH cmd err, output: <nil>: ha-278127-m02
I1126 20:06:36.755173 59960 ubuntu.go:182] provisioning hostname "ha-278127-m02"
I1126 20:06:36.755238 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127-m02
I1126 20:06:36.783610 59960 main.go:143] libmachine: Using SSH client type: native
I1126 20:06:36.783923 59960 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x3dad70] 0x3dd270 <nil> [] 0s} 127.0.0.1 32833 <nil> <nil>}
I1126 20:06:36.783950 59960 main.go:143] libmachine: About to run SSH command:
sudo hostname ha-278127-m02 && echo "ha-278127-m02" | sudo tee /etc/hostname
I1126 20:06:37.026368 59960 main.go:143] libmachine: SSH cmd err, output: <nil>: ha-278127-m02
I1126 20:06:37.026488 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127-m02
I1126 20:06:37.056257 59960 main.go:143] libmachine: Using SSH client type: native
I1126 20:06:37.056574 59960 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x3dad70] 0x3dd270 <nil> [] 0s} 127.0.0.1 32833 <nil> <nil>}
I1126 20:06:37.056592 59960 main.go:143] libmachine: About to run SSH command:
if ! grep -xq '.*\sha-278127-m02' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-278127-m02/g' /etc/hosts;
else
echo '127.0.1.1 ha-278127-m02' | sudo tee -a /etc/hosts;
fi
fi
I1126 20:06:37.278605 59960 main.go:143] libmachine: SSH cmd err, output: <nil>:
I1126 20:06:37.278692 59960 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/21974-2326/.minikube CaCertPath:/home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/21974-2326/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/21974-2326/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/21974-2326/.minikube}
I1126 20:06:37.278724 59960 ubuntu.go:190] setting up certificates
I1126 20:06:37.278764 59960 provision.go:84] configureAuth start
I1126 20:06:37.278849 59960 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-278127-m02
I1126 20:06:37.306165 59960 provision.go:143] copyHostCerts
I1126 20:06:37.306207 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/21974-2326/.minikube/key.pem
I1126 20:06:37.306246 59960 exec_runner.go:144] found /home/jenkins/minikube-integration/21974-2326/.minikube/key.pem, removing ...
I1126 20:06:37.306253 59960 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21974-2326/.minikube/key.pem
I1126 20:06:37.306332 59960 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/21974-2326/.minikube/key.pem (1675 bytes)
I1126 20:06:37.306421 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/21974-2326/.minikube/ca.pem
I1126 20:06:37.306441 59960 exec_runner.go:144] found /home/jenkins/minikube-integration/21974-2326/.minikube/ca.pem, removing ...
I1126 20:06:37.306445 59960 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21974-2326/.minikube/ca.pem
I1126 20:06:37.306474 59960 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/21974-2326/.minikube/ca.pem (1078 bytes)
I1126 20:06:37.306512 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/21974-2326/.minikube/cert.pem
I1126 20:06:37.306528 59960 exec_runner.go:144] found /home/jenkins/minikube-integration/21974-2326/.minikube/cert.pem, removing ...
I1126 20:06:37.306532 59960 exec_runner.go:203] rm: /home/jenkins/minikube-integration/21974-2326/.minikube/cert.pem
I1126 20:06:37.306553 59960 exec_runner.go:151] cp: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/21974-2326/.minikube/cert.pem (1123 bytes)
I1126 20:06:37.306602 59960 provision.go:117] generating server cert: /home/jenkins/minikube-integration/21974-2326/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca-key.pem org=jenkins.ha-278127-m02 san=[127.0.0.1 192.168.49.3 ha-278127-m02 localhost minikube]
I1126 20:06:37.781886 59960 provision.go:177] copyRemoteCerts
I1126 20:06:37.782050 59960 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1126 20:06:37.782113 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127-m02
I1126 20:06:37.799978 59960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32833 SSHKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/machines/ha-278127-m02/id_rsa Username:docker}
I1126 20:06:37.920744 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I1126 20:06:37.920800 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I1126 20:06:37.946353 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/machines/server.pem -> /etc/docker/server.pem
I1126 20:06:37.946424 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I1126 20:06:37.990628 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I1126 20:06:37.990734 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I1126 20:06:38.022932 59960 provision.go:87] duration metric: took 744.14174ms to configureAuth
I1126 20:06:38.022999 59960 ubuntu.go:206] setting minikube options for container-runtime
I1126 20:06:38.023281 59960 config.go:182] Loaded profile config "ha-278127": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1126 20:06:38.023419 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127-m02
I1126 20:06:38.055902 59960 main.go:143] libmachine: Using SSH client type: native
I1126 20:06:38.056219 59960 main.go:143] libmachine: &{{{<nil> 0 [] [] []} docker [0x3dad70] 0x3dd270 <nil> [] 0s} 127.0.0.1 32833 <nil> <nil>}
I1126 20:06:38.056232 59960 main.go:143] libmachine: About to run SSH command:
sudo mkdir -p /etc/sysconfig && printf %s "
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
I1126 20:06:39.163004 59960 main.go:143] libmachine: SSH cmd err, output: <nil>:
CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
I1126 20:06:39.163066 59960 machine.go:97] duration metric: took 5.650194842s to provisionDockerMachine
I1126 20:06:39.163087 59960 start.go:293] postStartSetup for "ha-278127-m02" (driver="docker")
I1126 20:06:39.163098 59960 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1126 20:06:39.163204 59960 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1126 20:06:39.163258 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127-m02
I1126 20:06:39.194111 59960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32833 SSHKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/machines/ha-278127-m02/id_rsa Username:docker}
I1126 20:06:39.327619 59960 ssh_runner.go:195] Run: cat /etc/os-release
I1126 20:06:39.331483 59960 main.go:143] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I1126 20:06:39.331507 59960 info.go:137] Remote host: Debian GNU/Linux 12 (bookworm)
I1126 20:06:39.331518 59960 filesync.go:126] Scanning /home/jenkins/minikube-integration/21974-2326/.minikube/addons for local assets ...
I1126 20:06:39.331574 59960 filesync.go:126] Scanning /home/jenkins/minikube-integration/21974-2326/.minikube/files for local assets ...
I1126 20:06:39.331649 59960 filesync.go:149] local asset: /home/jenkins/minikube-integration/21974-2326/.minikube/files/etc/ssl/certs/41292.pem -> 41292.pem in /etc/ssl/certs
I1126 20:06:39.331655 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/files/etc/ssl/certs/41292.pem -> /etc/ssl/certs/41292.pem
I1126 20:06:39.331756 59960 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
I1126 20:06:39.344886 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/files/etc/ssl/certs/41292.pem --> /etc/ssl/certs/41292.pem (1708 bytes)
I1126 20:06:39.377797 59960 start.go:296] duration metric: took 214.695598ms for postStartSetup
I1126 20:06:39.377880 59960 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1126 20:06:39.377991 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127-m02
I1126 20:06:39.402878 59960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32833 SSHKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/machines/ha-278127-m02/id_rsa Username:docker}
I1126 20:06:39.525023 59960 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I1126 20:06:39.531527 59960 fix.go:56] duration metric: took 6.492076268s for fixHost
I1126 20:06:39.531551 59960 start.go:83] releasing machines lock for "ha-278127-m02", held for 6.492125467s
I1126 20:06:39.531622 59960 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-278127-m02
I1126 20:06:39.571062 59960 out.go:179] * Found network options:
I1126 20:06:39.574101 59960 out.go:179] - NO_PROXY=192.168.49.2
W1126 20:06:39.577135 59960 proxy.go:120] fail to check proxy env: Error ip not in block
W1126 20:06:39.577189 59960 proxy.go:120] fail to check proxy env: Error ip not in block
I1126 20:06:39.577283 59960 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
I1126 20:06:39.577298 59960 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I1126 20:06:39.577325 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127-m02
I1126 20:06:39.577353 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127-m02
I1126 20:06:39.610149 59960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32833 SSHKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/machines/ha-278127-m02/id_rsa Username:docker}
I1126 20:06:39.618182 59960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32833 SSHKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/machines/ha-278127-m02/id_rsa Username:docker}
I1126 20:06:39.847910 59960 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
W1126 20:06:39.986067 59960 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found
I1126 20:06:39.986218 59960 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I1126 20:06:40.010567 59960 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
I1126 20:06:40.010651 59960 start.go:496] detecting cgroup driver to use...
I1126 20:06:40.010701 59960 detect.go:187] detected "cgroupfs" cgroup driver on host os
I1126 20:06:40.010777 59960 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
I1126 20:06:40.066499 59960 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
I1126 20:06:40.113187 59960 docker.go:218] disabling cri-docker service (if available) ...
I1126 20:06:40.113357 59960 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I1126 20:06:40.138505 59960 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I1126 20:06:40.165558 59960 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I1126 20:06:40.434812 59960 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I1126 20:06:40.667360 59960 docker.go:234] disabling docker service ...
I1126 20:06:40.667485 59960 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I1126 20:06:40.689020 59960 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I1126 20:06:40.712251 59960 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I1126 20:06:41.062262 59960 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I1126 20:06:41.446879 59960 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I1126 20:06:41.479018 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
" | sudo tee /etc/crictl.yaml"
I1126 20:06:41.522736 59960 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
I1126 20:06:41.522836 59960 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
I1126 20:06:41.550554 59960 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
I1126 20:06:41.550640 59960 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
I1126 20:06:41.568877 59960 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
I1126 20:06:41.605965 59960 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
I1126 20:06:41.634535 59960 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I1126 20:06:41.647439 59960 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
I1126 20:06:41.679616 59960 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
I1126 20:06:41.700895 59960 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
I1126 20:06:41.724575 59960 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I1126 20:06:41.743621 59960 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I1126 20:06:41.761053 59960 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1126 20:06:42.179518 59960 ssh_runner.go:195] Run: sudo systemctl restart crio
I1126 20:08:12.654700 59960 ssh_runner.go:235] Completed: sudo systemctl restart crio: (1m30.475140858s)
I1126 20:08:12.654725 59960 start.go:543] Will wait 60s for socket path /var/run/crio/crio.sock
I1126 20:08:12.654777 59960 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
I1126 20:08:12.658561 59960 start.go:564] Will wait 60s for crictl version
I1126 20:08:12.658629 59960 ssh_runner.go:195] Run: which crictl
I1126 20:08:12.662122 59960 ssh_runner.go:195] Run: sudo /usr/local/bin/crictl version
I1126 20:08:12.694230 59960 start.go:580] Version: 0.1.0
RuntimeName: cri-o
RuntimeVersion: 1.34.2
RuntimeApiVersion: v1
I1126 20:08:12.694320 59960 ssh_runner.go:195] Run: crio --version
I1126 20:08:12.723516 59960 ssh_runner.go:195] Run: crio --version
I1126 20:08:12.752895 59960 out.go:179] * Preparing Kubernetes v1.34.1 on CRI-O 1.34.2 ...
I1126 20:08:12.755800 59960 out.go:179] - env NO_PROXY=192.168.49.2
I1126 20:08:12.758681 59960 cli_runner.go:164] Run: docker network inspect ha-278127 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I1126 20:08:12.774831 59960 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I1126 20:08:12.778729 59960 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1126 20:08:12.788193 59960 mustload.go:66] Loading cluster: ha-278127
I1126 20:08:12.788437 59960 config.go:182] Loaded profile config "ha-278127": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1126 20:08:12.788732 59960 cli_runner.go:164] Run: docker container inspect ha-278127 --format={{.State.Status}}
I1126 20:08:12.805367 59960 host.go:66] Checking if "ha-278127" exists ...
I1126 20:08:12.805673 59960 certs.go:69] Setting up /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127 for IP: 192.168.49.3
I1126 20:08:12.805688 59960 certs.go:195] generating shared ca certs ...
I1126 20:08:12.805703 59960 certs.go:227] acquiring lock for ca certs: {Name:mk6624f5dc47de70a2a392df95b2ee1f3043c770 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1126 20:08:12.805829 59960 certs.go:236] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/21974-2326/.minikube/ca.key
I1126 20:08:12.805875 59960 certs.go:236] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/21974-2326/.minikube/proxy-client-ca.key
I1126 20:08:12.805885 59960 certs.go:257] generating profile certs ...
I1126 20:08:12.806061 59960 certs.go:360] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/client.key
I1126 20:08:12.806134 59960 certs.go:360] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.key.28ad082f
I1126 20:08:12.806177 59960 certs.go:360] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/proxy-client.key
I1126 20:08:12.806189 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I1126 20:08:12.806203 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I1126 20:08:12.806214 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I1126 20:08:12.806227 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I1126 20:08:12.806238 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I1126 20:08:12.806249 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I1126 20:08:12.806265 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I1126 20:08:12.806276 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I1126 20:08:12.806330 59960 certs.go:484] found cert: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/4129.pem (1338 bytes)
W1126 20:08:12.806364 59960 certs.go:480] ignoring /home/jenkins/minikube-integration/21974-2326/.minikube/certs/4129_empty.pem, impossibly tiny 0 bytes
I1126 20:08:12.806376 59960 certs.go:484] found cert: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca-key.pem (1675 bytes)
I1126 20:08:12.806404 59960 certs.go:484] found cert: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/ca.pem (1078 bytes)
I1126 20:08:12.806431 59960 certs.go:484] found cert: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/cert.pem (1123 bytes)
I1126 20:08:12.806458 59960 certs.go:484] found cert: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/key.pem (1675 bytes)
I1126 20:08:12.806505 59960 certs.go:484] found cert: /home/jenkins/minikube-integration/21974-2326/.minikube/files/etc/ssl/certs/41292.pem (1708 bytes)
I1126 20:08:12.806543 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I1126 20:08:12.806557 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/certs/4129.pem -> /usr/share/ca-certificates/4129.pem
I1126 20:08:12.806568 59960 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/21974-2326/.minikube/files/etc/ssl/certs/41292.pem -> /usr/share/ca-certificates/41292.pem
I1126 20:08:12.806631 59960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-278127
I1126 20:08:12.824408 59960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/21974-2326/.minikube/machines/ha-278127/id_rsa Username:docker}
I1126 20:08:12.926228 59960 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
I1126 20:08:12.930801 59960 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
I1126 20:08:12.939401 59960 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
I1126 20:08:12.947934 59960 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
I1126 20:08:12.960335 59960 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
I1126 20:08:12.964526 59960 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
I1126 20:08:12.973104 59960 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
I1126 20:08:12.978204 59960 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)
I1126 20:08:12.987576 59960 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
I1126 20:08:12.991901 59960 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
I1126 20:08:13.001289 59960 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
I1126 20:08:13.006200 59960 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1675 bytes)
I1126 20:08:13.014443 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I1126 20:08:13.039341 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I1126 20:08:13.063520 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I1126 20:08:13.085219 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I1126 20:08:13.103037 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
I1126 20:08:13.123095 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I1126 20:08:13.140681 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I1126 20:08:13.160781 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1126 20:08:13.180406 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I1126 20:08:13.200475 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/certs/4129.pem --> /usr/share/ca-certificates/4129.pem (1338 bytes)
I1126 20:08:13.221024 59960 ssh_runner.go:362] scp /home/jenkins/minikube-integration/21974-2326/.minikube/files/etc/ssl/certs/41292.pem --> /usr/share/ca-certificates/41292.pem (1708 bytes)
I1126 20:08:13.239900 59960 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
I1126 20:08:13.254738 59960 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
I1126 20:08:13.269631 59960 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
I1126 20:08:13.285317 59960 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)
I1126 20:08:13.300359 59960 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
I1126 20:08:13.320893 59960 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1675 bytes)
I1126 20:08:13.340300 59960 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
I1126 20:08:13.361527 59960 ssh_runner.go:195] Run: openssl version
I1126 20:08:13.368555 59960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1126 20:08:13.377244 59960 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1126 20:08:13.381511 59960 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Nov 26 19:37 /usr/share/ca-certificates/minikubeCA.pem
I1126 20:08:13.381624 59960 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1126 20:08:13.427936 59960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1126 20:08:13.437023 59960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4129.pem && ln -fs /usr/share/ca-certificates/4129.pem /etc/ssl/certs/4129.pem"
I1126 20:08:13.445274 59960 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/4129.pem
I1126 20:08:13.449571 59960 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Nov 26 19:43 /usr/share/ca-certificates/4129.pem
I1126 20:08:13.449682 59960 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4129.pem
I1126 20:08:13.496315 59960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/4129.pem /etc/ssl/certs/51391683.0"
I1126 20:08:13.504808 59960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/41292.pem && ln -fs /usr/share/ca-certificates/41292.pem /etc/ssl/certs/41292.pem"
I1126 20:08:13.513181 59960 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/41292.pem
I1126 20:08:13.517313 59960 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Nov 26 19:43 /usr/share/ca-certificates/41292.pem
I1126 20:08:13.517396 59960 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/41292.pem
I1126 20:08:13.579337 59960 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/41292.pem /etc/ssl/certs/3ec20f2e.0"
I1126 20:08:13.588179 59960 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I1126 20:08:13.593330 59960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
I1126 20:08:13.645107 59960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
I1126 20:08:13.691020 59960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
I1126 20:08:13.735436 59960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
I1126 20:08:13.780762 59960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
I1126 20:08:13.830095 59960 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
I1126 20:08:13.873290 59960 kubeadm.go:935] updating node {m02 192.168.49.3 8443 v1.34.1 crio true true} ...
I1126 20:08:13.873415 59960 kubeadm.go:947] kubelet [Unit]
Wants=crio.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.34.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-278127-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.3
[Install]
config:
{KubernetesVersion:v1.34.1 ClusterName:ha-278127 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I1126 20:08:13.873445 59960 kube-vip.go:115] generating kube-vip config ...
I1126 20:08:13.873508 59960 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
I1126 20:08:13.885513 59960 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
stdout:
stderr:
I1126 20:08:13.885577 59960 kube-vip.go:137] kube-vip config:
apiVersion: v1
kind: Pod
metadata:
creationTimestamp: null
name: kube-vip
namespace: kube-system
spec:
containers:
- args:
- manager
env:
- name: vip_arp
value: "true"
- name: port
value: "8443"
- name: vip_nodename
valueFrom:
fieldRef:
fieldPath: spec.nodeName
- name: vip_interface
value: eth0
- name: vip_cidr
value: "32"
- name: dns_mode
value: first
- name: cp_enable
value: "true"
- name: cp_namespace
value: kube-system
- name: vip_leaderelection
value: "true"
- name: vip_leasename
value: plndr-cp-lock
- name: vip_leaseduration
value: "5"
- name: vip_renewdeadline
value: "3"
- name: vip_retryperiod
value: "1"
- name: address
value: 192.168.49.254
- name: prometheus_server
value: :2112
image: ghcr.io/kube-vip/kube-vip:v1.0.2
imagePullPolicy: IfNotPresent
name: kube-vip
resources: {}
securityContext:
capabilities:
add:
- NET_ADMIN
- NET_RAW
volumeMounts:
- mountPath: /etc/kubernetes/admin.conf
name: kubeconfig
hostAliases:
- hostnames:
- kubernetes
ip: 127.0.0.1
hostNetwork: true
volumes:
- hostPath:
path: "/etc/kubernetes/admin.conf"
name: kubeconfig
status: {}
I1126 20:08:13.885657 59960 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.1
I1126 20:08:13.893550 59960 binaries.go:51] Found k8s binaries, skipping transfer
I1126 20:08:13.893628 59960 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
I1126 20:08:13.901912 59960 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
I1126 20:08:13.916015 59960 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1126 20:08:13.934936 59960 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
I1126 20:08:13.979363 59960 ssh_runner.go:195] Run: grep 192.168.49.254 control-plane.minikube.internal$ /etc/hosts
I1126 20:08:13.991396 59960 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I1126 20:08:14.018397 59960 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1126 20:08:14.385132 59960 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1126 20:08:14.402828 59960 start.go:236] Will wait 6m0s for node &{Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.1 ContainerRuntime:crio ControlPlane:true Worker:true}
I1126 20:08:14.403147 59960 config.go:182] Loaded profile config "ha-278127": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.1
I1126 20:08:14.408967 59960 out.go:179] * Verifying Kubernetes components...
I1126 20:08:14.411916 59960 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I1126 20:08:14.659853 59960 ssh_runner.go:195] Run: sudo systemctl start kubelet
I1126 20:08:14.678979 59960 kapi.go:59] client config for ha-278127: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/client.crt", KeyFile:"/home/jenkins/minikube-integration/21974-2326/.minikube/profiles/ha-278127/client.key", CAFile:"/home/jenkins/minikube-integration/21974-2326/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1fb33c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
W1126 20:08:14.679061 59960 kubeadm.go:492] Overriding stale ClientConfig host https://192.168.49.254:8443 with https://192.168.49.2:8443
I1126 20:08:14.679322 59960 node_ready.go:35] waiting up to 6m0s for node "ha-278127-m02" to be "Ready" ...
I1126 20:08:15.269402 59960 node_ready.go:49] node "ha-278127-m02" is "Ready"
I1126 20:08:15.269438 59960 node_ready.go:38] duration metric: took 590.083677ms for node "ha-278127-m02" to be "Ready" ...
I1126 20:08:15.269450 59960 api_server.go:52] waiting for apiserver process to appear ...
I1126 20:08:15.269508 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:15.770378 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:16.271005 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:16.769624 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:17.269646 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:17.770292 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:18.270233 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:18.770225 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:19.269626 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:19.770251 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:20.270592 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:20.769691 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:21.269742 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:21.769575 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:22.269640 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:22.770094 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:23.269745 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:23.770093 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:24.269839 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:24.770626 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:25.270510 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:25.770352 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:26.270238 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:26.770199 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:27.270553 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:27.770570 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:28.269631 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:28.770575 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:29.269663 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:29.770438 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:30.269733 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:30.769570 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:31.269688 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:31.770556 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:32.270505 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:32.770152 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:33.269716 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:33.769765 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:34.269659 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:34.769641 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:35.269866 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:35.770030 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:36.270158 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:36.770014 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:37.270234 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:37.769610 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:38.270567 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:38.770558 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:39.269653 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:39.769895 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:40.270407 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:40.769781 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:41.270338 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:41.770411 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:42.269686 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:42.770028 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:43.269580 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:43.769636 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:44.269684 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:44.769627 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:45.272055 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:45.770418 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:46.269657 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:46.770575 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:47.270036 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:47.770377 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:48.270502 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:48.770450 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:49.269719 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:49.770449 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:50.269903 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:50.769675 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:51.270539 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:51.770618 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:52.270336 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:52.770354 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:53.270340 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:53.769901 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:54.270054 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:54.769747 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:55.270283 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:55.770525 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:56.269881 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:56.769908 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:57.269834 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:57.769631 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:58.270414 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:58.770529 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:59.269820 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:08:59.770577 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:00.269749 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:00.770275 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:01.270165 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:01.769910 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:02.269673 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:02.770492 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:03.270339 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:03.769642 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:04.269668 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:04.770177 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:05.270062 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:05.770571 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:06.270286 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:06.770466 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:07.269878 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:07.770593 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:08.270292 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:08.770068 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:09.269767 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:09.769619 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:10.270146 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:10.769659 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:11.270311 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:11.770596 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:12.269893 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:12.769649 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:13.270341 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:13.770530 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:14.269596 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:14.769532 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:09:14.769644 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:09:14.805181 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:14.805204 59960 cri.go:89] found id: ""
I1126 20:09:14.805213 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:09:14.805269 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:14.809129 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:09:14.809206 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:09:14.835451 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:14.835475 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:14.835480 59960 cri.go:89] found id: ""
I1126 20:09:14.835487 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:09:14.835543 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:14.839249 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:14.842501 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:09:14.842574 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:09:14.867922 59960 cri.go:89] found id: ""
I1126 20:09:14.867948 59960 logs.go:282] 0 containers: []
W1126 20:09:14.867957 59960 logs.go:284] No container was found matching "coredns"
I1126 20:09:14.867963 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:09:14.868022 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:09:14.893599 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:14.893625 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:14.893630 59960 cri.go:89] found id: ""
I1126 20:09:14.893638 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:09:14.893730 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:14.897540 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:14.901438 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:09:14.901540 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:09:14.929244 59960 cri.go:89] found id: ""
I1126 20:09:14.929268 59960 logs.go:282] 0 containers: []
W1126 20:09:14.929277 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:09:14.929284 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:09:14.929340 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:09:14.956242 59960 cri.go:89] found id: "7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:14.956264 59960 cri.go:89] found id: ""
I1126 20:09:14.956272 59960 logs.go:282] 1 containers: [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f]
I1126 20:09:14.956326 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:14.960197 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:09:14.960271 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:09:14.985332 59960 cri.go:89] found id: ""
I1126 20:09:14.985407 59960 logs.go:282] 0 containers: []
W1126 20:09:14.985428 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:09:14.985455 59960 logs.go:123] Gathering logs for container status ...
I1126 20:09:14.985495 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:09:15.015412 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:09:15.015491 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:09:15.446082 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:09:15.438231 1519 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:15.438877 1519 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:15.440458 1519 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:15.440891 1519 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:15.442380 1519 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:09:15.438231 1519 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:15.438877 1519 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:15.440458 1519 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:15.440891 1519 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:15.442380 1519 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:09:15.446107 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:09:15.446122 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:15.474426 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:09:15.474452 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:15.514330 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:09:15.514364 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:15.582633 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:09:15.582662 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:15.636475 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:09:15.636508 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:09:15.718181 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:09:15.718215 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:09:15.814217 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:09:15.814253 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:09:15.826793 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:09:15.826823 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:15.854520 59960 logs.go:123] Gathering logs for kube-controller-manager [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f] ...
I1126 20:09:15.854550 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:18.382038 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:18.401602 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:09:18.401678 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:09:18.435808 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:18.435831 59960 cri.go:89] found id: ""
I1126 20:09:18.435839 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:09:18.435907 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:18.439686 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:09:18.439801 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:09:18.476740 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:18.476764 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:18.476770 59960 cri.go:89] found id: ""
I1126 20:09:18.476787 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:09:18.476889 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:18.480732 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:18.484682 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:09:18.484783 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:09:18.511910 59960 cri.go:89] found id: ""
I1126 20:09:18.511974 59960 logs.go:282] 0 containers: []
W1126 20:09:18.511989 59960 logs.go:284] No container was found matching "coredns"
I1126 20:09:18.511996 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:09:18.512055 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:09:18.547921 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:18.547988 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:18.548006 59960 cri.go:89] found id: ""
I1126 20:09:18.548014 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:09:18.548071 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:18.552076 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:18.556982 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:09:18.557066 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:09:18.587286 59960 cri.go:89] found id: ""
I1126 20:09:18.587313 59960 logs.go:282] 0 containers: []
W1126 20:09:18.587333 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:09:18.587340 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:09:18.587401 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:09:18.620541 59960 cri.go:89] found id: "7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:18.620559 59960 cri.go:89] found id: ""
I1126 20:09:18.620567 59960 logs.go:282] 1 containers: [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f]
I1126 20:09:18.620626 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:18.624723 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:09:18.624796 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:09:18.653037 59960 cri.go:89] found id: ""
I1126 20:09:18.653060 59960 logs.go:282] 0 containers: []
W1126 20:09:18.653068 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:09:18.653077 59960 logs.go:123] Gathering logs for kube-controller-manager [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f] ...
I1126 20:09:18.653090 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:18.684308 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:09:18.684335 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:09:18.776764 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:09:18.776798 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:09:18.865581 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:09:18.856655 1653 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:18.858014 1653 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:18.858939 1653 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:18.859710 1653 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:18.861248 1653 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:09:18.856655 1653 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:18.858014 1653 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:18.858939 1653 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:18.859710 1653 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:18.861248 1653 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:09:18.865603 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:09:18.865616 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:18.909234 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:09:18.909270 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:18.960436 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:09:18.960477 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:18.990735 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:09:18.990766 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:09:19.069643 59960 logs.go:123] Gathering logs for container status ...
I1126 20:09:19.069722 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:09:19.104112 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:09:19.104137 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:09:19.118175 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:09:19.118204 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:19.148200 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:09:19.148229 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:21.687827 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:21.698536 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:09:21.698621 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:09:21.730147 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:21.730171 59960 cri.go:89] found id: ""
I1126 20:09:21.730180 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:09:21.730235 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:21.735922 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:09:21.736012 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:09:21.763452 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:21.763481 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:21.763486 59960 cri.go:89] found id: ""
I1126 20:09:21.763494 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:09:21.763551 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:21.767451 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:21.771041 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:09:21.771140 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:09:21.803663 59960 cri.go:89] found id: ""
I1126 20:09:21.803688 59960 logs.go:282] 0 containers: []
W1126 20:09:21.803697 59960 logs.go:284] No container was found matching "coredns"
I1126 20:09:21.803703 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:09:21.803767 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:09:21.832470 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:21.832496 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:21.832501 59960 cri.go:89] found id: ""
I1126 20:09:21.832510 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:09:21.832567 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:21.836410 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:21.840076 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:09:21.840157 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:09:21.866968 59960 cri.go:89] found id: ""
I1126 20:09:21.866994 59960 logs.go:282] 0 containers: []
W1126 20:09:21.867004 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:09:21.867011 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:09:21.867093 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:09:21.892977 59960 cri.go:89] found id: "7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:21.893000 59960 cri.go:89] found id: ""
I1126 20:09:21.893008 59960 logs.go:282] 1 containers: [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f]
I1126 20:09:21.893083 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:21.896906 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:09:21.897019 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:09:21.923720 59960 cri.go:89] found id: ""
I1126 20:09:21.923744 59960 logs.go:282] 0 containers: []
W1126 20:09:21.923753 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:09:21.923762 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:09:21.923793 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:09:22.011751 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:09:22.003342 1780 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:22.003880 1780 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:22.005519 1780 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:22.006189 1780 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:22.007784 1780 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:09:22.003342 1780 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:22.003880 1780 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:22.005519 1780 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:22.006189 1780 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:22.007784 1780 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:09:22.011856 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:09:22.011890 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:22.042091 59960 logs.go:123] Gathering logs for kube-controller-manager [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f] ...
I1126 20:09:22.042121 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:22.079857 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:09:22.079886 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:09:22.179933 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:09:22.179973 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:22.207540 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:09:22.207568 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:22.263434 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:09:22.263465 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:22.313145 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:09:22.313180 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:22.365142 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:09:22.365177 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:09:22.446886 59960 logs.go:123] Gathering logs for container status ...
I1126 20:09:22.446920 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:09:22.483927 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:09:22.483961 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:09:24.996823 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:25.007913 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:09:25.007987 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:09:25.044777 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:25.044801 59960 cri.go:89] found id: ""
I1126 20:09:25.044810 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:09:25.044870 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:25.048843 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:09:25.048923 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:09:25.083120 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:25.083187 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:25.083197 59960 cri.go:89] found id: ""
I1126 20:09:25.083205 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:09:25.083271 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:25.086865 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:25.090526 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:09:25.090596 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:09:25.118710 59960 cri.go:89] found id: ""
I1126 20:09:25.118735 59960 logs.go:282] 0 containers: []
W1126 20:09:25.118745 59960 logs.go:284] No container was found matching "coredns"
I1126 20:09:25.118752 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:09:25.118809 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:09:25.145818 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:25.145843 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:25.145850 59960 cri.go:89] found id: ""
I1126 20:09:25.145857 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:09:25.145956 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:25.154268 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:25.159267 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:09:25.159348 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:09:25.185977 59960 cri.go:89] found id: ""
I1126 20:09:25.186002 59960 logs.go:282] 0 containers: []
W1126 20:09:25.186011 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:09:25.186017 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:09:25.186072 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:09:25.213727 59960 cri.go:89] found id: "7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:25.213751 59960 cri.go:89] found id: ""
I1126 20:09:25.213760 59960 logs.go:282] 1 containers: [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f]
I1126 20:09:25.213826 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:25.217850 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:09:25.217960 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:09:25.246743 59960 cri.go:89] found id: ""
I1126 20:09:25.246769 59960 logs.go:282] 0 containers: []
W1126 20:09:25.246779 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:09:25.246788 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:09:25.246800 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:09:25.321227 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:09:25.312798 1919 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:25.313456 1919 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:25.315126 1919 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:25.315598 1919 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:25.317138 1919 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:09:25.312798 1919 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:25.313456 1919 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:25.315126 1919 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:25.315598 1919 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:25.317138 1919 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:09:25.321251 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:09:25.321288 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:25.346983 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:09:25.347011 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:25.407991 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:09:25.408027 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:25.439857 59960 logs.go:123] Gathering logs for kube-controller-manager [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f] ...
I1126 20:09:25.439886 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:25.467227 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:09:25.467252 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:09:25.549334 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:09:25.549371 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:25.590791 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:09:25.590821 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:25.636096 59960 logs.go:123] Gathering logs for container status ...
I1126 20:09:25.636130 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:09:25.668287 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:09:25.668314 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:09:25.765804 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:09:25.765838 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:09:28.279160 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:28.290077 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:09:28.290149 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:09:28.320697 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:28.320720 59960 cri.go:89] found id: ""
I1126 20:09:28.320729 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:09:28.320786 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:28.324391 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:09:28.324466 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:09:28.351072 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:28.351094 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:28.351099 59960 cri.go:89] found id: ""
I1126 20:09:28.351106 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:09:28.351161 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:28.355739 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:28.359260 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:09:28.359346 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:09:28.386343 59960 cri.go:89] found id: ""
I1126 20:09:28.386370 59960 logs.go:282] 0 containers: []
W1126 20:09:28.386383 59960 logs.go:284] No container was found matching "coredns"
I1126 20:09:28.386390 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:09:28.386457 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:09:28.413613 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:28.413635 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:28.413641 59960 cri.go:89] found id: ""
I1126 20:09:28.413648 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:09:28.413701 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:28.417403 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:28.420731 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:09:28.420810 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:09:28.446127 59960 cri.go:89] found id: ""
I1126 20:09:28.446202 59960 logs.go:282] 0 containers: []
W1126 20:09:28.446225 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:09:28.446245 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:09:28.446337 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:09:28.471432 59960 cri.go:89] found id: "7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:28.471454 59960 cri.go:89] found id: ""
I1126 20:09:28.471462 59960 logs.go:282] 1 containers: [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f]
I1126 20:09:28.471545 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:28.475058 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:09:28.475141 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:09:28.502515 59960 cri.go:89] found id: ""
I1126 20:09:28.502539 59960 logs.go:282] 0 containers: []
W1126 20:09:28.502549 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:09:28.502559 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:09:28.502570 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:09:28.514608 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:09:28.514637 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:28.557861 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:09:28.557890 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:28.627880 59960 logs.go:123] Gathering logs for container status ...
I1126 20:09:28.627917 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:09:28.659730 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:09:28.659757 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:09:28.725495 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:09:28.717349 2095 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:28.718072 2095 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:28.719611 2095 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:28.720154 2095 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:28.722097 2095 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:09:28.717349 2095 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:28.718072 2095 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:28.719611 2095 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:28.720154 2095 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:28.722097 2095 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:09:28.725519 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:09:28.725532 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:28.763157 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:09:28.763187 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:28.828543 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:09:28.828573 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:28.855674 59960 logs.go:123] Gathering logs for kube-controller-manager [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f] ...
I1126 20:09:28.855707 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:28.888296 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:09:28.888323 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:09:28.966101 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:09:28.966135 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:09:31.560965 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:31.571673 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:09:31.571744 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:09:31.601161 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:31.601182 59960 cri.go:89] found id: ""
I1126 20:09:31.601190 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:09:31.601269 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:31.605397 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:09:31.605476 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:09:31.631813 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:31.631835 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:31.631841 59960 cri.go:89] found id: ""
I1126 20:09:31.631848 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:09:31.631904 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:31.635710 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:31.639546 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:09:31.639621 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:09:31.674540 59960 cri.go:89] found id: ""
I1126 20:09:31.674569 59960 logs.go:282] 0 containers: []
W1126 20:09:31.674578 59960 logs.go:284] No container was found matching "coredns"
I1126 20:09:31.674585 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:09:31.674643 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:09:31.705780 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:31.705799 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:31.705803 59960 cri.go:89] found id: ""
I1126 20:09:31.705810 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:09:31.705865 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:31.709862 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:31.713500 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:09:31.713591 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:09:31.739394 59960 cri.go:89] found id: ""
I1126 20:09:31.739419 59960 logs.go:282] 0 containers: []
W1126 20:09:31.739429 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:09:31.739435 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:09:31.739492 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:09:31.765811 59960 cri.go:89] found id: "7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:31.765834 59960 cri.go:89] found id: ""
I1126 20:09:31.765842 59960 logs.go:282] 1 containers: [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f]
I1126 20:09:31.765960 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:31.769463 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:09:31.769554 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:09:31.802081 59960 cri.go:89] found id: ""
I1126 20:09:31.802107 59960 logs.go:282] 0 containers: []
W1126 20:09:31.802116 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:09:31.802153 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:09:31.802172 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:31.849273 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:09:31.849308 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:31.902662 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:09:31.902697 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:09:31.990675 59960 logs.go:123] Gathering logs for container status ...
I1126 20:09:31.990710 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:09:32.022637 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:09:32.022667 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:09:32.100797 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:09:32.092180 2234 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:32.093036 2234 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:32.094703 2234 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:32.095415 2234 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:32.097142 2234 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:09:32.092180 2234 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:32.093036 2234 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:32.094703 2234 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:32.095415 2234 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:32.097142 2234 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:09:32.100820 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:09:32.100833 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:32.146149 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:09:32.146184 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:32.172943 59960 logs.go:123] Gathering logs for kube-controller-manager [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f] ...
I1126 20:09:32.172970 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:32.199037 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:09:32.199063 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:09:32.306507 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:09:32.306540 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:09:32.319193 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:09:32.319221 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:34.849302 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:34.860158 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:09:34.860250 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:09:34.887094 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:34.887113 59960 cri.go:89] found id: ""
I1126 20:09:34.887121 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:09:34.887177 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:34.890890 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:09:34.890964 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:09:34.921149 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:34.921177 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:34.921182 59960 cri.go:89] found id: ""
I1126 20:09:34.921189 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:09:34.921243 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:34.924938 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:34.928493 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:09:34.928569 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:09:34.954052 59960 cri.go:89] found id: ""
I1126 20:09:34.954078 59960 logs.go:282] 0 containers: []
W1126 20:09:34.954087 59960 logs.go:284] No container was found matching "coredns"
I1126 20:09:34.954093 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:09:34.954206 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:09:34.985031 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:34.985054 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:34.985059 59960 cri.go:89] found id: ""
I1126 20:09:34.985067 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:09:34.985121 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:34.989050 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:34.992852 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:09:34.992934 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:09:35.019287 59960 cri.go:89] found id: ""
I1126 20:09:35.019314 59960 logs.go:282] 0 containers: []
W1126 20:09:35.019323 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:09:35.019330 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:09:35.019393 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:09:35.049190 59960 cri.go:89] found id: "7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:35.049217 59960 cri.go:89] found id: ""
I1126 20:09:35.049237 59960 logs.go:282] 1 containers: [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f]
I1126 20:09:35.049313 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:35.053627 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:09:35.053713 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:09:35.091326 59960 cri.go:89] found id: ""
I1126 20:09:35.091394 59960 logs.go:282] 0 containers: []
W1126 20:09:35.091420 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:09:35.091440 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:09:35.091476 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:09:35.188523 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:09:35.188560 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:35.220725 59960 logs.go:123] Gathering logs for kube-controller-manager [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f] ...
I1126 20:09:35.220755 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:35.250614 59960 logs.go:123] Gathering logs for container status ...
I1126 20:09:35.250643 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:09:35.289963 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:09:35.289995 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:09:35.303153 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:09:35.303180 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:09:35.375929 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:09:35.367382 2375 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:35.368117 2375 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:35.369869 2375 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:35.370618 2375 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:35.372228 2375 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:09:35.367382 2375 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:35.368117 2375 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:35.369869 2375 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:35.370618 2375 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:35.372228 2375 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:09:35.375952 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:09:35.375968 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:35.403037 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:09:35.403066 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:35.445367 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:09:35.445402 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:35.491101 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:09:35.491135 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:35.561489 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:09:35.561524 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:09:38.150634 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:38.161275 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:09:38.161346 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:09:38.189434 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:38.189461 59960 cri.go:89] found id: ""
I1126 20:09:38.189469 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:09:38.189530 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:38.195206 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:09:38.195288 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:09:38.223137 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:38.223160 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:38.223166 59960 cri.go:89] found id: ""
I1126 20:09:38.223173 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:09:38.223227 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:38.226977 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:38.230547 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:09:38.230624 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:09:38.255698 59960 cri.go:89] found id: ""
I1126 20:09:38.255723 59960 logs.go:282] 0 containers: []
W1126 20:09:38.255732 59960 logs.go:284] No container was found matching "coredns"
I1126 20:09:38.255742 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:09:38.255800 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:09:38.285059 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:38.285082 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:38.285087 59960 cri.go:89] found id: ""
I1126 20:09:38.285097 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:09:38.285151 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:38.288799 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:38.292713 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:09:38.292786 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:09:38.318862 59960 cri.go:89] found id: ""
I1126 20:09:38.318889 59960 logs.go:282] 0 containers: []
W1126 20:09:38.318898 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:09:38.318905 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:09:38.318963 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:09:38.346973 59960 cri.go:89] found id: "7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:38.346996 59960 cri.go:89] found id: ""
I1126 20:09:38.347005 59960 logs.go:282] 1 containers: [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f]
I1126 20:09:38.347057 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:38.350729 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:09:38.350856 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:09:38.378801 59960 cri.go:89] found id: ""
I1126 20:09:38.378827 59960 logs.go:282] 0 containers: []
W1126 20:09:38.378836 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:09:38.378845 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:09:38.378915 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:09:38.390980 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:09:38.391009 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:38.422522 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:09:38.422550 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:38.469058 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:09:38.469133 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:38.523109 59960 logs.go:123] Gathering logs for kube-controller-manager [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f] ...
I1126 20:09:38.523182 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:38.559691 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:09:38.559716 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:09:38.646468 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:09:38.646504 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:09:38.751509 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:09:38.751551 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:09:38.836492 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:09:38.827693 2526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:38.828759 2526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:38.829560 2526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:38.830636 2526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:38.831318 2526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:09:38.827693 2526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:38.828759 2526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:38.829560 2526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:38.830636 2526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:38.831318 2526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:09:38.836516 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:09:38.836528 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:38.876587 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:09:38.876623 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:38.910948 59960 logs.go:123] Gathering logs for container status ...
I1126 20:09:38.910987 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:09:41.443533 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:41.454798 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:09:41.454873 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:09:41.485670 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:41.485699 59960 cri.go:89] found id: ""
I1126 20:09:41.485707 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:09:41.485761 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:41.489619 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:09:41.489690 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:09:41.525686 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:41.525710 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:41.525714 59960 cri.go:89] found id: ""
I1126 20:09:41.525722 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:09:41.525777 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:41.536491 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:41.541670 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:09:41.541797 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:09:41.570295 59960 cri.go:89] found id: ""
I1126 20:09:41.570319 59960 logs.go:282] 0 containers: []
W1126 20:09:41.570327 59960 logs.go:284] No container was found matching "coredns"
I1126 20:09:41.570334 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:09:41.570393 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:09:41.598145 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:41.598169 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:41.598175 59960 cri.go:89] found id: ""
I1126 20:09:41.598182 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:09:41.598258 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:41.602230 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:41.606445 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:09:41.606530 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:09:41.636614 59960 cri.go:89] found id: ""
I1126 20:09:41.636637 59960 logs.go:282] 0 containers: []
W1126 20:09:41.636646 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:09:41.636652 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:09:41.636707 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:09:41.663292 59960 cri.go:89] found id: "7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:41.663315 59960 cri.go:89] found id: ""
I1126 20:09:41.663327 59960 logs.go:282] 1 containers: [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f]
I1126 20:09:41.663382 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:41.667194 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:09:41.667277 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:09:41.696056 59960 cri.go:89] found id: ""
I1126 20:09:41.696081 59960 logs.go:282] 0 containers: []
W1126 20:09:41.696090 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:09:41.696099 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:09:41.696110 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:09:41.794427 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:09:41.794463 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:41.822463 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:09:41.822493 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:41.871566 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:09:41.871599 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:41.916725 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:09:41.916759 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:41.950381 59960 logs.go:123] Gathering logs for container status ...
I1126 20:09:41.950410 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:09:41.982658 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:09:41.982692 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:09:41.996639 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:09:41.996672 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:09:42.087350 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:09:42.079184 2671 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:42.079744 2671 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:42.081320 2671 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:42.081972 2671 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:42.083647 2671 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:09:42.079184 2671 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:42.079744 2671 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:42.081320 2671 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:42.081972 2671 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:42.083647 2671 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:09:42.087369 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:09:42.087384 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:42.175919 59960 logs.go:123] Gathering logs for kube-controller-manager [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f] ...
I1126 20:09:42.176012 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:42.281379 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:09:42.281406 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:09:44.882212 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:44.893873 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:09:44.893969 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:09:44.923663 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:44.923683 59960 cri.go:89] found id: ""
I1126 20:09:44.923691 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:09:44.923744 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:44.927892 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:09:44.927959 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:09:44.958403 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:44.958423 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:44.958427 59960 cri.go:89] found id: ""
I1126 20:09:44.958434 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:09:44.958486 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:44.962367 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:44.966913 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:09:44.966985 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:09:45.000482 59960 cri.go:89] found id: ""
I1126 20:09:45.000503 59960 logs.go:282] 0 containers: []
W1126 20:09:45.000511 59960 logs.go:284] No container was found matching "coredns"
I1126 20:09:45.000517 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:09:45.000572 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:09:45.031381 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:45.031401 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:45.031406 59960 cri.go:89] found id: ""
I1126 20:09:45.031414 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:09:45.031471 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:45.036637 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:45.042551 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:09:45.042723 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:09:45.086906 59960 cri.go:89] found id: ""
I1126 20:09:45.086987 59960 logs.go:282] 0 containers: []
W1126 20:09:45.087026 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:09:45.087050 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:09:45.087153 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:09:45.137504 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:09:45.137578 59960 cri.go:89] found id: "7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:45.137598 59960 cri.go:89] found id: ""
I1126 20:09:45.137621 59960 logs.go:282] 2 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f]
I1126 20:09:45.137715 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:45.143678 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:45.149235 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:09:45.149438 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:09:45.196979 59960 cri.go:89] found id: ""
I1126 20:09:45.197063 59960 logs.go:282] 0 containers: []
W1126 20:09:45.197089 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:09:45.197146 59960 logs.go:123] Gathering logs for kube-controller-manager [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f] ...
I1126 20:09:45.197191 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:45.267194 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:09:45.267280 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:09:45.386434 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:09:45.386524 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:09:45.468233 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:09:45.459943 2775 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:45.460742 2775 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:45.462336 2775 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:45.462624 2775 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:45.464644 2775 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:09:45.459943 2775 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:45.460742 2775 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:45.462336 2775 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:45.462624 2775 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:45.464644 2775 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:09:45.468305 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:09:45.468342 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:45.541622 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:09:45.541649 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:45.613664 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:09:45.613695 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:09:45.641765 59960 logs.go:123] Gathering logs for container status ...
I1126 20:09:45.641794 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:09:45.702809 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:09:45.702837 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:09:45.807019 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:09:45.807056 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:09:45.820258 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:09:45.820289 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:45.867345 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:09:45.867376 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:45.921560 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:09:45.921596 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:48.454091 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:48.464670 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:09:48.464755 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:09:48.493056 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:48.493081 59960 cri.go:89] found id: ""
I1126 20:09:48.493089 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:09:48.493144 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:48.496943 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:09:48.497007 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:09:48.524995 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:48.525020 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:48.525025 59960 cri.go:89] found id: ""
I1126 20:09:48.525032 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:09:48.525085 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:48.528726 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:48.532247 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:09:48.532317 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:09:48.557862 59960 cri.go:89] found id: ""
I1126 20:09:48.557887 59960 logs.go:282] 0 containers: []
W1126 20:09:48.557896 59960 logs.go:284] No container was found matching "coredns"
I1126 20:09:48.557902 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:09:48.557988 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:09:48.587744 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:48.587765 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:48.587770 59960 cri.go:89] found id: ""
I1126 20:09:48.587777 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:09:48.587832 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:48.591388 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:48.594875 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:09:48.594985 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:09:48.627277 59960 cri.go:89] found id: ""
I1126 20:09:48.627298 59960 logs.go:282] 0 containers: []
W1126 20:09:48.627313 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:09:48.627352 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:09:48.627433 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:09:48.664063 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:09:48.664088 59960 cri.go:89] found id: "7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:48.664102 59960 cri.go:89] found id: ""
I1126 20:09:48.664110 59960 logs.go:282] 2 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f]
I1126 20:09:48.664222 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:48.668219 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:48.671608 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:09:48.671680 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:09:48.700294 59960 cri.go:89] found id: ""
I1126 20:09:48.700322 59960 logs.go:282] 0 containers: []
W1126 20:09:48.700331 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:09:48.700340 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:09:48.700351 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:09:48.793887 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:09:48.793974 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:09:48.807445 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:09:48.807472 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:09:48.881133 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:09:48.873596 2915 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:48.874156 2915 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:48.875737 2915 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:48.876232 2915 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:48.877299 2915 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:09:48.873596 2915 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:48.874156 2915 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:48.875737 2915 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:48.876232 2915 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:48.877299 2915 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:09:48.881155 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:09:48.881167 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:48.926338 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:09:48.926370 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:48.980929 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:09:48.980964 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:09:49.008703 59960 logs.go:123] Gathering logs for kube-controller-manager [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f] ...
I1126 20:09:49.008729 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:49.035020 59960 logs.go:123] Gathering logs for container status ...
I1126 20:09:49.035134 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:09:49.075209 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:09:49.075239 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:49.102778 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:09:49.102808 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:49.148209 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:09:49.148243 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:49.175449 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:09:49.175477 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:09:51.750461 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:51.761173 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:09:51.761247 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:09:51.792174 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:51.792200 59960 cri.go:89] found id: ""
I1126 20:09:51.792207 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:09:51.792272 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:51.796194 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:09:51.796266 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:09:51.826309 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:51.826333 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:51.826339 59960 cri.go:89] found id: ""
I1126 20:09:51.826346 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:09:51.826408 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:51.830049 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:51.833626 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:09:51.833703 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:09:51.864668 59960 cri.go:89] found id: ""
I1126 20:09:51.864693 59960 logs.go:282] 0 containers: []
W1126 20:09:51.864702 59960 logs.go:284] No container was found matching "coredns"
I1126 20:09:51.864709 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:09:51.864770 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:09:51.902154 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:51.902178 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:51.902184 59960 cri.go:89] found id: ""
I1126 20:09:51.902191 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:09:51.902244 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:51.906099 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:51.909550 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:09:51.909622 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:09:51.940956 59960 cri.go:89] found id: ""
I1126 20:09:51.940984 59960 logs.go:282] 0 containers: []
W1126 20:09:51.940993 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:09:51.941000 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:09:51.941057 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:09:51.967086 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:09:51.967112 59960 cri.go:89] found id: "7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:51.967117 59960 cri.go:89] found id: ""
I1126 20:09:51.967125 59960 logs.go:282] 2 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f]
I1126 20:09:51.967206 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:51.970992 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:51.974344 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:09:51.974463 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:09:52.006654 59960 cri.go:89] found id: ""
I1126 20:09:52.006675 59960 logs.go:282] 0 containers: []
W1126 20:09:52.006684 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:09:52.006693 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:09:52.006705 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:52.033587 59960 logs.go:123] Gathering logs for kube-controller-manager [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f] ...
I1126 20:09:52.033621 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:52.062777 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:09:52.062810 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:09:52.136250 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:09:52.127112 3069 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:52.127989 3069 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:52.129548 3069 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:52.130437 3069 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:52.132317 3069 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:09:52.127112 3069 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:52.127989 3069 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:52.129548 3069 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:52.130437 3069 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:52.132317 3069 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:09:52.136279 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:09:52.136292 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:52.165716 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:09:52.165792 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:52.210120 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:09:52.210157 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:52.266182 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:09:52.266228 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:09:52.296704 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:09:52.296732 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:09:52.373394 59960 logs.go:123] Gathering logs for container status ...
I1126 20:09:52.373432 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:09:52.409405 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:09:52.409436 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:09:52.508717 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:09:52.508755 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:09:52.520510 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:09:52.520577 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:55.069988 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:55.081385 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:09:55.081477 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:09:55.109272 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:55.109297 59960 cri.go:89] found id: ""
I1126 20:09:55.109306 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:09:55.109393 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:55.113332 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:09:55.113409 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:09:55.144644 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:55.144728 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:55.144749 59960 cri.go:89] found id: ""
I1126 20:09:55.144782 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:09:55.144860 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:55.148962 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:55.153598 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:09:55.153724 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:09:55.180168 59960 cri.go:89] found id: ""
I1126 20:09:55.180235 59960 logs.go:282] 0 containers: []
W1126 20:09:55.180274 59960 logs.go:284] No container was found matching "coredns"
I1126 20:09:55.180302 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:09:55.180378 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:09:55.207578 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:55.207606 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:55.207611 59960 cri.go:89] found id: ""
I1126 20:09:55.207621 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:09:55.207698 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:55.211665 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:55.215295 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:09:55.215371 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:09:55.243201 59960 cri.go:89] found id: ""
I1126 20:09:55.243228 59960 logs.go:282] 0 containers: []
W1126 20:09:55.243237 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:09:55.243243 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:09:55.243299 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:09:55.273345 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:09:55.273370 59960 cri.go:89] found id: "7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:55.273375 59960 cri.go:89] found id: ""
I1126 20:09:55.273382 59960 logs.go:282] 2 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f]
I1126 20:09:55.273434 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:55.277156 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:55.280557 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:09:55.280629 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:09:55.306973 59960 cri.go:89] found id: ""
I1126 20:09:55.307037 59960 logs.go:282] 0 containers: []
W1126 20:09:55.307052 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:09:55.307061 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:09:55.307072 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:09:55.405440 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:09:55.405474 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:09:55.418598 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:09:55.418628 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:09:55.487261 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:09:55.479261 3202 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:55.479915 3202 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:55.481393 3202 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:55.481846 3202 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:55.483618 3202 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:09:55.479261 3202 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:55.479915 3202 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:55.481393 3202 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:55.481846 3202 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:55.483618 3202 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:09:55.487286 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:09:55.487299 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:55.531555 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:09:55.531626 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:55.601020 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:09:55.601057 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:55.632319 59960 logs.go:123] Gathering logs for kube-controller-manager [7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f] ...
I1126 20:09:55.632347 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 7265a1863deba220803b023ae281c19e30b2afb00cffffdf24d8581cd818c53f"
I1126 20:09:55.660851 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:09:55.660881 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:09:55.742963 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:09:55.742998 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:55.773047 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:09:55.773076 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:55.826960 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:09:55.826991 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:09:55.855917 59960 logs.go:123] Gathering logs for container status ...
I1126 20:09:55.855944 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:09:58.399772 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:09:58.415975 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:09:58.416043 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:09:58.442760 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:58.442782 59960 cri.go:89] found id: ""
I1126 20:09:58.442792 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:09:58.442850 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:58.446527 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:09:58.446620 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:09:58.476049 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:58.476071 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:58.476076 59960 cri.go:89] found id: ""
I1126 20:09:58.476084 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:09:58.476141 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:58.480019 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:58.483716 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:09:58.483799 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:09:58.514116 59960 cri.go:89] found id: ""
I1126 20:09:58.514138 59960 logs.go:282] 0 containers: []
W1126 20:09:58.514147 59960 logs.go:284] No container was found matching "coredns"
I1126 20:09:58.514153 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:09:58.514220 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:09:58.547211 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:58.547233 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:58.547239 59960 cri.go:89] found id: ""
I1126 20:09:58.547257 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:09:58.547342 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:58.551299 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:58.554848 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:09:58.554921 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:09:58.583768 59960 cri.go:89] found id: ""
I1126 20:09:58.583793 59960 logs.go:282] 0 containers: []
W1126 20:09:58.583802 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:09:58.583809 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:09:58.583865 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:09:58.611601 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:09:58.611635 59960 cri.go:89] found id: ""
I1126 20:09:58.611644 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:09:58.611703 59960 ssh_runner.go:195] Run: which crictl
I1126 20:09:58.615732 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:09:58.615802 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:09:58.646048 59960 cri.go:89] found id: ""
I1126 20:09:58.646087 59960 logs.go:282] 0 containers: []
W1126 20:09:58.646096 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:09:58.646106 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:09:58.646135 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:09:58.745296 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:09:58.745332 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:09:58.820265 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:09:58.811642 3345 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:58.812262 3345 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:58.813785 3345 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:58.814448 3345 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:58.815924 3345 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:09:58.811642 3345 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:58.812262 3345 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:58.813785 3345 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:58.814448 3345 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:09:58.815924 3345 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:09:58.820294 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:09:58.820308 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:09:58.877523 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:09:58.877556 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:09:58.904630 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:09:58.904656 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:09:58.980105 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:09:58.980138 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:09:58.992220 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:09:58.992248 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:09:59.019086 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:09:59.019112 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:09:59.058229 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:09:59.058260 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:09:59.106394 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:09:59.106427 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:09:59.134445 59960 logs.go:123] Gathering logs for container status ...
I1126 20:09:59.134474 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:01.667677 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:01.679153 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:01.679227 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:01.713101 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:01.713122 59960 cri.go:89] found id: ""
I1126 20:10:01.713130 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:01.713185 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:01.717042 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:01.717117 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:01.748792 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:01.748817 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:01.748823 59960 cri.go:89] found id: ""
I1126 20:10:01.748832 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:01.748889 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:01.752752 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:01.756411 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:01.756487 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:01.785898 59960 cri.go:89] found id: ""
I1126 20:10:01.785954 59960 logs.go:282] 0 containers: []
W1126 20:10:01.785964 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:01.785971 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:01.786033 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:01.817470 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:01.817496 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:01.817502 59960 cri.go:89] found id: ""
I1126 20:10:01.817509 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:01.817567 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:01.821688 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:01.826052 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:01.826203 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:01.856542 59960 cri.go:89] found id: ""
I1126 20:10:01.856568 59960 logs.go:282] 0 containers: []
W1126 20:10:01.856590 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:01.856620 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:01.856742 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:01.893138 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:01.893218 59960 cri.go:89] found id: ""
I1126 20:10:01.893242 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:01.893337 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:01.897863 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:01.898026 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:01.935921 59960 cri.go:89] found id: ""
I1126 20:10:01.935951 59960 logs.go:282] 0 containers: []
W1126 20:10:01.935961 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:01.935971 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:01.935985 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:01.973303 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:01.973332 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:02.028454 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:02.028493 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:02.074241 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:02.074272 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:02.162898 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:02.162936 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:02.176057 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:02.176088 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:02.235629 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:02.235665 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:02.306607 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:02.306643 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:02.337699 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:02.337729 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:02.374553 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:02.374582 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:02.481202 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:02.481238 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:02.563313 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:02.555444 3547 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:02.556211 3547 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:02.557668 3547 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:02.558242 3547 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:02.559786 3547 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:02.555444 3547 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:02.556211 3547 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:02.557668 3547 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:02.558242 3547 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:02.559786 3547 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:05.064305 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:05.075852 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:05.075925 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:05.108322 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:05.108345 59960 cri.go:89] found id: ""
I1126 20:10:05.108354 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:05.108410 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:05.112382 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:05.112460 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:05.140946 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:05.141021 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:05.141040 59960 cri.go:89] found id: ""
I1126 20:10:05.141063 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:05.141150 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:05.145278 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:05.148898 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:05.148974 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:05.176423 59960 cri.go:89] found id: ""
I1126 20:10:05.176450 59960 logs.go:282] 0 containers: []
W1126 20:10:05.176459 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:05.176466 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:05.176527 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:05.204990 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:05.205013 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:05.205018 59960 cri.go:89] found id: ""
I1126 20:10:05.205026 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:05.205088 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:05.208959 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:05.212627 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:05.212730 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:05.239581 59960 cri.go:89] found id: ""
I1126 20:10:05.239604 59960 logs.go:282] 0 containers: []
W1126 20:10:05.239614 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:05.239620 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:05.239679 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:05.268087 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:05.268110 59960 cri.go:89] found id: ""
I1126 20:10:05.268119 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:05.268176 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:05.271819 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:05.271923 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:05.298753 59960 cri.go:89] found id: ""
I1126 20:10:05.298819 59960 logs.go:282] 0 containers: []
W1126 20:10:05.298833 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:05.298843 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:05.298855 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:05.325518 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:05.325548 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:05.376406 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:05.376438 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:05.428781 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:05.428943 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:05.459754 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:05.459786 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:05.487550 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:05.487581 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:05.520035 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:05.520071 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:05.616425 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:05.616503 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:05.630189 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:05.630221 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:05.715272 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:05.705315 3677 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:05.706188 3677 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:05.708012 3677 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:05.708749 3677 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:05.710497 3677 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:05.705315 3677 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:05.706188 3677 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:05.708012 3677 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:05.708749 3677 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:05.710497 3677 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:05.715301 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:05.715315 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:05.768473 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:05.768507 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:08.349688 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:08.360619 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:08.360693 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:08.388583 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:08.388610 59960 cri.go:89] found id: ""
I1126 20:10:08.388619 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:08.388678 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:08.392264 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:08.392334 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:08.418523 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:08.418549 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:08.418554 59960 cri.go:89] found id: ""
I1126 20:10:08.418562 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:08.418621 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:08.422368 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:08.425851 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:08.425954 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:08.456520 59960 cri.go:89] found id: ""
I1126 20:10:08.456546 59960 logs.go:282] 0 containers: []
W1126 20:10:08.456555 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:08.456562 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:08.456620 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:08.487158 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:08.487182 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:08.487186 59960 cri.go:89] found id: ""
I1126 20:10:08.487195 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:08.487268 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:08.491193 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:08.494690 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:08.494760 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:08.523674 59960 cri.go:89] found id: ""
I1126 20:10:08.523699 59960 logs.go:282] 0 containers: []
W1126 20:10:08.523708 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:08.523715 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:08.523773 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:08.569422 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:08.569442 59960 cri.go:89] found id: ""
I1126 20:10:08.569449 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:08.569505 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:08.572997 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:08.573065 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:08.599736 59960 cri.go:89] found id: ""
I1126 20:10:08.599763 59960 logs.go:282] 0 containers: []
W1126 20:10:08.599772 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:08.599781 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:08.599799 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:08.674461 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:08.665974 3757 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:08.666705 3757 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:08.668447 3757 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:08.669108 3757 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:08.670766 3757 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:08.665974 3757 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:08.666705 3757 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:08.668447 3757 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:08.669108 3757 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:08.670766 3757 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:08.674482 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:08.674495 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:08.726546 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:08.726591 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:08.783639 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:08.783690 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:08.860709 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:08.860759 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:08.873030 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:08.873058 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:08.899170 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:08.899199 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:08.940773 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:08.940855 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:08.969671 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:08.969762 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:09.001544 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:09.001621 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:09.035799 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:09.035837 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:11.634159 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:11.645145 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:11.645262 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:11.684091 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:11.684113 59960 cri.go:89] found id: ""
I1126 20:10:11.684121 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:11.684198 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:11.687930 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:11.688002 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:11.716342 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:11.716366 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:11.716372 59960 cri.go:89] found id: ""
I1126 20:10:11.716380 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:11.716438 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:11.720592 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:11.724106 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:11.724181 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:11.750971 59960 cri.go:89] found id: ""
I1126 20:10:11.750997 59960 logs.go:282] 0 containers: []
W1126 20:10:11.751007 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:11.751014 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:11.751140 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:11.778888 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:11.778912 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:11.778917 59960 cri.go:89] found id: ""
I1126 20:10:11.778924 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:11.778979 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:11.782704 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:11.786153 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:11.786245 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:11.812859 59960 cri.go:89] found id: ""
I1126 20:10:11.812924 59960 logs.go:282] 0 containers: []
W1126 20:10:11.812953 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:11.812972 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:11.813047 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:11.844995 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:11.845065 59960 cri.go:89] found id: ""
I1126 20:10:11.845089 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:11.845159 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:11.848928 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:11.849056 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:11.878557 59960 cri.go:89] found id: ""
I1126 20:10:11.878634 59960 logs.go:282] 0 containers: []
W1126 20:10:11.878657 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:11.878674 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:11.878686 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:11.911996 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:11.912024 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:11.957531 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:11.957700 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:12.002561 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:12.002600 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:12.037611 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:12.037655 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:12.124659 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:12.124695 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:12.157527 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:12.157559 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:12.255561 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:12.255597 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:12.270701 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:12.270727 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:12.344084 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:12.335378 3942 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:12.336132 3942 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:12.337729 3942 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:12.338527 3942 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:12.340203 3942 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:12.335378 3942 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:12.336132 3942 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:12.337729 3942 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:12.338527 3942 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:12.340203 3942 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:12.344111 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:12.344127 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:12.414064 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:12.414099 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:14.957062 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:14.971279 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:14.971358 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:15.002850 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:15.002871 59960 cri.go:89] found id: ""
I1126 20:10:15.002879 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:15.002953 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:15.007210 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:15.007317 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:15.044904 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:15.044929 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:15.044934 59960 cri.go:89] found id: ""
I1126 20:10:15.044943 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:15.045037 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:15.050180 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:15.055192 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:15.055293 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:15.087772 59960 cri.go:89] found id: ""
I1126 20:10:15.087798 59960 logs.go:282] 0 containers: []
W1126 20:10:15.087815 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:15.087822 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:15.087883 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:15.117095 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:15.117114 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:15.117119 59960 cri.go:89] found id: ""
I1126 20:10:15.117127 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:15.117185 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:15.120995 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:15.124760 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:15.124885 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:15.157854 59960 cri.go:89] found id: ""
I1126 20:10:15.157954 59960 logs.go:282] 0 containers: []
W1126 20:10:15.157994 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:15.158017 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:15.158084 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:15.190383 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:15.190407 59960 cri.go:89] found id: ""
I1126 20:10:15.190417 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:15.190474 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:15.194524 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:15.194624 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:15.223311 59960 cri.go:89] found id: ""
I1126 20:10:15.223337 59960 logs.go:282] 0 containers: []
W1126 20:10:15.223346 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:15.223355 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:15.223366 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:15.236105 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:15.236134 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:15.263408 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:15.263436 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:15.308099 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:15.308133 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:15.370222 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:15.370258 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:15.412978 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:15.413009 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:15.482330 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:15.473679 4073 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:15.474420 4073 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:15.476124 4073 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:15.476749 4073 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:15.478398 4073 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:15.473679 4073 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:15.474420 4073 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:15.476124 4073 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:15.476749 4073 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:15.478398 4073 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:15.482403 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:15.482428 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:15.528305 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:15.528335 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:15.564111 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:15.564138 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:15.592541 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:15.592569 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:15.673319 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:15.673357 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:18.279646 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:18.290358 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:18.290427 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:18.319136 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:18.319159 59960 cri.go:89] found id: ""
I1126 20:10:18.319168 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:18.319225 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:18.322893 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:18.322967 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:18.350092 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:18.350120 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:18.350126 59960 cri.go:89] found id: ""
I1126 20:10:18.350139 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:18.350193 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:18.354777 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:18.358503 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:18.358602 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:18.396162 59960 cri.go:89] found id: ""
I1126 20:10:18.396185 59960 logs.go:282] 0 containers: []
W1126 20:10:18.396193 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:18.396199 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:18.396262 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:18.430093 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:18.430119 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:18.430124 59960 cri.go:89] found id: ""
I1126 20:10:18.430131 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:18.430196 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:18.434456 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:18.438374 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:18.438451 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:18.478030 59960 cri.go:89] found id: ""
I1126 20:10:18.478058 59960 logs.go:282] 0 containers: []
W1126 20:10:18.478070 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:18.478076 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:18.478137 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:18.506317 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:18.506340 59960 cri.go:89] found id: ""
I1126 20:10:18.506349 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:18.506410 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:18.510476 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:18.510552 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:18.550337 59960 cri.go:89] found id: ""
I1126 20:10:18.550408 59960 logs.go:282] 0 containers: []
W1126 20:10:18.550436 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:18.550454 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:18.550487 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:18.621602 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:18.613602 4172 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:18.614230 4172 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:18.615899 4172 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:18.616339 4172 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:18.617881 4172 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:18.613602 4172 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:18.614230 4172 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:18.615899 4172 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:18.616339 4172 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:18.617881 4172 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:18.621625 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:18.621638 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:18.648795 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:18.648824 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:18.691314 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:18.691358 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:18.771327 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:18.771367 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:18.808287 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:18.808319 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:18.907011 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:18.907048 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:18.919575 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:18.919605 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:18.961664 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:18.961697 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:19.020056 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:19.020092 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:19.050179 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:19.050206 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:21.599106 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:21.611209 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:21.611309 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:21.639207 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:21.639229 59960 cri.go:89] found id: ""
I1126 20:10:21.639238 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:21.639296 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:21.643290 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:21.643365 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:21.675608 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:21.675633 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:21.675639 59960 cri.go:89] found id: ""
I1126 20:10:21.675648 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:21.675702 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:21.679772 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:21.683385 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:21.683511 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:21.719004 59960 cri.go:89] found id: ""
I1126 20:10:21.719078 59960 logs.go:282] 0 containers: []
W1126 20:10:21.719102 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:21.719123 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:21.719196 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:21.745555 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:21.745634 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:21.745660 59960 cri.go:89] found id: ""
I1126 20:10:21.745681 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:21.745750 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:21.750313 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:21.753830 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:21.753907 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:21.781119 59960 cri.go:89] found id: ""
I1126 20:10:21.781199 59960 logs.go:282] 0 containers: []
W1126 20:10:21.781222 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:21.781243 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:21.781347 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:21.809894 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:21.810006 59960 cri.go:89] found id: ""
I1126 20:10:21.810022 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:21.810092 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:21.813756 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:21.813853 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:21.840725 59960 cri.go:89] found id: ""
I1126 20:10:21.840751 59960 logs.go:282] 0 containers: []
W1126 20:10:21.840760 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:21.840769 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:21.840781 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:21.854145 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:21.854177 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:21.884873 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:21.884902 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:21.936427 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:21.936463 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:21.990170 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:21.990205 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:22.077016 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:22.077064 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:22.106941 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:22.106974 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:22.136672 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:22.136703 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:22.235594 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:22.235630 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:22.305008 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:22.295860 4358 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:22.296666 4358 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:22.298548 4358 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:22.299084 4358 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:22.300765 4358 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:22.295860 4358 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:22.296666 4358 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:22.298548 4358 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:22.299084 4358 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:22.300765 4358 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:22.305032 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:22.305046 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:22.378673 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:22.378711 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:24.920612 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:24.931941 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:24.932015 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:24.958956 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:24.958979 59960 cri.go:89] found id: ""
I1126 20:10:24.958988 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:24.959047 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:24.962853 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:24.962931 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:24.989108 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:24.989130 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:24.989134 59960 cri.go:89] found id: ""
I1126 20:10:24.989141 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:24.989195 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:24.992756 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:24.996360 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:24.996431 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:25.023636 59960 cri.go:89] found id: ""
I1126 20:10:25.023660 59960 logs.go:282] 0 containers: []
W1126 20:10:25.023670 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:25.023676 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:25.023751 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:25.056300 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:25.056325 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:25.056331 59960 cri.go:89] found id: ""
I1126 20:10:25.056339 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:25.056407 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:25.060822 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:25.066693 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:25.066825 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:25.098171 59960 cri.go:89] found id: ""
I1126 20:10:25.098239 59960 logs.go:282] 0 containers: []
W1126 20:10:25.098258 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:25.098265 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:25.098344 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:25.129634 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:25.129655 59960 cri.go:89] found id: ""
I1126 20:10:25.129664 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:25.129759 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:25.134599 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:25.134715 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:25.166870 59960 cri.go:89] found id: ""
I1126 20:10:25.166896 59960 logs.go:282] 0 containers: []
W1126 20:10:25.166905 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:25.166918 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:25.166931 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:25.201303 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:25.201335 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:25.234106 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:25.234132 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:25.335293 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:25.335329 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:25.367895 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:25.367920 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:25.408499 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:25.408540 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:25.489459 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:25.489496 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:25.525614 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:25.525642 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:25.540937 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:25.541079 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:25.619457 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:25.611129 4492 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:25.611986 4492 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:25.613567 4492 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:25.614319 4492 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:25.615842 4492 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:25.611129 4492 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:25.611986 4492 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:25.613567 4492 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:25.614319 4492 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:25.615842 4492 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:25.619480 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:25.619494 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:25.667380 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:25.667419 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:28.233076 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:28.244698 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:28.244770 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:28.272507 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:28.272530 59960 cri.go:89] found id: ""
I1126 20:10:28.272538 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:28.272596 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:28.276257 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:28.276333 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:28.303315 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:28.303337 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:28.303342 59960 cri.go:89] found id: ""
I1126 20:10:28.303349 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:28.303429 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:28.307300 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:28.310655 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:28.310727 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:28.337118 59960 cri.go:89] found id: ""
I1126 20:10:28.337140 59960 logs.go:282] 0 containers: []
W1126 20:10:28.337150 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:28.337156 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:28.337214 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:28.364328 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:28.364352 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:28.364358 59960 cri.go:89] found id: ""
I1126 20:10:28.364374 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:28.364436 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:28.368741 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:28.372299 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:28.372385 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:28.398315 59960 cri.go:89] found id: ""
I1126 20:10:28.398342 59960 logs.go:282] 0 containers: []
W1126 20:10:28.398351 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:28.398357 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:28.398418 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:28.426255 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:28.426276 59960 cri.go:89] found id: ""
I1126 20:10:28.426287 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:28.426342 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:28.429863 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:28.430017 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:28.456908 59960 cri.go:89] found id: ""
I1126 20:10:28.456933 59960 logs.go:282] 0 containers: []
W1126 20:10:28.456942 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:28.456951 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:28.456962 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:28.532783 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:28.532820 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:28.637119 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:28.637160 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:28.711269 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:28.702783 4585 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:28.703978 4585 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:28.704633 4585 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:28.706176 4585 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:28.706692 4585 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:28.702783 4585 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:28.703978 4585 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:28.704633 4585 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:28.706176 4585 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:28.706692 4585 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:28.711288 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:28.711304 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:28.737855 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:28.737883 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:28.789442 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:28.789477 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:28.820705 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:28.820738 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:28.855530 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:28.855560 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:28.868297 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:28.868324 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:28.913639 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:28.913673 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:28.973350 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:28.973386 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:31.500924 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:31.511869 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:31.511943 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:31.546414 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:31.546447 59960 cri.go:89] found id: ""
I1126 20:10:31.546456 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:31.546559 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:31.550296 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:31.550368 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:31.577840 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:31.577859 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:31.577864 59960 cri.go:89] found id: ""
I1126 20:10:31.577870 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:31.577967 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:31.581789 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:31.585352 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:31.585421 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:31.616396 59960 cri.go:89] found id: ""
I1126 20:10:31.616419 59960 logs.go:282] 0 containers: []
W1126 20:10:31.616428 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:31.616435 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:31.616491 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:31.641907 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:31.641971 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:31.641977 59960 cri.go:89] found id: ""
I1126 20:10:31.641984 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:31.642048 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:31.645886 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:31.649651 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:31.649732 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:31.682488 59960 cri.go:89] found id: ""
I1126 20:10:31.682512 59960 logs.go:282] 0 containers: []
W1126 20:10:31.682521 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:31.682527 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:31.682597 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:31.713608 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:31.713632 59960 cri.go:89] found id: ""
I1126 20:10:31.713641 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:31.713693 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:31.717274 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:31.717349 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:31.750907 59960 cri.go:89] found id: ""
I1126 20:10:31.750934 59960 logs.go:282] 0 containers: []
W1126 20:10:31.750948 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:31.750957 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:31.750970 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:31.822403 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:31.813458 4715 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:31.814237 4715 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:31.815876 4715 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:31.816493 4715 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:31.818239 4715 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:31.813458 4715 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:31.814237 4715 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:31.815876 4715 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:31.816493 4715 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:31.818239 4715 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:31.822425 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:31.822440 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:31.849676 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:31.849705 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:31.891923 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:31.891959 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:31.944564 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:31.944608 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:32.015493 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:32.015577 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:32.047447 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:32.047480 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:32.127183 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:32.127225 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:32.229734 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:32.229767 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:32.243678 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:32.243719 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:32.271264 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:32.271291 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:34.809253 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:34.819692 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:34.819817 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:34.846220 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:34.846240 59960 cri.go:89] found id: ""
I1126 20:10:34.846248 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:34.846302 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:34.849960 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:34.850035 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:34.875486 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:34.875510 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:34.875515 59960 cri.go:89] found id: ""
I1126 20:10:34.875522 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:34.875591 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:34.879655 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:34.883266 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:34.883341 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:34.910257 59960 cri.go:89] found id: ""
I1126 20:10:34.910286 59960 logs.go:282] 0 containers: []
W1126 20:10:34.910295 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:34.910302 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:34.910359 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:34.936501 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:34.936526 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:34.936531 59960 cri.go:89] found id: ""
I1126 20:10:34.936539 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:34.936602 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:34.940297 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:34.943886 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:34.943960 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:34.970440 59960 cri.go:89] found id: ""
I1126 20:10:34.970467 59960 logs.go:282] 0 containers: []
W1126 20:10:34.970476 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:34.970482 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:34.970540 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:34.996813 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:34.996833 59960 cri.go:89] found id: ""
I1126 20:10:34.996842 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:34.996901 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:35.000962 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:35.001030 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:35.029207 59960 cri.go:89] found id: ""
I1126 20:10:35.029229 59960 logs.go:282] 0 containers: []
W1126 20:10:35.029237 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:35.029247 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:35.029259 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:35.089280 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:35.089316 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:35.137518 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:35.137557 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:35.198701 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:35.198741 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:35.226526 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:35.226560 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:35.308302 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:35.308341 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:35.411713 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:35.411751 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:35.425089 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:35.425118 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:35.496500 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:35.487044 4896 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:35.487890 4896 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:35.489861 4896 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:35.490651 4896 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:35.492443 4896 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:35.487044 4896 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:35.487890 4896 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:35.489861 4896 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:35.490651 4896 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:35.492443 4896 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:35.496523 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:35.496538 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:35.521713 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:35.521740 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:35.552491 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:35.552520 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:38.092147 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:38.105386 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:38.105494 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:38.134115 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:38.134183 59960 cri.go:89] found id: ""
I1126 20:10:38.134204 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:38.134297 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:38.138342 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:38.138463 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:38.165373 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:38.165448 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:38.165468 59960 cri.go:89] found id: ""
I1126 20:10:38.165492 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:38.165591 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:38.169464 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:38.173100 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:38.173220 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:38.201795 59960 cri.go:89] found id: ""
I1126 20:10:38.201818 59960 logs.go:282] 0 containers: []
W1126 20:10:38.201826 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:38.201836 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:38.201895 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:38.234752 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:38.234776 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:38.234782 59960 cri.go:89] found id: ""
I1126 20:10:38.234789 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:38.234845 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:38.239023 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:38.242779 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:38.242854 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:38.271155 59960 cri.go:89] found id: ""
I1126 20:10:38.271184 59960 logs.go:282] 0 containers: []
W1126 20:10:38.271193 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:38.271200 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:38.271261 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:38.298657 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:38.298682 59960 cri.go:89] found id: ""
I1126 20:10:38.298691 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:38.298766 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:38.302858 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:38.302929 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:38.330494 59960 cri.go:89] found id: ""
I1126 20:10:38.330520 59960 logs.go:282] 0 containers: []
W1126 20:10:38.330529 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:38.330538 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:38.330570 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:38.356340 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:38.356374 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:38.401509 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:38.401542 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:38.463681 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:38.463719 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:38.496848 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:38.496881 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:38.524848 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:38.524875 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:38.607033 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:38.607098 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:38.709803 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:38.709840 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:38.722963 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:38.722995 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:38.796592 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:38.787909 5041 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:38.788704 5041 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:38.790425 5041 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:38.791012 5041 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:38.792912 5041 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:38.787909 5041 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:38.788704 5041 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:38.790425 5041 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:38.791012 5041 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:38.792912 5041 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:38.796617 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:38.796635 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:38.836671 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:38.836707 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:41.373598 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:41.384711 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:41.384792 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:41.414012 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:41.414038 59960 cri.go:89] found id: ""
I1126 20:10:41.414047 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:41.414103 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:41.417961 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:41.418036 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:41.450051 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:41.450076 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:41.450082 59960 cri.go:89] found id: ""
I1126 20:10:41.450089 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:41.450147 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:41.455240 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:41.459174 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:41.459275 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:41.487216 59960 cri.go:89] found id: ""
I1126 20:10:41.487241 59960 logs.go:282] 0 containers: []
W1126 20:10:41.487250 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:41.487257 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:41.487340 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:41.515666 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:41.515739 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:41.515751 59960 cri.go:89] found id: ""
I1126 20:10:41.515759 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:41.515817 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:41.519735 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:41.523565 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:41.523639 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:41.554213 59960 cri.go:89] found id: ""
I1126 20:10:41.554240 59960 logs.go:282] 0 containers: []
W1126 20:10:41.554250 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:41.554256 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:41.554321 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:41.584766 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:41.584790 59960 cri.go:89] found id: ""
I1126 20:10:41.584799 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:41.584861 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:41.589437 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:41.589510 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:41.616610 59960 cri.go:89] found id: ""
I1126 20:10:41.616638 59960 logs.go:282] 0 containers: []
W1126 20:10:41.616648 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:41.616657 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:41.616669 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:41.696316 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:41.696352 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:41.765798 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:41.758434 5133 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:41.758824 5133 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:41.760333 5133 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:41.760643 5133 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:41.762180 5133 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:41.758434 5133 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:41.758824 5133 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:41.760333 5133 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:41.760643 5133 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:41.762180 5133 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:41.765870 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:41.765900 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:41.791490 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:41.791517 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:41.827993 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:41.828022 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:41.854480 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:41.854511 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:41.885603 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:41.885632 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:41.984936 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:41.984970 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:41.997672 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:41.997701 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:42.039613 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:42.039668 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:42.100317 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:42.100359 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:44.745690 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:44.756208 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:44.756277 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:44.793586 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:44.793606 59960 cri.go:89] found id: ""
I1126 20:10:44.793614 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:44.793666 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:44.797466 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:44.797561 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:44.823288 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:44.823313 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:44.823319 59960 cri.go:89] found id: ""
I1126 20:10:44.823326 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:44.823383 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:44.828270 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:44.832190 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:44.832260 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:44.858643 59960 cri.go:89] found id: ""
I1126 20:10:44.858694 59960 logs.go:282] 0 containers: []
W1126 20:10:44.858704 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:44.858711 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:44.858772 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:44.887625 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:44.887711 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:44.887722 59960 cri.go:89] found id: ""
I1126 20:10:44.887730 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:44.887791 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:44.891593 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:44.895076 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:44.895151 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:44.924994 59960 cri.go:89] found id: ""
I1126 20:10:44.925060 59960 logs.go:282] 0 containers: []
W1126 20:10:44.925085 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:44.925104 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:44.925196 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:44.951783 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:44.951807 59960 cri.go:89] found id: ""
I1126 20:10:44.951816 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:44.951874 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:44.955505 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:44.955620 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:44.982789 59960 cri.go:89] found id: ""
I1126 20:10:44.982814 59960 logs.go:282] 0 containers: []
W1126 20:10:44.982822 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:44.982831 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:44.982843 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:45.010557 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:45.010586 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:45.141549 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:45.141632 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:45.253485 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:45.253554 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:45.353619 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:45.353660 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:45.408761 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:45.408795 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:45.443664 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:45.443692 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:45.470742 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:45.470773 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:45.504515 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:45.504544 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:45.608220 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:45.608254 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:45.620732 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:45.620761 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:45.707896 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:45.695026 5337 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:45.696388 5337 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:45.697297 5337 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:45.699791 5337 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:45.700340 5337 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:45.695026 5337 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:45.696388 5337 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:45.697297 5337 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:45.699791 5337 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:45.700340 5337 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:48.209609 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:48.220742 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:48.220811 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:48.247863 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:48.247886 59960 cri.go:89] found id: ""
I1126 20:10:48.247894 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:48.247949 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:48.251929 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:48.251997 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:48.280449 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:48.280470 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:48.280475 59960 cri.go:89] found id: ""
I1126 20:10:48.280483 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:48.280537 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:48.284732 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:48.288315 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:48.288405 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:48.316409 59960 cri.go:89] found id: ""
I1126 20:10:48.316432 59960 logs.go:282] 0 containers: []
W1126 20:10:48.316440 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:48.316446 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:48.316506 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:48.349208 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:48.349271 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:48.349289 59960 cri.go:89] found id: ""
I1126 20:10:48.349316 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:48.349408 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:48.354353 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:48.357751 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:48.357848 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:48.385059 59960 cri.go:89] found id: ""
I1126 20:10:48.385081 59960 logs.go:282] 0 containers: []
W1126 20:10:48.385090 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:48.385107 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:48.385185 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:48.411304 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:48.411326 59960 cri.go:89] found id: ""
I1126 20:10:48.411334 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:48.411405 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:48.415053 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:48.415156 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:48.441024 59960 cri.go:89] found id: ""
I1126 20:10:48.441046 59960 logs.go:282] 0 containers: []
W1126 20:10:48.441055 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:48.441063 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:48.441075 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:48.469644 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:48.469672 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:48.510776 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:48.510859 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:48.592885 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:48.592917 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:48.620191 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:48.620216 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:48.715671 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:48.715746 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:48.730976 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:48.731004 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:48.784446 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:48.784483 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:48.816189 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:48.816220 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:48.894569 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:48.894607 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:48.934181 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:48.934214 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:49.000322 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:48.992247 5475 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:48.992990 5475 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:48.994167 5475 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:48.994648 5475 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:48.996101 5475 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:48.992247 5475 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:48.992990 5475 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:48.994167 5475 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:48.994648 5475 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:48.996101 5475 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:51.500568 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:51.512500 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:51.512570 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:51.550166 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:51.550188 59960 cri.go:89] found id: ""
I1126 20:10:51.550196 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:51.550253 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:51.554115 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:51.554221 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:51.580857 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:51.580880 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:51.580885 59960 cri.go:89] found id: ""
I1126 20:10:51.580893 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:51.580949 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:51.584903 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:51.588661 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:51.588730 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:51.620121 59960 cri.go:89] found id: ""
I1126 20:10:51.620147 59960 logs.go:282] 0 containers: []
W1126 20:10:51.620156 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:51.620163 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:51.620225 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:51.648043 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:51.648066 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:51.648071 59960 cri.go:89] found id: ""
I1126 20:10:51.648079 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:51.648144 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:51.652146 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:51.656590 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:51.656658 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:51.684798 59960 cri.go:89] found id: ""
I1126 20:10:51.684825 59960 logs.go:282] 0 containers: []
W1126 20:10:51.684835 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:51.684842 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:51.684900 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:51.712247 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:51.712270 59960 cri.go:89] found id: ""
I1126 20:10:51.712279 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:51.712334 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:51.716105 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:51.716235 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:51.755296 59960 cri.go:89] found id: ""
I1126 20:10:51.755373 59960 logs.go:282] 0 containers: []
W1126 20:10:51.755389 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:51.755400 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:51.755412 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:51.782840 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:51.782871 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:51.826403 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:51.826436 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:51.894112 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:51.894148 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:51.920185 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:51.920212 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:51.993815 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:51.993856 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:52.030774 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:52.030804 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:52.112821 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:52.103396 5587 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:52.104540 5587 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:52.105295 5587 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:52.106939 5587 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:52.107489 5587 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:52.103396 5587 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:52.104540 5587 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:52.105295 5587 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:52.106939 5587 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:52.107489 5587 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:52.112847 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:52.112861 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:52.161738 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:52.161771 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:52.193340 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:52.193368 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:52.291814 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:52.291862 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:54.810104 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:54.820898 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:54.820971 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:54.849431 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:54.849454 59960 cri.go:89] found id: ""
I1126 20:10:54.849462 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:54.849524 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:54.853394 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:54.853465 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:54.879833 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:54.879855 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:54.879860 59960 cri.go:89] found id: ""
I1126 20:10:54.879867 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:54.879926 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:54.883636 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:54.887200 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:54.887280 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:54.913349 59960 cri.go:89] found id: ""
I1126 20:10:54.913374 59960 logs.go:282] 0 containers: []
W1126 20:10:54.913382 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:54.913389 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:54.913446 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:54.941189 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:54.941215 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:54.941221 59960 cri.go:89] found id: ""
I1126 20:10:54.941229 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:54.941285 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:54.945133 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:54.948594 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:54.948673 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:54.977649 59960 cri.go:89] found id: ""
I1126 20:10:54.977677 59960 logs.go:282] 0 containers: []
W1126 20:10:54.977687 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:54.977693 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:54.977768 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:55.008912 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:55.008938 59960 cri.go:89] found id: ""
I1126 20:10:55.008948 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:55.009005 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:55.012659 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:55.012727 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:55.056313 59960 cri.go:89] found id: ""
I1126 20:10:55.056393 59960 logs.go:282] 0 containers: []
W1126 20:10:55.056419 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:55.056449 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:55.056478 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:55.170137 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:55.170180 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:55.194458 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:55.194489 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:55.279906 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:55.272019 5685 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:55.272480 5685 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:55.274150 5685 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:55.274543 5685 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:55.276078 5685 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:55.272019 5685 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:55.272480 5685 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:55.274150 5685 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:55.274543 5685 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:55.276078 5685 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:55.279931 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:55.279945 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:55.321902 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:55.321949 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:55.351446 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:55.351474 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:55.426688 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:55.426723 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:55.463472 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:55.463501 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:55.510565 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:55.510598 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:55.580501 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:55.580534 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:55.614574 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:55.614602 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:10:58.162969 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:10:58.173910 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:10:58.174019 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:10:58.202329 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:58.202352 59960 cri.go:89] found id: ""
I1126 20:10:58.202360 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:10:58.202415 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:58.206274 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:10:58.206347 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:10:58.233721 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:58.233741 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:58.233745 59960 cri.go:89] found id: ""
I1126 20:10:58.233753 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:10:58.233811 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:58.237802 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:58.242346 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:10:58.242419 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:10:58.271013 59960 cri.go:89] found id: ""
I1126 20:10:58.271038 59960 logs.go:282] 0 containers: []
W1126 20:10:58.271047 59960 logs.go:284] No container was found matching "coredns"
I1126 20:10:58.271053 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:10:58.271109 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:10:58.298515 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:58.298538 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:58.298553 59960 cri.go:89] found id: ""
I1126 20:10:58.298560 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:10:58.298617 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:58.302497 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:58.306172 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:10:58.306241 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:10:58.331672 59960 cri.go:89] found id: ""
I1126 20:10:58.331698 59960 logs.go:282] 0 containers: []
W1126 20:10:58.331707 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:10:58.331714 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:10:58.331819 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:10:58.359197 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:58.359219 59960 cri.go:89] found id: ""
I1126 20:10:58.359228 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:10:58.359307 59960 ssh_runner.go:195] Run: which crictl
I1126 20:10:58.363274 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:10:58.363346 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:10:58.403777 59960 cri.go:89] found id: ""
I1126 20:10:58.403804 59960 logs.go:282] 0 containers: []
W1126 20:10:58.403814 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:10:58.403829 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:10:58.403890 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:10:58.504667 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:10:58.504702 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:10:58.517722 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:10:58.517750 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:10:58.589740 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:10:58.581328 5822 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:58.582205 5822 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:58.583896 5822 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:58.584218 5822 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:58.585780 5822 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:10:58.581328 5822 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:58.582205 5822 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:58.583896 5822 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:58.584218 5822 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:10:58.585780 5822 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:10:58.589761 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:10:58.589774 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:10:58.617621 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:10:58.617648 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:10:58.660238 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:10:58.660281 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:10:58.709585 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:10:58.709624 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:10:58.783550 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:10:58.783586 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:10:58.820181 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:10:58.820219 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:10:58.848533 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:10:58.848564 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:10:58.921350 59960 logs.go:123] Gathering logs for container status ...
I1126 20:10:58.921390 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:01.453687 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:01.467262 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:01.467365 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:01.498662 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:01.498715 59960 cri.go:89] found id: ""
I1126 20:11:01.498724 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:01.498785 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:01.504322 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:01.504445 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:01.545072 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:01.545098 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:01.545105 59960 cri.go:89] found id: ""
I1126 20:11:01.545113 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:01.545185 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:01.548993 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:01.552685 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:01.552797 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:01.582855 59960 cri.go:89] found id: ""
I1126 20:11:01.582881 59960 logs.go:282] 0 containers: []
W1126 20:11:01.582891 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:01.582897 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:01.582954 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:01.613527 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:01.613548 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:01.613553 59960 cri.go:89] found id: ""
I1126 20:11:01.613560 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:01.613629 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:01.618859 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:01.623550 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:01.623624 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:01.660116 59960 cri.go:89] found id: ""
I1126 20:11:01.660140 59960 logs.go:282] 0 containers: []
W1126 20:11:01.660149 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:01.660159 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:01.660221 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:01.692418 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:01.692442 59960 cri.go:89] found id: ""
I1126 20:11:01.692450 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:11:01.692509 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:01.696379 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:01.696453 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:01.729407 59960 cri.go:89] found id: ""
I1126 20:11:01.729430 59960 logs.go:282] 0 containers: []
W1126 20:11:01.729439 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:01.729447 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:01.729463 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:01.784458 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:01.784492 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:01.872850 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:01.872886 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:01.903039 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:11:01.903068 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:01.942057 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:01.942084 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:02.024475 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:02.024514 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:02.128096 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:02.128133 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:02.199528 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:02.191565 5992 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:02.192150 5992 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:02.193873 5992 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:02.194411 5992 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:02.195999 5992 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:02.191565 5992 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:02.192150 5992 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:02.193873 5992 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:02.194411 5992 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:02.195999 5992 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:02.199554 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:02.199568 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:02.226949 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:02.226985 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:02.270517 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:02.270555 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:02.306879 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:02.306948 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:04.822921 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:04.834951 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:04.835018 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:04.862163 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:04.862219 59960 cri.go:89] found id: ""
I1126 20:11:04.862244 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:04.862312 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:04.865957 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:04.866029 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:04.895638 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:04.895658 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:04.895663 59960 cri.go:89] found id: ""
I1126 20:11:04.895669 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:04.895722 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:04.899645 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:04.903838 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:04.903909 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:04.929326 59960 cri.go:89] found id: ""
I1126 20:11:04.929389 59960 logs.go:282] 0 containers: []
W1126 20:11:04.929422 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:04.929442 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:04.929522 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:04.956401 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:04.956472 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:04.956491 59960 cri.go:89] found id: ""
I1126 20:11:04.956522 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:04.956593 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:04.960195 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:04.963812 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:04.963930 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:04.990366 59960 cri.go:89] found id: ""
I1126 20:11:04.990387 59960 logs.go:282] 0 containers: []
W1126 20:11:04.990395 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:04.990402 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:04.990468 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:05.019718 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:05.019752 59960 cri.go:89] found id: ""
I1126 20:11:05.019762 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:11:05.019824 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:05.023681 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:05.023779 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:05.053886 59960 cri.go:89] found id: ""
I1126 20:11:05.053915 59960 logs.go:282] 0 containers: []
W1126 20:11:05.053953 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:05.053963 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:05.053994 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:05.152926 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:05.152963 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:05.165506 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:05.165534 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:05.194915 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:05.194945 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:05.235104 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:05.235137 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:05.285215 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:05.285247 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:05.314134 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:11:05.314162 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:05.341007 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:05.341034 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:05.418277 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:05.418313 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:05.491273 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:05.482790 6141 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:05.483758 6141 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:05.485510 6141 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:05.486097 6141 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:05.487714 6141 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:05.482790 6141 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:05.483758 6141 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:05.485510 6141 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:05.486097 6141 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:05.487714 6141 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:05.491294 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:05.491308 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:05.552151 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:05.552187 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:08.086064 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:08.097504 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:08.097574 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:08.126757 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:08.126780 59960 cri.go:89] found id: ""
I1126 20:11:08.126789 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:08.126851 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:08.131043 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:08.131119 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:08.158212 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:08.158274 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:08.158289 59960 cri.go:89] found id: ""
I1126 20:11:08.158297 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:08.158360 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:08.162104 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:08.166980 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:08.167053 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:08.193258 59960 cri.go:89] found id: ""
I1126 20:11:08.193290 59960 logs.go:282] 0 containers: []
W1126 20:11:08.193300 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:08.193307 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:08.193374 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:08.219187 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:08.219210 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:08.219216 59960 cri.go:89] found id: ""
I1126 20:11:08.219234 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:08.219313 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:08.223489 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:08.227150 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:08.227228 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:08.255318 59960 cri.go:89] found id: ""
I1126 20:11:08.255340 59960 logs.go:282] 0 containers: []
W1126 20:11:08.255348 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:08.255355 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:08.255411 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:08.282171 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:08.282194 59960 cri.go:89] found id: ""
I1126 20:11:08.282202 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:11:08.282273 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:08.285788 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:08.285852 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:08.315430 59960 cri.go:89] found id: ""
I1126 20:11:08.315505 59960 logs.go:282] 0 containers: []
W1126 20:11:08.315538 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:08.315560 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:08.315580 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:08.345199 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:08.345268 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:08.441184 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:08.441220 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:08.511176 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:08.500509 6242 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:08.501151 6242 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:08.504004 6242 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:08.504546 6242 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:08.506870 6242 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:08.500509 6242 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:08.501151 6242 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:08.504004 6242 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:08.504546 6242 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:08.506870 6242 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:08.511208 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:08.511222 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:08.543421 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:08.543450 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:08.604175 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:08.604207 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:08.632557 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:11:08.632623 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:08.663480 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:08.663506 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:08.675096 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:08.675127 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:08.713968 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:08.713998 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:08.759141 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:08.759176 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:11.351574 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:11.361875 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:11.361972 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:11.388446 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:11.388515 59960 cri.go:89] found id: ""
I1126 20:11:11.388529 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:11.388594 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:11.392093 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:11.392176 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:11.421855 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:11.421875 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:11.421880 59960 cri.go:89] found id: ""
I1126 20:11:11.421887 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:11.421974 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:11.425675 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:11.429670 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:11.429770 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:11.455248 59960 cri.go:89] found id: ""
I1126 20:11:11.455272 59960 logs.go:282] 0 containers: []
W1126 20:11:11.455280 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:11.455287 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:11.455349 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:11.481734 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:11.481755 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:11.481761 59960 cri.go:89] found id: ""
I1126 20:11:11.481769 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:11.481841 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:11.485836 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:11.489303 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:11.489380 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:11.521985 59960 cri.go:89] found id: ""
I1126 20:11:11.522011 59960 logs.go:282] 0 containers: []
W1126 20:11:11.522020 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:11.522036 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:11.522095 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:11.561668 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:11.561700 59960 cri.go:89] found id: ""
I1126 20:11:11.561708 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:11:11.561772 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:11.565986 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:11.566063 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:11.594364 59960 cri.go:89] found id: ""
I1126 20:11:11.594386 59960 logs.go:282] 0 containers: []
W1126 20:11:11.594395 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:11.594404 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:11.594440 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:11.639020 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:11.639057 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:11.709026 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:11.709063 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:11.739742 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:11.739771 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:11.806014 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:11.797164 6392 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:11.798194 6392 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:11.798970 6392 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:11.800645 6392 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:11.801154 6392 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:11.797164 6392 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:11.798194 6392 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:11.798970 6392 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:11.800645 6392 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:11.801154 6392 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:11.806036 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:11.806048 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:11.844958 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:11.844991 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:11.876607 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:11:11.876634 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:11.911651 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:11.911677 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:11.991136 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:11.991170 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:12.094606 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:12.094650 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:12.107579 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:12.107609 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:14.637133 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:14.648286 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:14.648355 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:14.678404 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:14.678427 59960 cri.go:89] found id: ""
I1126 20:11:14.678435 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:14.678495 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:14.682257 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:14.682330 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:14.713744 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:14.713765 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:14.713770 59960 cri.go:89] found id: ""
I1126 20:11:14.713777 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:14.713835 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:14.718000 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:14.721792 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:14.721916 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:14.753701 59960 cri.go:89] found id: ""
I1126 20:11:14.753767 59960 logs.go:282] 0 containers: []
W1126 20:11:14.753793 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:14.753812 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:14.753951 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:14.782584 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:14.782609 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:14.782615 59960 cri.go:89] found id: ""
I1126 20:11:14.782622 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:14.782679 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:14.786288 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:14.790091 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:14.790165 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:14.816545 59960 cri.go:89] found id: ""
I1126 20:11:14.816570 59960 logs.go:282] 0 containers: []
W1126 20:11:14.816579 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:14.816586 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:14.816642 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:14.846080 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:14.846100 59960 cri.go:89] found id: ""
I1126 20:11:14.846108 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:11:14.846166 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:14.849789 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:14.849880 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:14.876460 59960 cri.go:89] found id: ""
I1126 20:11:14.876491 59960 logs.go:282] 0 containers: []
W1126 20:11:14.876500 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:14.876508 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:14.876518 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:14.951236 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:14.951274 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:14.983322 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:14.983350 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:15.061107 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:15.051102 6513 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:15.052170 6513 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:15.053243 6513 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:15.054378 6513 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:15.056334 6513 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:15.051102 6513 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:15.052170 6513 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:15.053243 6513 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:15.054378 6513 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:15.056334 6513 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:15.061129 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:15.061144 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:15.097557 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:15.097587 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:15.138293 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:15.138326 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:15.168503 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:15.168532 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:15.267115 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:15.267150 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:15.279584 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:15.279615 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:15.326150 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:15.326184 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:15.389193 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:11:15.389226 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:17.918406 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:17.929053 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:17.929122 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:17.953884 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:17.953945 59960 cri.go:89] found id: ""
I1126 20:11:17.953954 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:17.954015 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:17.957395 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:17.957465 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:17.983711 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:17.983731 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:17.983735 59960 cri.go:89] found id: ""
I1126 20:11:17.983742 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:17.983795 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:17.987660 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:17.991154 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:17.991224 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:18.019969 59960 cri.go:89] found id: ""
I1126 20:11:18.019998 59960 logs.go:282] 0 containers: []
W1126 20:11:18.020008 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:18.020015 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:18.020073 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:18.061149 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:18.061172 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:18.061178 59960 cri.go:89] found id: ""
I1126 20:11:18.061186 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:18.061246 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:18.065578 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:18.069815 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:18.069885 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:18.096457 59960 cri.go:89] found id: ""
I1126 20:11:18.096479 59960 logs.go:282] 0 containers: []
W1126 20:11:18.096487 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:18.096494 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:18.096554 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:18.124303 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:18.124367 59960 cri.go:89] found id: ""
I1126 20:11:18.124392 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:11:18.124471 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:18.130707 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:18.130839 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:18.156714 59960 cri.go:89] found id: ""
I1126 20:11:18.156740 59960 logs.go:282] 0 containers: []
W1126 20:11:18.156750 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:18.156759 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:18.156773 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:18.233800 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:18.233837 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:18.264943 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:18.264973 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:18.343435 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:18.335872 6652 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:18.336444 6652 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:18.337906 6652 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:18.338530 6652 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:18.339816 6652 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:18.335872 6652 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:18.336444 6652 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:18.337906 6652 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:18.338530 6652 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:18.339816 6652 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:18.343458 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:18.343470 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:18.372998 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:18.373026 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:18.416461 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:18.416495 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:18.445233 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:18.445263 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:18.545748 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:18.545787 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:18.557806 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:18.557835 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:18.622509 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:18.622542 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:18.707610 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:11:18.707689 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:21.236452 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:21.247662 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:21.247729 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:21.276004 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:21.276030 59960 cri.go:89] found id: ""
I1126 20:11:21.276038 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:21.276125 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:21.279851 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:21.279945 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:21.309267 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:21.309291 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:21.309297 59960 cri.go:89] found id: ""
I1126 20:11:21.309304 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:21.309359 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:21.313384 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:21.317026 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:21.317099 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:21.347773 59960 cri.go:89] found id: ""
I1126 20:11:21.347799 59960 logs.go:282] 0 containers: []
W1126 20:11:21.347807 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:21.347817 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:21.347901 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:21.389878 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:21.389898 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:21.389902 59960 cri.go:89] found id: ""
I1126 20:11:21.389910 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:21.390028 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:21.396218 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:21.405704 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:21.405823 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:21.458505 59960 cri.go:89] found id: ""
I1126 20:11:21.458573 59960 logs.go:282] 0 containers: []
W1126 20:11:21.458605 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:21.458635 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:21.458731 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:21.486896 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:21.486961 59960 cri.go:89] found id: ""
I1126 20:11:21.486983 59960 logs.go:282] 1 containers: [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:11:21.487052 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:21.490729 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:21.490845 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:21.521776 59960 cri.go:89] found id: ""
I1126 20:11:21.521798 59960 logs.go:282] 0 containers: []
W1126 20:11:21.521806 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:21.521815 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:21.521827 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:21.540126 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:21.540201 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:21.612034 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:21.604355 6776 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:21.605075 6776 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:21.606757 6776 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:21.607410 6776 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:21.608381 6776 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:21.604355 6776 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:21.605075 6776 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:21.606757 6776 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:21.607410 6776 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:21.608381 6776 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:21.612058 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:21.612072 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:21.658622 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:21.658657 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:21.707807 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:21.707844 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:21.769271 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:21.769306 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:21.801295 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:21.801325 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:21.896605 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:21.896639 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:21.929176 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:21.929205 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:21.967857 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:11:21.967884 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:22.001350 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:22.001375 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:24.595423 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:24.606910 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:24.606980 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:24.638795 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:24.638819 59960 cri.go:89] found id: ""
I1126 20:11:24.638827 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:24.638885 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:24.642601 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:24.642677 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:24.709965 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:24.709984 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:24.709989 59960 cri.go:89] found id: ""
I1126 20:11:24.709996 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:24.710075 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:24.714848 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:24.719509 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:24.719668 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:24.756426 59960 cri.go:89] found id: ""
I1126 20:11:24.756497 59960 logs.go:282] 0 containers: []
W1126 20:11:24.756521 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:24.756540 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:24.756658 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:24.803189 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:24.803256 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:24.803274 59960 cri.go:89] found id: ""
I1126 20:11:24.803295 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:24.803379 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:24.808196 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:24.812071 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:24.812194 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:24.852305 59960 cri.go:89] found id: ""
I1126 20:11:24.852378 59960 logs.go:282] 0 containers: []
W1126 20:11:24.852408 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:24.852429 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:24.852520 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:24.889194 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:24.889263 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:24.889294 59960 cri.go:89] found id: ""
I1126 20:11:24.889320 59960 logs.go:282] 2 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:11:24.889413 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:24.893347 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:24.897224 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:24.897334 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:24.930230 59960 cri.go:89] found id: ""
I1126 20:11:24.930304 59960 logs.go:282] 0 containers: []
W1126 20:11:24.930333 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:24.930344 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:24.930371 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:25.035563 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:25.035604 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:25.054082 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:25.054112 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:25.096053 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:25.096081 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:25.145970 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:25.146007 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:25.185648 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:11:25.185678 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:25.214168 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:25.214199 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:25.247077 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:25.247106 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:25.338812 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:25.330325 6966 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:25.331301 6966 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:25.332972 6966 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:25.333487 6966 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:25.335076 6966 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:25.330325 6966 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:25.331301 6966 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:25.332972 6966 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:25.333487 6966 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:25.335076 6966 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:25.338839 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:25.338854 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:25.379564 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:25.379600 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:25.447694 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:11:25.447730 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:25.472568 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:25.472598 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:28.058550 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:28.076007 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:28.076082 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:28.106329 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:28.106351 59960 cri.go:89] found id: ""
I1126 20:11:28.106360 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:28.106418 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:28.110514 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:28.110591 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:28.140757 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:28.140777 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:28.140782 59960 cri.go:89] found id: ""
I1126 20:11:28.140789 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:28.140842 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:28.144844 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:28.148401 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:28.148473 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:28.174921 59960 cri.go:89] found id: ""
I1126 20:11:28.174944 59960 logs.go:282] 0 containers: []
W1126 20:11:28.174953 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:28.174959 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:28.175022 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:28.202405 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:28.202425 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:28.202429 59960 cri.go:89] found id: ""
I1126 20:11:28.202436 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:28.202491 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:28.207455 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:28.211480 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:28.211548 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:28.239676 59960 cri.go:89] found id: ""
I1126 20:11:28.239749 59960 logs.go:282] 0 containers: []
W1126 20:11:28.239773 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:28.239793 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:28.239857 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:28.269256 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:28.269277 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:28.269282 59960 cri.go:89] found id: ""
I1126 20:11:28.269289 59960 logs.go:282] 2 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:11:28.269344 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:28.273004 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:28.276329 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:28.276398 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:28.302206 59960 cri.go:89] found id: ""
I1126 20:11:28.302272 59960 logs.go:282] 0 containers: []
W1126 20:11:28.302298 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:28.302321 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:28.302363 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:28.332034 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:28.332062 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:28.376567 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:28.376603 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:28.441530 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:11:28.441568 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:28.468188 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:28.468219 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:28.544745 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:28.544780 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:28.590841 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:28.590870 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:28.603163 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:28.603194 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:28.675368 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:28.666467 7114 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:28.667143 7114 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:28.668892 7114 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:28.669848 7114 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:28.671529 7114 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:28.666467 7114 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:28.667143 7114 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:28.668892 7114 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:28.669848 7114 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:28.671529 7114 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:28.675390 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:28.675403 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:28.716129 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:28.716160 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:28.746889 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:11:28.746916 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:28.784649 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:28.784678 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:31.386032 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:31.396663 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:31.396729 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:31.424252 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:31.424274 59960 cri.go:89] found id: ""
I1126 20:11:31.424282 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:31.424337 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:31.427909 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:31.427983 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:31.459053 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:31.459075 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:31.459080 59960 cri.go:89] found id: ""
I1126 20:11:31.459088 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:31.459148 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:31.462802 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:31.466564 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:31.466687 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:31.497981 59960 cri.go:89] found id: ""
I1126 20:11:31.498003 59960 logs.go:282] 0 containers: []
W1126 20:11:31.498012 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:31.498018 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:31.498110 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:31.526027 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:31.526052 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:31.526057 59960 cri.go:89] found id: ""
I1126 20:11:31.526065 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:31.526170 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:31.529987 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:31.534855 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:31.534945 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:31.563109 59960 cri.go:89] found id: ""
I1126 20:11:31.563169 59960 logs.go:282] 0 containers: []
W1126 20:11:31.563198 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:31.563219 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:31.563293 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:31.589243 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:31.589265 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:31.589270 59960 cri.go:89] found id: ""
I1126 20:11:31.589278 59960 logs.go:282] 2 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:11:31.589354 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:31.593459 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:31.596946 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:31.597021 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:31.623525 59960 cri.go:89] found id: ""
I1126 20:11:31.623558 59960 logs.go:282] 0 containers: []
W1126 20:11:31.623567 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:31.623576 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:11:31.623587 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:31.652294 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:31.652373 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:31.735258 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:31.735294 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:31.768608 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:31.768683 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:31.870428 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:31.870508 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:31.897014 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:31.897042 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:32.001263 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:11:32.001299 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:32.038474 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:32.038514 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:32.052890 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:32.052925 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:32.157895 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:32.150135 7260 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:32.150798 7260 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:32.152292 7260 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:32.152811 7260 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:32.154388 7260 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:32.150135 7260 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:32.150798 7260 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:32.152292 7260 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:32.152811 7260 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:32.154388 7260 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:32.157991 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:32.158015 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:32.202276 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:32.202312 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:32.246886 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:32.246920 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:34.774920 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:34.785509 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:34.785619 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:34.817587 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:34.817656 59960 cri.go:89] found id: ""
I1126 20:11:34.817682 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:34.817753 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:34.821524 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:34.821594 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:34.849130 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:34.849154 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:34.849159 59960 cri.go:89] found id: ""
I1126 20:11:34.849167 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:34.849233 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:34.852945 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:34.856601 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:34.856684 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:34.883375 59960 cri.go:89] found id: ""
I1126 20:11:34.883398 59960 logs.go:282] 0 containers: []
W1126 20:11:34.883412 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:34.883450 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:34.883524 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:34.909798 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:34.909821 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:34.909826 59960 cri.go:89] found id: ""
I1126 20:11:34.909834 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:34.909888 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:34.913552 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:34.916964 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:34.917033 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:34.949567 59960 cri.go:89] found id: ""
I1126 20:11:34.949592 59960 logs.go:282] 0 containers: []
W1126 20:11:34.949601 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:34.949608 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:34.949663 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:34.977128 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:34.977150 59960 cri.go:89] found id: "2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:34.977156 59960 cri.go:89] found id: ""
I1126 20:11:34.977163 59960 logs.go:282] 2 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed]
I1126 20:11:34.977220 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:34.981001 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:34.984842 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:34.984957 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:35.012427 59960 cri.go:89] found id: ""
I1126 20:11:35.012460 59960 logs.go:282] 0 containers: []
W1126 20:11:35.012470 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:35.012479 59960 logs.go:123] Gathering logs for kube-controller-manager [2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed] ...
I1126 20:11:35.012493 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 2d543d941af1990a9a32a729e5c28a0c11ebc07b1265ba780a51542a81b743ed"
I1126 20:11:35.040355 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:35.040396 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:35.085028 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:35.085064 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:35.113614 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:35.113649 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:35.153880 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:35.153911 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:35.198643 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:35.198675 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:35.268315 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:35.268350 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:35.295776 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:35.295804 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:35.376804 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:35.376847 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:35.482429 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:35.482467 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:35.495585 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:35.495620 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:35.570301 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:35.562818 7422 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:35.563633 7422 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:35.565195 7422 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:35.565472 7422 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:35.566934 7422 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:35.562818 7422 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:35.563633 7422 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:35.565195 7422 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:35.565472 7422 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:35.566934 7422 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:35.570323 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:11:35.570336 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:38.104089 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:38.117181 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:38.117256 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:38.149986 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:38.150007 59960 cri.go:89] found id: ""
I1126 20:11:38.150015 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:38.150071 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:38.153769 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:38.153836 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:38.181424 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:38.181445 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:38.181450 59960 cri.go:89] found id: ""
I1126 20:11:38.181457 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:38.181514 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:38.186065 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:38.189965 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:38.190088 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:38.222377 59960 cri.go:89] found id: ""
I1126 20:11:38.222403 59960 logs.go:282] 0 containers: []
W1126 20:11:38.222412 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:38.222418 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:38.222512 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:38.251289 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:38.251308 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:38.251312 59960 cri.go:89] found id: ""
I1126 20:11:38.251319 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:38.251376 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:38.256455 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:38.260117 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:38.260191 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:38.285970 59960 cri.go:89] found id: ""
I1126 20:11:38.285993 59960 logs.go:282] 0 containers: []
W1126 20:11:38.286001 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:38.286007 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:38.286071 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:38.316333 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:38.316352 59960 cri.go:89] found id: ""
I1126 20:11:38.316360 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:11:38.316418 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:38.320056 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:38.320141 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:38.346321 59960 cri.go:89] found id: ""
I1126 20:11:38.346343 59960 logs.go:282] 0 containers: []
W1126 20:11:38.346355 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:38.346365 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:38.346377 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:38.373397 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:38.373424 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:38.425362 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:11:38.425395 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:38.453015 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:38.453091 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:38.532623 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:38.532697 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:38.633361 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:38.633397 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:38.645846 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:38.645873 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:38.703411 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:38.703444 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:38.767512 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:38.767547 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:38.796976 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:38.797004 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:38.829009 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:38.829038 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:38.898466 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:38.890004 7575 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:38.890695 7575 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:38.892444 7575 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:38.892921 7575 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:38.894201 7575 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:38.890004 7575 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:38.890695 7575 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:38.892444 7575 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:38.892921 7575 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:38.894201 7575 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:41.398722 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:41.410132 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:41.410201 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:41.438116 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:41.438139 59960 cri.go:89] found id: ""
I1126 20:11:41.438148 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:41.438205 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:41.442017 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:41.442090 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:41.469903 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:41.469958 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:41.469963 59960 cri.go:89] found id: ""
I1126 20:11:41.469970 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:41.470027 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:41.474067 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:41.478045 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:41.478121 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:41.505356 59960 cri.go:89] found id: ""
I1126 20:11:41.505421 59960 logs.go:282] 0 containers: []
W1126 20:11:41.505446 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:41.505473 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:41.505547 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:41.539013 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:41.539078 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:41.539097 59960 cri.go:89] found id: ""
I1126 20:11:41.539120 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:41.539192 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:41.545082 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:41.548706 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:41.548780 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:41.575834 59960 cri.go:89] found id: ""
I1126 20:11:41.575859 59960 logs.go:282] 0 containers: []
W1126 20:11:41.575867 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:41.575874 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:41.575934 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:41.611347 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:41.611373 59960 cri.go:89] found id: ""
I1126 20:11:41.611381 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:11:41.611452 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:41.615789 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:41.615865 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:41.641022 59960 cri.go:89] found id: ""
I1126 20:11:41.641047 59960 logs.go:282] 0 containers: []
W1126 20:11:41.641057 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:41.641066 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:41.641078 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:41.742347 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:41.742381 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:41.754134 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:41.754164 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:41.831601 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:41.821574 7650 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:41.822287 7650 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:41.823756 7650 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:41.824699 7650 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:41.826433 7650 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:41.821574 7650 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:41.822287 7650 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:41.823756 7650 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:41.824699 7650 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:41.826433 7650 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:41.831624 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:41.831637 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:41.860096 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:41.860125 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:41.910250 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:41.910285 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:41.980123 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:41.980161 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:42.010802 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:42.010829 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:42.106028 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:42.106070 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:42.164514 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:11:42.164559 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:42.271103 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:42.271151 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:44.839838 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:44.850546 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:44.850618 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:44.876918 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:44.876988 59960 cri.go:89] found id: ""
I1126 20:11:44.877011 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:44.877094 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:44.881043 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:44.881125 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:44.911219 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:44.911239 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:44.911243 59960 cri.go:89] found id: ""
I1126 20:11:44.911250 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:44.911304 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:44.914984 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:44.918517 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:44.918591 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:44.948367 59960 cri.go:89] found id: ""
I1126 20:11:44.948393 59960 logs.go:282] 0 containers: []
W1126 20:11:44.948403 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:44.948410 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:44.948488 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:44.979725 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:44.979749 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:44.979762 59960 cri.go:89] found id: ""
I1126 20:11:44.979770 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:44.979825 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:44.983672 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:44.987318 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:44.987393 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:45.013302 59960 cri.go:89] found id: ""
I1126 20:11:45.013326 59960 logs.go:282] 0 containers: []
W1126 20:11:45.013335 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:45.013342 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:45.013400 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:45.055627 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:45.055649 59960 cri.go:89] found id: ""
I1126 20:11:45.055657 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:11:45.055726 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:45.085558 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:45.085645 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:45.151023 59960 cri.go:89] found id: ""
I1126 20:11:45.151097 59960 logs.go:282] 0 containers: []
W1126 20:11:45.151125 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:45.151149 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:45.151189 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:45.299197 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:45.299495 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:45.414522 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:45.414561 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:45.426305 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:45.426334 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:45.498361 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:45.490138 7787 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:45.490855 7787 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:45.492369 7787 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:45.493032 7787 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:45.494581 7787 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:45.490138 7787 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:45.490855 7787 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:45.492369 7787 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:45.493032 7787 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:45.494581 7787 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:45.498385 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:45.498406 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:45.544282 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:11:45.544315 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:45.572601 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:45.572628 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:45.618675 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:45.618704 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:45.644699 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:45.644729 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:45.692766 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:45.692847 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:45.768264 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:45.768298 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:48.298071 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:48.309786 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:48.309955 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:48.338906 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:48.338929 59960 cri.go:89] found id: ""
I1126 20:11:48.338938 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:48.339013 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:48.342703 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:48.342807 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:48.373459 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:48.373483 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:48.373489 59960 cri.go:89] found id: ""
I1126 20:11:48.373497 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:48.373571 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:48.377243 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:48.380907 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:48.380978 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:48.410171 59960 cri.go:89] found id: ""
I1126 20:11:48.410194 59960 logs.go:282] 0 containers: []
W1126 20:11:48.410203 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:48.410210 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:48.410269 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:48.438118 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:48.438141 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:48.438146 59960 cri.go:89] found id: ""
I1126 20:11:48.438153 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:48.438208 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:48.441706 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:48.445239 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:48.445331 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:48.471795 59960 cri.go:89] found id: ""
I1126 20:11:48.471818 59960 logs.go:282] 0 containers: []
W1126 20:11:48.471827 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:48.471834 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:48.471894 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:48.499373 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:48.499444 59960 cri.go:89] found id: ""
I1126 20:11:48.499459 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:11:48.499520 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:48.503413 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:48.503486 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:48.530399 59960 cri.go:89] found id: ""
I1126 20:11:48.530421 59960 logs.go:282] 0 containers: []
W1126 20:11:48.530435 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:48.530450 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:48.530464 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:48.571849 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:48.571882 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:48.658179 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:11:48.658279 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:48.689018 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:48.689045 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:48.763174 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:48.763207 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:48.778567 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:48.778596 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:48.827328 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:48.827365 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:48.857288 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:48.857365 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:48.888507 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:48.888539 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:48.988930 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:48.988967 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:49.069225 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:49.055449 7978 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:49.056233 7978 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:49.057886 7978 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:49.058530 7978 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:49.060083 7978 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:49.055449 7978 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:49.056233 7978 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:49.057886 7978 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:49.058530 7978 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:49.060083 7978 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:49.069248 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:49.069262 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:51.595258 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:51.606745 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:51.606819 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:51.636395 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:51.636416 59960 cri.go:89] found id: ""
I1126 20:11:51.636430 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:51.636488 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:51.640040 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:51.640115 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:51.676792 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:51.676812 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:51.676816 59960 cri.go:89] found id: ""
I1126 20:11:51.676824 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:51.676877 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:51.681110 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:51.685068 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:51.685183 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:51.720013 59960 cri.go:89] found id: ""
I1126 20:11:51.720038 59960 logs.go:282] 0 containers: []
W1126 20:11:51.720047 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:51.720054 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:51.720111 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:51.748336 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:51.748360 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:51.748375 59960 cri.go:89] found id: ""
I1126 20:11:51.748383 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:51.748439 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:51.752267 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:51.756170 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:51.756241 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:51.783057 59960 cri.go:89] found id: ""
I1126 20:11:51.783086 59960 logs.go:282] 0 containers: []
W1126 20:11:51.783095 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:51.783101 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:51.783163 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:51.811250 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:51.811272 59960 cri.go:89] found id: ""
I1126 20:11:51.811282 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:11:51.811338 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:51.815120 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:51.815232 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:51.846026 59960 cri.go:89] found id: ""
I1126 20:11:51.846049 59960 logs.go:282] 0 containers: []
W1126 20:11:51.846064 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:51.846074 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:51.846086 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:51.890348 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:51.890380 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:51.920851 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:51.920922 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:51.977107 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:51.977140 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:52.060932 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:11:52.060981 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:52.093050 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:52.093078 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:52.176431 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:52.176468 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:52.215980 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:52.216012 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:52.327858 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:52.327901 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:52.340252 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:52.340285 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:52.418993 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:52.410090 8112 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:52.410776 8112 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:52.412508 8112 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:52.413095 8112 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:52.414685 8112 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:52.410090 8112 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:52.410776 8112 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:52.412508 8112 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:52.413095 8112 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:52.414685 8112 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:52.419016 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:52.419029 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:54.944539 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:54.955542 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:54.955615 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:54.986048 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:54.986074 59960 cri.go:89] found id: ""
I1126 20:11:54.986083 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:54.986139 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:54.989757 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:54.989829 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:55.016053 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:55.016085 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:55.016091 59960 cri.go:89] found id: ""
I1126 20:11:55.016099 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:55.016174 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:55.019787 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:55.023250 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:55.023321 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:55.069450 59960 cri.go:89] found id: ""
I1126 20:11:55.069473 59960 logs.go:282] 0 containers: []
W1126 20:11:55.069482 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:55.069489 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:55.069572 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:55.098641 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:55.098664 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:55.098669 59960 cri.go:89] found id: ""
I1126 20:11:55.098676 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:55.098732 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:55.102435 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:55.106227 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:55.106351 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:55.138121 59960 cri.go:89] found id: ""
I1126 20:11:55.138145 59960 logs.go:282] 0 containers: []
W1126 20:11:55.138154 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:55.138174 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:55.138236 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:55.167513 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:55.167544 59960 cri.go:89] found id: ""
I1126 20:11:55.167553 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:11:55.167618 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:55.171313 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:55.171381 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:55.202786 59960 cri.go:89] found id: ""
I1126 20:11:55.202813 59960 logs.go:282] 0 containers: []
W1126 20:11:55.202822 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:55.202832 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:55.202866 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:55.302444 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:55.302521 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:55.340281 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:55.340307 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:55.380642 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:55.380671 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:55.413529 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:11:55.413559 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:55.441562 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:55.441590 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:11:55.518521 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:55.518561 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:55.558444 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:55.558478 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:55.571280 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:55.571312 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:55.640808 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:55.631279 8240 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:55.631827 8240 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:55.633724 8240 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:55.634294 8240 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:55.636622 8240 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:55.631279 8240 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:55.631827 8240 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:55.633724 8240 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:55.634294 8240 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:55.636622 8240 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:55.640840 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:55.640855 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:55.687489 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:55.687525 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:58.274871 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:11:58.285429 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:11:58.285499 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:11:58.313375 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:58.313399 59960 cri.go:89] found id: ""
I1126 20:11:58.313406 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:11:58.313459 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:58.316973 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:11:58.317046 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:11:58.343195 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:58.343222 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:58.343233 59960 cri.go:89] found id: ""
I1126 20:11:58.343241 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:11:58.343299 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:58.346903 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:58.350464 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:11:58.350532 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:11:58.389630 59960 cri.go:89] found id: ""
I1126 20:11:58.389651 59960 logs.go:282] 0 containers: []
W1126 20:11:58.389659 59960 logs.go:284] No container was found matching "coredns"
I1126 20:11:58.389666 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:11:58.389727 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:11:58.417327 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:58.417347 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:58.417351 59960 cri.go:89] found id: ""
I1126 20:11:58.417358 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:11:58.417415 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:58.421999 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:58.425800 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:11:58.425864 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:11:58.452945 59960 cri.go:89] found id: ""
I1126 20:11:58.452969 59960 logs.go:282] 0 containers: []
W1126 20:11:58.452977 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:11:58.452983 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:11:58.453043 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:11:58.488167 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:58.488198 59960 cri.go:89] found id: ""
I1126 20:11:58.488207 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:11:58.488290 59960 ssh_runner.go:195] Run: which crictl
I1126 20:11:58.492158 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:11:58.492254 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:11:58.519792 59960 cri.go:89] found id: ""
I1126 20:11:58.519815 59960 logs.go:282] 0 containers: []
W1126 20:11:58.519824 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:11:58.519833 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:11:58.519845 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:11:58.539152 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:11:58.539178 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:11:58.611844 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:11:58.602656 8331 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:58.604433 8331 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:58.605264 8331 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:58.606165 8331 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:58.607783 8331 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:11:58.602656 8331 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:58.604433 8331 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:58.605264 8331 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:58.606165 8331 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:11:58.607783 8331 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:11:58.611916 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:11:58.611936 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:11:58.653684 59960 logs.go:123] Gathering logs for container status ...
I1126 20:11:58.653755 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:11:58.701629 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:11:58.701698 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:11:58.797678 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:11:58.797712 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:11:58.826943 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:11:58.826971 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:11:58.870347 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:11:58.870382 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:11:58.935086 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:11:58.935124 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:11:58.968825 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:11:58.968856 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:11:58.997914 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:11:58.998030 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:01.577720 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:01.589568 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:01.589642 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:01.621435 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:01.621457 59960 cri.go:89] found id: ""
I1126 20:12:01.621466 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:01.621521 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:01.625557 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:01.625630 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:01.653424 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:01.653447 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:01.653452 59960 cri.go:89] found id: ""
I1126 20:12:01.653459 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:01.653520 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:01.658113 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:01.663163 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:01.663279 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:01.690617 59960 cri.go:89] found id: ""
I1126 20:12:01.690692 59960 logs.go:282] 0 containers: []
W1126 20:12:01.690707 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:01.690714 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:01.690776 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:01.721669 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:01.721691 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:01.721696 59960 cri.go:89] found id: ""
I1126 20:12:01.721705 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:01.721760 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:01.725774 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:01.729528 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:01.729608 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:01.755428 59960 cri.go:89] found id: ""
I1126 20:12:01.755452 59960 logs.go:282] 0 containers: []
W1126 20:12:01.755461 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:01.755468 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:01.755529 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:01.783818 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:01.783841 59960 cri.go:89] found id: ""
I1126 20:12:01.783849 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:01.783905 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:01.787656 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:01.787726 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:01.815958 59960 cri.go:89] found id: ""
I1126 20:12:01.816025 59960 logs.go:282] 0 containers: []
W1126 20:12:01.816050 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:01.816067 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:01.816080 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:01.867560 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:01.867592 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:01.932205 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:01.932256 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:02.002408 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:02.002441 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:02.051577 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:02.051612 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:02.088918 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:02.088948 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:02.168080 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:02.158735 8503 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:02.159253 8503 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:02.162045 8503 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:02.162706 8503 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:02.164462 8503 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:02.158735 8503 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:02.159253 8503 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:02.162045 8503 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:02.162706 8503 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:02.164462 8503 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:02.168105 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:02.168119 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:02.244385 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:02.244435 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:02.282263 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:02.282293 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:02.383774 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:02.383810 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:02.399682 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:02.399712 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:04.928429 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:04.939418 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:04.939502 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:04.967318 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:04.967344 59960 cri.go:89] found id: ""
I1126 20:12:04.967352 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:04.967406 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:04.971172 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:04.971242 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:04.998636 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:04.998660 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:04.998666 59960 cri.go:89] found id: ""
I1126 20:12:04.998673 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:04.998728 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:05.002734 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:05.006234 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:05.006304 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:05.031905 59960 cri.go:89] found id: ""
I1126 20:12:05.031931 59960 logs.go:282] 0 containers: []
W1126 20:12:05.031948 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:05.031954 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:05.032022 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:05.062024 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:05.062047 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:05.062053 59960 cri.go:89] found id: ""
I1126 20:12:05.062061 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:05.062119 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:05.066633 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:05.070769 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:05.070894 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:05.098088 59960 cri.go:89] found id: ""
I1126 20:12:05.098113 59960 logs.go:282] 0 containers: []
W1126 20:12:05.098123 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:05.098130 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:05.098213 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:05.131371 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:05.131394 59960 cri.go:89] found id: ""
I1126 20:12:05.131403 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:05.131477 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:05.135270 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:05.135372 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:05.162342 59960 cri.go:89] found id: ""
I1126 20:12:05.162365 59960 logs.go:282] 0 containers: []
W1126 20:12:05.162374 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:05.162383 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:05.162395 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:05.235501 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:05.227170 8598 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:05.227750 8598 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:05.229253 8598 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:05.229720 8598 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:05.231198 8598 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:05.227170 8598 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:05.227750 8598 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:05.229253 8598 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:05.229720 8598 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:05.231198 8598 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:05.235522 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:05.235536 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:05.263102 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:05.263128 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:05.302111 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:05.302144 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:05.333187 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:05.333216 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:05.359477 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:05.359505 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:05.438760 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:05.438798 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:05.451777 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:05.451807 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:05.498508 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:05.498543 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:05.568808 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:05.568843 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:05.616879 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:05.616909 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:08.220414 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:08.231126 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:08.231199 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:08.258035 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:08.258105 59960 cri.go:89] found id: ""
I1126 20:12:08.258125 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:08.258192 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:08.262176 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:08.262249 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:08.289710 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:08.289733 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:08.289739 59960 cri.go:89] found id: ""
I1126 20:12:08.289750 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:08.289805 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:08.293485 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:08.297802 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:08.297880 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:08.327209 59960 cri.go:89] found id: ""
I1126 20:12:08.327234 59960 logs.go:282] 0 containers: []
W1126 20:12:08.327243 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:08.327263 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:08.327336 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:08.357819 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:08.357840 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:08.357845 59960 cri.go:89] found id: ""
I1126 20:12:08.357852 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:08.357906 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:08.361705 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:08.365237 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:08.365328 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:08.394319 59960 cri.go:89] found id: ""
I1126 20:12:08.394383 59960 logs.go:282] 0 containers: []
W1126 20:12:08.394399 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:08.394406 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:08.394480 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:08.420463 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:08.420527 59960 cri.go:89] found id: ""
I1126 20:12:08.420553 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:08.420638 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:08.424335 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:08.424450 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:08.452961 59960 cri.go:89] found id: ""
I1126 20:12:08.452986 59960 logs.go:282] 0 containers: []
W1126 20:12:08.452995 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:08.453003 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:08.453014 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:08.493988 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:08.494022 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:08.544465 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:08.544499 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:08.574385 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:08.574413 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:08.586334 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:08.586371 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:08.667454 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:08.650997 8764 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:08.659303 8764 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:08.660307 8764 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:08.662037 8764 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:08.662374 8764 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:08.650997 8764 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:08.659303 8764 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:08.660307 8764 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:08.662037 8764 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:08.662374 8764 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:08.667486 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:08.667499 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:08.699349 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:08.699378 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:08.764949 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:08.764985 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:08.796757 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:08.796785 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:08.880624 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:08.880660 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:08.914640 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:08.914667 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:11.513808 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:11.524482 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:11.524580 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:11.558859 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:11.558902 59960 cri.go:89] found id: ""
I1126 20:12:11.558911 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:11.558970 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:11.562673 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:11.562747 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:11.588932 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:11.588951 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:11.588956 59960 cri.go:89] found id: ""
I1126 20:12:11.588963 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:11.589017 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:11.592810 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:11.596570 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:11.596643 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:11.623065 59960 cri.go:89] found id: ""
I1126 20:12:11.623145 59960 logs.go:282] 0 containers: []
W1126 20:12:11.623161 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:11.623169 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:11.623229 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:11.650581 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:11.650605 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:11.650610 59960 cri.go:89] found id: ""
I1126 20:12:11.650618 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:11.650671 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:11.655559 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:11.659747 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:11.659817 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:11.687296 59960 cri.go:89] found id: ""
I1126 20:12:11.687322 59960 logs.go:282] 0 containers: []
W1126 20:12:11.687331 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:11.687337 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:11.687396 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:11.720511 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:11.720579 59960 cri.go:89] found id: ""
I1126 20:12:11.720617 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:11.720708 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:11.724437 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:11.724506 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:11.749548 59960 cri.go:89] found id: ""
I1126 20:12:11.749582 59960 logs.go:282] 0 containers: []
W1126 20:12:11.749591 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:11.749601 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:11.749612 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:11.844417 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:11.844451 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:11.856841 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:11.856870 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:11.927039 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:11.919031 8882 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:11.919434 8882 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:11.921013 8882 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:11.921770 8882 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:11.923409 8882 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:11.919031 8882 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:11.919434 8882 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:11.921013 8882 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:11.921770 8882 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:11.923409 8882 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:11.927072 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:11.927085 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:11.952749 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:11.952778 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:11.979828 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:11.979854 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:12.054969 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:12.055007 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:12.096829 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:12.096861 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:12.139040 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:12.139073 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:12.188630 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:12.188665 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:12.261491 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:12.261525 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:14.793314 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:14.805690 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:14.805792 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:14.834480 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:14.834550 59960 cri.go:89] found id: ""
I1126 20:12:14.834563 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:14.834624 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:14.838451 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:14.838546 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:14.865258 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:14.865280 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:14.865288 59960 cri.go:89] found id: ""
I1126 20:12:14.865296 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:14.865369 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:14.869042 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:14.872598 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:14.872673 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:14.899453 59960 cri.go:89] found id: ""
I1126 20:12:14.899475 59960 logs.go:282] 0 containers: []
W1126 20:12:14.899484 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:14.899491 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:14.899553 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:14.927802 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:14.927830 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:14.927837 59960 cri.go:89] found id: ""
I1126 20:12:14.927845 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:14.927940 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:14.932558 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:14.936133 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:14.936204 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:14.961102 59960 cri.go:89] found id: ""
I1126 20:12:14.961173 59960 logs.go:282] 0 containers: []
W1126 20:12:14.961195 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:14.961215 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:14.961302 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:15.002363 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:15.002384 59960 cri.go:89] found id: ""
I1126 20:12:15.002393 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:15.002447 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:15.006142 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:15.006212 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:15.032134 59960 cri.go:89] found id: ""
I1126 20:12:15.032199 59960 logs.go:282] 0 containers: []
W1126 20:12:15.032214 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:15.032224 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:15.032240 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:15.081347 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:15.081379 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:15.180623 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:15.180658 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:15.209901 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:15.209962 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:15.262607 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:15.262636 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:15.288510 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:15.288544 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:15.367680 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:15.367714 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:15.412204 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:15.412231 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:15.424270 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:15.424300 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:15.503073 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:15.494667 9062 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:15.495283 9062 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:15.496993 9062 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:15.497515 9062 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:15.498972 9062 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:15.494667 9062 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:15.495283 9062 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:15.496993 9062 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:15.497515 9062 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:15.498972 9062 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:15.503139 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:15.503167 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:15.550262 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:15.550296 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:18.118444 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:18.129864 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:18.129981 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:18.156819 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:18.156838 59960 cri.go:89] found id: ""
I1126 20:12:18.156846 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:18.156904 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:18.161071 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:18.161149 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:18.189616 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:18.189639 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:18.189644 59960 cri.go:89] found id: ""
I1126 20:12:18.189651 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:18.189705 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:18.193599 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:18.197622 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:18.197702 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:18.229000 59960 cri.go:89] found id: ""
I1126 20:12:18.229024 59960 logs.go:282] 0 containers: []
W1126 20:12:18.229034 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:18.229041 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:18.229097 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:18.258704 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:18.258728 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:18.258734 59960 cri.go:89] found id: ""
I1126 20:12:18.258741 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:18.258799 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:18.262617 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:18.266630 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:18.266703 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:18.294498 59960 cri.go:89] found id: ""
I1126 20:12:18.294520 59960 logs.go:282] 0 containers: []
W1126 20:12:18.294528 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:18.294535 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:18.294592 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:18.321461 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:18.321534 59960 cri.go:89] found id: ""
I1126 20:12:18.321556 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:18.321645 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:18.325350 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:18.325460 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:18.351492 59960 cri.go:89] found id: ""
I1126 20:12:18.351553 59960 logs.go:282] 0 containers: []
W1126 20:12:18.351579 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:18.351599 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:18.351637 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:18.407171 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:18.407205 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:18.439080 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:18.439112 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:18.547958 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:18.547995 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:18.619721 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:18.609846 9169 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:18.610654 9169 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:18.612119 9169 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:18.612768 9169 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:18.614366 9169 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:18.609846 9169 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:18.610654 9169 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:18.612119 9169 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:18.612768 9169 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:18.614366 9169 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:18.619742 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:18.619754 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:18.645098 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:18.645177 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:18.682606 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:18.682639 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:18.763422 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:18.763453 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:18.795735 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:18.795762 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:18.822004 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:18.822035 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:18.896691 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:18.896727 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:21.410083 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:21.420840 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:21.420938 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:21.446994 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:21.447016 59960 cri.go:89] found id: ""
I1126 20:12:21.447024 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:21.447102 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:21.450650 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:21.450721 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:21.479530 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:21.479554 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:21.479559 59960 cri.go:89] found id: ""
I1126 20:12:21.479566 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:21.479639 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:21.483856 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:21.487301 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:21.487396 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:21.514632 59960 cri.go:89] found id: ""
I1126 20:12:21.514655 59960 logs.go:282] 0 containers: []
W1126 20:12:21.514664 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:21.514677 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:21.514734 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:21.552676 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:21.552697 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:21.552701 59960 cri.go:89] found id: ""
I1126 20:12:21.552708 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:21.552764 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:21.558562 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:21.562503 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:21.562570 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:21.592027 59960 cri.go:89] found id: ""
I1126 20:12:21.592051 59960 logs.go:282] 0 containers: []
W1126 20:12:21.592059 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:21.592065 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:21.592122 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:21.622050 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:21.622069 59960 cri.go:89] found id: ""
I1126 20:12:21.622078 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:21.622133 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:21.625979 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:21.626057 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:21.659506 59960 cri.go:89] found id: ""
I1126 20:12:21.659530 59960 logs.go:282] 0 containers: []
W1126 20:12:21.659539 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:21.659548 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:21.659561 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:21.692379 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:21.692406 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:21.765021 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:21.765055 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:21.839116 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:21.830975 9297 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:21.831759 9297 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:21.833349 9297 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:21.833904 9297 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:21.835476 9297 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:21.830975 9297 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:21.831759 9297 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:21.833349 9297 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:21.833904 9297 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:21.835476 9297 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:21.839140 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:21.839153 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:21.865386 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:21.865413 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:21.904223 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:21.904257 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:21.949513 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:21.949545 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:21.975811 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:21.975838 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:22.009804 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:22.009830 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:22.114067 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:22.114107 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:22.129823 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:22.129850 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:24.699777 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:24.710717 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:24.710835 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:24.737361 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:24.737395 59960 cri.go:89] found id: ""
I1126 20:12:24.737404 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:24.737467 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:24.741100 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:24.741181 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:24.766942 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:24.767005 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:24.767023 59960 cri.go:89] found id: ""
I1126 20:12:24.767038 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:24.767117 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:24.771423 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:24.775599 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:24.775679 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:24.807211 59960 cri.go:89] found id: ""
I1126 20:12:24.807238 59960 logs.go:282] 0 containers: []
W1126 20:12:24.807247 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:24.807254 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:24.807313 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:24.839448 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:24.839474 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:24.839480 59960 cri.go:89] found id: ""
I1126 20:12:24.839487 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:24.839543 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:24.843345 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:24.846785 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:24.846859 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:24.875974 59960 cri.go:89] found id: ""
I1126 20:12:24.875999 59960 logs.go:282] 0 containers: []
W1126 20:12:24.876008 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:24.876015 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:24.876074 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:24.904623 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:24.904646 59960 cri.go:89] found id: ""
I1126 20:12:24.904655 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:24.904729 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:24.908536 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:24.908626 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:24.937367 59960 cri.go:89] found id: ""
I1126 20:12:24.937448 59960 logs.go:282] 0 containers: []
W1126 20:12:24.937471 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:24.937494 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:24.937534 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:24.976827 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:24.976864 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:25.024594 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:25.024629 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:25.103663 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:25.103701 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:25.184899 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:25.184934 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:25.288663 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:25.288696 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:25.303312 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:25.303340 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:25.371319 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:25.361818 9457 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:25.362509 9457 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:25.364256 9457 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:25.365013 9457 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:25.366870 9457 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:25.361818 9457 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:25.362509 9457 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:25.364256 9457 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:25.365013 9457 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:25.366870 9457 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:25.371342 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:25.371357 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:25.399886 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:25.399954 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:25.431130 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:25.431162 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:25.457679 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:25.457758 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:27.990400 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:28.001290 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:28.001359 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:28.027402 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:28.027424 59960 cri.go:89] found id: ""
I1126 20:12:28.027441 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:28.027501 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:28.030992 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:28.031083 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:28.072993 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:28.073014 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:28.073019 59960 cri.go:89] found id: ""
I1126 20:12:28.073026 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:28.073084 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:28.076846 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:28.080628 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:28.080762 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:28.107876 59960 cri.go:89] found id: ""
I1126 20:12:28.107902 59960 logs.go:282] 0 containers: []
W1126 20:12:28.107911 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:28.107918 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:28.107993 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:28.135277 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:28.135299 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:28.135305 59960 cri.go:89] found id: ""
I1126 20:12:28.135312 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:28.135369 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:28.139340 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:28.143115 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:28.143193 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:28.179129 59960 cri.go:89] found id: ""
I1126 20:12:28.179230 59960 logs.go:282] 0 containers: []
W1126 20:12:28.179259 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:28.179273 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:28.179346 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:28.208432 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:28.208453 59960 cri.go:89] found id: ""
I1126 20:12:28.208465 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:28.208523 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:28.212104 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:28.212174 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:28.239214 59960 cri.go:89] found id: ""
I1126 20:12:28.239290 59960 logs.go:282] 0 containers: []
W1126 20:12:28.239307 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:28.239317 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:28.239331 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:28.311306 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:28.311342 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:28.340943 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:28.340972 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:28.376088 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:28.376113 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:28.447578 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:28.440425 9590 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:28.440837 9590 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:28.442342 9590 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:28.442644 9590 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:28.444078 9590 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:28.440425 9590 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:28.440837 9590 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:28.442342 9590 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:28.442644 9590 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:28.444078 9590 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:28.447601 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:28.447613 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:28.494672 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:28.494707 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:28.524817 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:28.524847 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:28.611534 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:28.611568 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:28.717586 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:28.717621 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:28.729869 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:28.729894 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:28.755777 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:28.755805 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:31.304943 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:31.316121 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:31.316189 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:31.344914 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:31.344936 59960 cri.go:89] found id: ""
I1126 20:12:31.344945 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:31.345000 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:31.348636 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:31.348708 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:31.376592 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:31.376614 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:31.376623 59960 cri.go:89] found id: ""
I1126 20:12:31.376630 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:31.376683 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:31.380757 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:31.384468 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:31.384545 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:31.415544 59960 cri.go:89] found id: ""
I1126 20:12:31.415570 59960 logs.go:282] 0 containers: []
W1126 20:12:31.415579 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:31.415586 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:31.415646 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:31.441604 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:31.441680 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:31.441699 59960 cri.go:89] found id: ""
I1126 20:12:31.441723 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:31.441808 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:31.445590 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:31.449159 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:31.449233 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:31.475467 59960 cri.go:89] found id: ""
I1126 20:12:31.475492 59960 logs.go:282] 0 containers: []
W1126 20:12:31.475501 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:31.475507 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:31.475567 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:31.505974 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:31.505995 59960 cri.go:89] found id: ""
I1126 20:12:31.506004 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:31.506068 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:31.510913 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:31.510988 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:31.555870 59960 cri.go:89] found id: ""
I1126 20:12:31.555901 59960 logs.go:282] 0 containers: []
W1126 20:12:31.555911 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:31.555920 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:31.555932 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:31.569317 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:31.569396 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:31.639071 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:31.630335 9706 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:31.631132 9706 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:31.632992 9706 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:31.633425 9706 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:31.635012 9706 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:31.630335 9706 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:31.631132 9706 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:31.632992 9706 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:31.633425 9706 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:31.635012 9706 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:31.639141 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:31.639171 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:31.685122 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:31.685156 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:31.715735 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:31.715763 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:31.744469 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:31.744499 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:31.782788 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:31.782822 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:31.854784 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:31.854820 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:31.883960 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:31.883989 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:31.968197 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:31.968235 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:32.000618 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:32.000646 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:34.599812 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:34.610580 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:34.610690 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:34.643812 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:34.643835 59960 cri.go:89] found id: ""
I1126 20:12:34.643844 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:34.643902 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:34.647819 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:34.647891 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:34.681825 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:34.681849 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:34.681855 59960 cri.go:89] found id: ""
I1126 20:12:34.681863 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:34.681959 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:34.685589 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:34.689208 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:34.689280 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:34.719704 59960 cri.go:89] found id: ""
I1126 20:12:34.719727 59960 logs.go:282] 0 containers: []
W1126 20:12:34.719736 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:34.719743 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:34.719802 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:34.745609 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:34.745632 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:34.745639 59960 cri.go:89] found id: ""
I1126 20:12:34.745646 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:34.745704 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:34.749369 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:34.752915 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:34.752982 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:34.778956 59960 cri.go:89] found id: ""
I1126 20:12:34.778982 59960 logs.go:282] 0 containers: []
W1126 20:12:34.778996 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:34.779003 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:34.779059 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:34.805123 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:34.805146 59960 cri.go:89] found id: ""
I1126 20:12:34.805153 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:34.805211 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:34.808760 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:34.808834 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:34.834427 59960 cri.go:89] found id: ""
I1126 20:12:34.834452 59960 logs.go:282] 0 containers: []
W1126 20:12:34.834462 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:34.834471 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:34.834482 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:34.912760 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:34.912792 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:35.015751 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:35.015790 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:35.046216 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:35.046291 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:35.092725 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:35.092760 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:35.163096 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:35.163130 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:35.191405 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:35.191488 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:35.227181 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:35.227213 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:35.240889 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:35.240922 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:35.311849 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:35.302602 9888 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:35.303934 9888 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:35.304899 9888 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:35.306705 9888 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:35.307280 9888 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:35.302602 9888 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:35.303934 9888 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:35.304899 9888 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:35.306705 9888 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:35.307280 9888 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:35.311871 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:35.311884 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:35.356916 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:35.356951 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:37.883250 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:37.894052 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:37.894122 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:37.924918 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:37.924943 59960 cri.go:89] found id: ""
I1126 20:12:37.924956 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:37.925020 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:37.928865 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:37.928940 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:37.961907 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:37.961958 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:37.961964 59960 cri.go:89] found id: ""
I1126 20:12:37.961971 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:37.962035 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:37.965843 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:37.969339 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:37.969409 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:37.995343 59960 cri.go:89] found id: ""
I1126 20:12:37.995373 59960 logs.go:282] 0 containers: []
W1126 20:12:37.995381 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:37.995388 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:37.995491 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:38.022312 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:38.022334 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:38.022339 59960 cri.go:89] found id: ""
I1126 20:12:38.022346 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:38.022413 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:38.026080 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:38.029533 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:38.029622 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:38.060280 59960 cri.go:89] found id: ""
I1126 20:12:38.060307 59960 logs.go:282] 0 containers: []
W1126 20:12:38.060346 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:38.060368 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:38.060437 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:38.091248 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:38.091312 59960 cri.go:89] found id: ""
I1126 20:12:38.091327 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:38.091425 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:38.095836 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:38.095914 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:38.125378 59960 cri.go:89] found id: ""
I1126 20:12:38.125403 59960 logs.go:282] 0 containers: []
W1126 20:12:38.125413 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:38.125422 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:38.125436 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:38.151847 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:38.151875 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:38.202356 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:38.202391 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:38.247650 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:38.247725 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:38.275709 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:38.275736 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:38.307514 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:38.307542 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:38.404957 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:38.404994 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:38.491924 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:38.491962 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:38.521423 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:38.521460 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:38.598021 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:38.598053 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:38.610973 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:38.611004 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:38.687841 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:38.679705 10042 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:38.680686 10042 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:38.681793 10042 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:38.682498 10042 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:38.684162 10042 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:38.679705 10042 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:38.680686 10042 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:38.681793 10042 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:38.682498 10042 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:38.684162 10042 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:41.188401 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:41.199011 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:41.199080 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:41.227170 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:41.227196 59960 cri.go:89] found id: ""
I1126 20:12:41.227205 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:41.227260 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:41.230873 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:41.230945 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:41.257484 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:41.257506 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:41.257522 59960 cri.go:89] found id: ""
I1126 20:12:41.257529 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:41.257584 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:41.261286 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:41.265036 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:41.265101 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:41.290579 59960 cri.go:89] found id: ""
I1126 20:12:41.290645 59960 logs.go:282] 0 containers: []
W1126 20:12:41.290669 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:41.290682 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:41.290741 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:41.319766 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:41.319786 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:41.319791 59960 cri.go:89] found id: ""
I1126 20:12:41.319799 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:41.319859 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:41.323637 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:41.327077 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:41.327177 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:41.356676 59960 cri.go:89] found id: ""
I1126 20:12:41.356702 59960 logs.go:282] 0 containers: []
W1126 20:12:41.356711 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:41.356719 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:41.356783 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:41.385771 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:41.385790 59960 cri.go:89] found id: ""
I1126 20:12:41.385798 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:41.385852 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:41.389446 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:41.389544 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:41.416642 59960 cri.go:89] found id: ""
I1126 20:12:41.416710 59960 logs.go:282] 0 containers: []
W1126 20:12:41.416732 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:41.416754 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:41.416788 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:41.482246 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:41.473419 10111 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:41.474136 10111 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:41.475824 10111 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:41.476403 10111 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:41.478152 10111 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:41.473419 10111 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:41.474136 10111 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:41.475824 10111 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:41.476403 10111 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:41.478152 10111 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:41.482311 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:41.482339 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:41.509950 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:41.510016 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:41.557291 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:41.557324 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:41.584211 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:41.584240 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:41.666177 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:41.666212 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:41.767334 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:41.767369 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:41.781064 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:41.781089 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:41.825285 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:41.825321 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:41.892538 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:41.892573 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:41.920754 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:41.920785 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:44.468280 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:44.479465 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:44.479546 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:44.507592 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:44.507615 59960 cri.go:89] found id: ""
I1126 20:12:44.507623 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:44.507679 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:44.511422 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:44.511510 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:44.543146 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:44.543169 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:44.543174 59960 cri.go:89] found id: ""
I1126 20:12:44.543181 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:44.543251 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:44.547022 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:44.550639 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:44.550719 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:44.579025 59960 cri.go:89] found id: ""
I1126 20:12:44.579054 59960 logs.go:282] 0 containers: []
W1126 20:12:44.579063 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:44.579070 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:44.579139 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:44.611309 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:44.611332 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:44.611336 59960 cri.go:89] found id: ""
I1126 20:12:44.611344 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:44.611407 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:44.615332 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:44.619108 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:44.619183 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:44.645161 59960 cri.go:89] found id: ""
I1126 20:12:44.645185 59960 logs.go:282] 0 containers: []
W1126 20:12:44.645194 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:44.645201 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:44.645257 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:44.684280 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:44.684301 59960 cri.go:89] found id: ""
I1126 20:12:44.684310 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:44.684364 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:44.687985 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:44.688057 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:44.713170 59960 cri.go:89] found id: ""
I1126 20:12:44.713193 59960 logs.go:282] 0 containers: []
W1126 20:12:44.713202 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:44.713211 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:44.713225 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:44.790764 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:44.782647 10250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:44.783505 10250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:44.785179 10250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:44.785579 10250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:44.787022 10250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:44.782647 10250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:44.783505 10250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:44.785179 10250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:44.785579 10250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:44.787022 10250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:44.790787 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:44.790801 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:44.841911 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:44.842082 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:44.886124 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:44.886155 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:44.956783 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:44.956817 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:44.992805 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:44.992834 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:45.021163 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:45.021190 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:45.060873 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:45.061452 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:45.201027 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:45.201119 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:45.266419 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:45.266547 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:45.415986 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:45.416024 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:47.928674 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:47.940771 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:47.940843 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:47.966175 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:47.966194 59960 cri.go:89] found id: ""
I1126 20:12:47.966202 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:47.966254 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:47.969908 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:47.970011 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:47.997001 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:47.997027 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:47.997032 59960 cri.go:89] found id: ""
I1126 20:12:47.997040 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:47.997096 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:48.001757 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:48.005881 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:48.005980 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:48.031565 59960 cri.go:89] found id: ""
I1126 20:12:48.031587 59960 logs.go:282] 0 containers: []
W1126 20:12:48.031595 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:48.031602 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:48.031660 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:48.063357 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:48.063380 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:48.063386 59960 cri.go:89] found id: ""
I1126 20:12:48.063393 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:48.063450 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:48.068044 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:48.073135 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:48.073260 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:48.103364 59960 cri.go:89] found id: ""
I1126 20:12:48.103391 59960 logs.go:282] 0 containers: []
W1126 20:12:48.103401 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:48.103408 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:48.103511 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:48.134700 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:48.134720 59960 cri.go:89] found id: ""
I1126 20:12:48.134728 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:48.134795 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:48.138489 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:48.138568 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:48.164615 59960 cri.go:89] found id: ""
I1126 20:12:48.164639 59960 logs.go:282] 0 containers: []
W1126 20:12:48.164648 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:48.164657 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:48.164670 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:48.238206 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:48.238245 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:48.270325 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:48.270352 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:48.316632 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:48.316660 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:48.328526 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:48.328554 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:48.370051 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:48.370081 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:48.397236 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:48.397264 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:48.478994 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:48.479029 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:48.586134 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:48.586167 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:48.661172 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:48.650880 10438 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:48.652436 10438 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:48.653061 10438 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:48.654717 10438 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:48.655290 10438 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:48.650880 10438 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:48.652436 10438 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:48.653061 10438 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:48.654717 10438 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:48.655290 10438 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:48.661195 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:48.661211 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:48.689769 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:48.689797 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:51.235721 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:51.246961 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:51.247038 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:51.276386 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:51.276410 59960 cri.go:89] found id: ""
I1126 20:12:51.276419 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:51.276472 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:51.280282 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:51.280363 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:51.307844 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:51.307875 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:51.307880 59960 cri.go:89] found id: ""
I1126 20:12:51.307888 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:51.307944 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:51.311885 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:51.315516 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:51.315643 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:51.343040 59960 cri.go:89] found id: ""
I1126 20:12:51.343068 59960 logs.go:282] 0 containers: []
W1126 20:12:51.343077 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:51.343084 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:51.343144 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:51.371879 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:51.371901 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:51.371907 59960 cri.go:89] found id: ""
I1126 20:12:51.371920 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:51.371976 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:51.375815 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:51.379444 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:51.379518 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:51.409590 59960 cri.go:89] found id: ""
I1126 20:12:51.409615 59960 logs.go:282] 0 containers: []
W1126 20:12:51.409624 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:51.409630 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:51.409688 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:51.440665 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:51.440692 59960 cri.go:89] found id: ""
I1126 20:12:51.440701 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:51.440756 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:51.444486 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:51.444565 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:51.470661 59960 cri.go:89] found id: ""
I1126 20:12:51.470686 59960 logs.go:282] 0 containers: []
W1126 20:12:51.470695 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:51.470705 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:51.470749 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:51.482794 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:51.482823 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:51.570460 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:51.561457 10526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:51.562296 10526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:51.563970 10526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:51.564288 10526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:51.566409 10526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:51.561457 10526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:51.562296 10526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:51.563970 10526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:51.564288 10526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:51.566409 10526 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:51.570484 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:51.570498 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:51.596696 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:51.596724 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:51.657780 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:51.657820 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:51.736300 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:51.736338 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:51.772635 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:51.772664 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:51.808014 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:51.808042 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:51.909775 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:51.909814 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:51.955849 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:51.955887 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:51.986011 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:51.986040 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:54.569991 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:54.582000 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:54.582074 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:54.610486 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:54.610506 59960 cri.go:89] found id: ""
I1126 20:12:54.610515 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:54.610573 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:54.614711 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:54.614787 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:54.641548 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:54.641571 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:54.641577 59960 cri.go:89] found id: ""
I1126 20:12:54.641584 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:54.641645 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:54.645430 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:54.649375 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:54.649465 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:54.677350 59960 cri.go:89] found id: ""
I1126 20:12:54.677377 59960 logs.go:282] 0 containers: []
W1126 20:12:54.677386 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:54.677399 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:54.677456 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:54.706226 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:54.706249 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:54.706254 59960 cri.go:89] found id: ""
I1126 20:12:54.706261 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:54.706315 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:54.710188 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:54.713666 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:54.713759 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:54.745132 59960 cri.go:89] found id: ""
I1126 20:12:54.745158 59960 logs.go:282] 0 containers: []
W1126 20:12:54.745167 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:54.745174 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:54.745235 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:54.774016 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:54.774039 59960 cri.go:89] found id: ""
I1126 20:12:54.774047 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:54.774105 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:54.778220 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:54.778293 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:54.807768 59960 cri.go:89] found id: ""
I1126 20:12:54.807831 59960 logs.go:282] 0 containers: []
W1126 20:12:54.807845 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:54.807855 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:54.807867 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:54.904620 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:54.904657 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:54.931520 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:54.931548 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:54.974322 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:54.974360 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:55.010146 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:55.010176 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:55.044963 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:55.045006 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:55.060490 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:55.060520 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:55.132694 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:55.124286 10699 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:55.124937 10699 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:55.126610 10699 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:55.127207 10699 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:55.128929 10699 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:55.124286 10699 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:55.124937 10699 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:55.126610 10699 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:55.127207 10699 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:55.128929 10699 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:12:55.132729 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:55.132746 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:55.180103 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:55.180139 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:55.258117 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:55.258154 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:55.289687 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:55.289716 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:57.870076 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:12:57.881883 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:12:57.881978 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:12:57.911809 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:57.911833 59960 cri.go:89] found id: ""
I1126 20:12:57.911841 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:12:57.911899 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:57.915590 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:12:57.915685 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:12:57.943647 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:57.943671 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:57.943677 59960 cri.go:89] found id: ""
I1126 20:12:57.943684 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:12:57.943747 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:57.947699 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:57.951409 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:12:57.951489 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:12:57.979114 59960 cri.go:89] found id: ""
I1126 20:12:57.979138 59960 logs.go:282] 0 containers: []
W1126 20:12:57.979147 59960 logs.go:284] No container was found matching "coredns"
I1126 20:12:57.979154 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:12:57.979214 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:12:58.009760 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:58.009781 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:58.009787 59960 cri.go:89] found id: ""
I1126 20:12:58.009794 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:12:58.009855 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:58.013598 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:58.017135 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:12:58.017207 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:12:58.047222 59960 cri.go:89] found id: ""
I1126 20:12:58.047247 59960 logs.go:282] 0 containers: []
W1126 20:12:58.047255 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:12:58.047262 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:12:58.047324 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:12:58.094431 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:58.094510 59960 cri.go:89] found id: ""
I1126 20:12:58.094524 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:12:58.094586 59960 ssh_runner.go:195] Run: which crictl
I1126 20:12:58.099004 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:12:58.099099 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:12:58.126698 59960 cri.go:89] found id: ""
I1126 20:12:58.126727 59960 logs.go:282] 0 containers: []
W1126 20:12:58.126735 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:12:58.126744 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:12:58.126756 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:12:58.155602 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:12:58.155629 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:12:58.196131 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:12:58.196166 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:12:58.243760 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:12:58.243793 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:12:58.314546 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:12:58.314583 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:12:58.347422 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:12:58.347451 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:12:58.373247 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:12:58.373277 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:12:58.448488 59960 logs.go:123] Gathering logs for container status ...
I1126 20:12:58.448524 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:12:58.480586 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:12:58.480615 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:12:58.586743 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:12:58.586799 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:12:58.600003 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:12:58.600029 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:12:58.682648 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:12:58.673481 10861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:58.674315 10861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:58.675021 10861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:58.676838 10861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:58.677737 10861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:12:58.673481 10861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:58.674315 10861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:58.675021 10861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:58.676838 10861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:12:58.677737 10861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:01.183502 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:01.195046 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:01.195153 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:01.224257 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:01.224281 59960 cri.go:89] found id: ""
I1126 20:13:01.224289 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:01.224365 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:01.228134 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:01.228206 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:01.265990 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:01.266014 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:01.266019 59960 cri.go:89] found id: ""
I1126 20:13:01.266027 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:01.266084 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:01.270682 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:01.274505 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:01.274580 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:01.302962 59960 cri.go:89] found id: ""
I1126 20:13:01.302989 59960 logs.go:282] 0 containers: []
W1126 20:13:01.302998 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:01.303005 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:01.303072 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:01.335599 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:01.335621 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:01.335627 59960 cri.go:89] found id: ""
I1126 20:13:01.335635 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:01.335689 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:01.339621 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:01.343531 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:01.343614 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:01.369553 59960 cri.go:89] found id: ""
I1126 20:13:01.369578 59960 logs.go:282] 0 containers: []
W1126 20:13:01.369588 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:01.369594 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:01.369657 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:01.402170 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:01.402197 59960 cri.go:89] found id: ""
I1126 20:13:01.402205 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:01.402266 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:01.406260 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:01.406336 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:01.432250 59960 cri.go:89] found id: ""
I1126 20:13:01.432326 59960 logs.go:282] 0 containers: []
W1126 20:13:01.432352 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:01.432362 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:01.432378 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:01.473457 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:01.473491 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:01.525391 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:01.525445 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:01.557734 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:01.557765 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:01.650427 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:01.650465 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:01.696040 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:01.696070 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:01.801258 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:01.801297 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:01.872498 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:01.872534 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:01.912672 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:01.912725 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:01.927976 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:01.928008 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:02.002577 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:01.992139 10989 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:01.993221 10989 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:01.994589 10989 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:01.996153 10989 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:01.996915 10989 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:01.992139 10989 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:01.993221 10989 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:01.994589 10989 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:01.996153 10989 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:01.996915 10989 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:02.002601 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:02.002614 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:04.532051 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:04.544501 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:04.544572 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:04.571414 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:04.571435 59960 cri.go:89] found id: ""
I1126 20:13:04.571443 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:04.571494 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:04.575072 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:04.575149 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:04.603292 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:04.603312 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:04.603316 59960 cri.go:89] found id: ""
I1126 20:13:04.603326 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:04.603378 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:04.607479 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:04.610889 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:04.610970 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:04.636626 59960 cri.go:89] found id: ""
I1126 20:13:04.636652 59960 logs.go:282] 0 containers: []
W1126 20:13:04.636662 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:04.636668 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:04.636745 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:04.665487 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:04.665511 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:04.665516 59960 cri.go:89] found id: ""
I1126 20:13:04.665523 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:04.665599 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:04.669516 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:04.673155 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:04.673221 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:04.705848 59960 cri.go:89] found id: ""
I1126 20:13:04.705873 59960 logs.go:282] 0 containers: []
W1126 20:13:04.705882 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:04.705888 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:04.705971 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:04.741254 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:04.741277 59960 cri.go:89] found id: ""
I1126 20:13:04.741285 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:04.741340 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:04.745396 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:04.745469 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:04.777680 59960 cri.go:89] found id: ""
I1126 20:13:04.777713 59960 logs.go:282] 0 containers: []
W1126 20:13:04.777723 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:04.777732 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:04.777744 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:04.884972 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:04.885008 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:04.898040 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:04.898066 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:04.971530 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:04.971610 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:05.003493 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:05.003573 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:05.082481 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:05.082515 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:05.116089 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:05.116119 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:05.186979 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:05.178888 11103 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:05.179664 11103 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:05.181297 11103 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:05.181664 11103 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:05.183205 11103 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:05.178888 11103 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:05.179664 11103 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:05.181297 11103 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:05.181664 11103 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:05.183205 11103 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:05.187006 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:05.187020 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:05.214669 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:05.214698 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:05.261207 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:05.261238 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:05.306449 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:05.306482 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:07.838042 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:07.850498 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:07.850567 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:07.878108 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:07.878130 59960 cri.go:89] found id: ""
I1126 20:13:07.878138 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:07.878197 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:07.882580 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:07.882654 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:07.911855 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:07.911886 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:07.911891 59960 cri.go:89] found id: ""
I1126 20:13:07.911899 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:07.911960 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:07.915705 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:07.919300 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:07.919371 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:07.951018 59960 cri.go:89] found id: ""
I1126 20:13:07.951044 59960 logs.go:282] 0 containers: []
W1126 20:13:07.951053 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:07.951059 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:07.951119 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:07.978929 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:07.978951 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:07.978956 59960 cri.go:89] found id: ""
I1126 20:13:07.978963 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:07.979017 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:07.983189 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:07.986830 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:07.986903 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:08.016199 59960 cri.go:89] found id: ""
I1126 20:13:08.016231 59960 logs.go:282] 0 containers: []
W1126 20:13:08.016240 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:08.016251 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:08.016325 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:08.053456 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:08.053528 59960 cri.go:89] found id: ""
I1126 20:13:08.053549 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:08.053644 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:08.057986 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:08.058066 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:08.087479 59960 cri.go:89] found id: ""
I1126 20:13:08.087508 59960 logs.go:282] 0 containers: []
W1126 20:13:08.087517 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:08.087533 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:08.087546 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:08.132468 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:08.132502 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:08.176740 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:08.176778 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:08.250131 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:08.250178 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:08.280307 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:08.280337 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:08.310477 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:08.310506 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:08.413610 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:08.413648 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:08.484512 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:08.474848 11250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:08.476074 11250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:08.477530 11250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:08.478182 11250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:08.479748 11250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:08.474848 11250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:08.476074 11250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:08.477530 11250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:08.478182 11250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:08.479748 11250 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:08.484538 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:08.484551 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:08.561138 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:08.561172 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:08.596362 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:08.596439 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:08.609838 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:08.609909 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:11.136633 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:11.147922 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:11.148007 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:11.179880 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:11.179915 59960 cri.go:89] found id: ""
I1126 20:13:11.179923 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:11.180040 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:11.184887 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:11.184958 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:11.213848 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:11.213872 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:11.213878 59960 cri.go:89] found id: ""
I1126 20:13:11.213885 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:11.213981 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:11.217804 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:11.221572 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:11.221649 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:11.258706 59960 cri.go:89] found id: ""
I1126 20:13:11.258783 59960 logs.go:282] 0 containers: []
W1126 20:13:11.258799 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:11.258806 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:11.258880 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:11.289663 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:11.289686 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:11.289692 59960 cri.go:89] found id: ""
I1126 20:13:11.289699 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:11.289755 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:11.293522 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:11.298425 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:11.298504 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:11.325442 59960 cri.go:89] found id: ""
I1126 20:13:11.325508 59960 logs.go:282] 0 containers: []
W1126 20:13:11.325534 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:11.325552 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:11.325636 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:11.352745 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:11.352808 59960 cri.go:89] found id: ""
I1126 20:13:11.352834 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:11.352923 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:11.356710 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:11.356824 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:11.384378 59960 cri.go:89] found id: ""
I1126 20:13:11.384402 59960 logs.go:282] 0 containers: []
W1126 20:13:11.384412 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:11.384421 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:11.384433 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:11.396869 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:11.396938 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:11.467278 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:11.459180 11348 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:11.459948 11348 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:11.461472 11348 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:11.462000 11348 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:11.463589 11348 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:11.459180 11348 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:11.459948 11348 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:11.461472 11348 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:11.462000 11348 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:11.463589 11348 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:11.467302 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:11.467316 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:11.494598 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:11.494626 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:11.533337 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:11.533372 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:11.559364 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:11.559392 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:11.642834 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:11.642873 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:11.680367 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:11.680393 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:11.784039 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:11.784075 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:11.834225 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:11.834260 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:11.905094 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:11.905129 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:14.439226 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:14.451155 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:14.451245 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:14.493752 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:14.493776 59960 cri.go:89] found id: ""
I1126 20:13:14.493784 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:14.493840 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:14.497504 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:14.497627 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:14.524624 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:14.524646 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:14.524652 59960 cri.go:89] found id: ""
I1126 20:13:14.524659 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:14.524743 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:14.528418 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:14.532417 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:14.532512 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:14.559402 59960 cri.go:89] found id: ""
I1126 20:13:14.559477 59960 logs.go:282] 0 containers: []
W1126 20:13:14.559491 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:14.559498 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:14.559556 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:14.588825 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:14.588848 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:14.588853 59960 cri.go:89] found id: ""
I1126 20:13:14.588860 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:14.588921 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:14.593022 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:14.596763 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:14.596831 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:14.624835 59960 cri.go:89] found id: ""
I1126 20:13:14.624858 59960 logs.go:282] 0 containers: []
W1126 20:13:14.624867 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:14.624874 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:14.624929 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:14.650771 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:14.650846 59960 cri.go:89] found id: ""
I1126 20:13:14.650872 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:14.650960 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:14.656095 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:14.656219 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:14.682420 59960 cri.go:89] found id: ""
I1126 20:13:14.682493 59960 logs.go:282] 0 containers: []
W1126 20:13:14.682517 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:14.682540 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:14.682581 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:14.722936 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:14.722971 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:14.754105 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:14.754134 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:14.786128 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:14.786156 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:14.798341 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:14.798370 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:14.873270 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:14.865757 11515 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:14.866349 11515 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:14.867866 11515 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:14.868348 11515 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:14.869793 11515 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:14.865757 11515 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:14.866349 11515 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:14.867866 11515 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:14.868348 11515 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:14.869793 11515 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:14.873292 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:14.873306 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:14.920206 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:14.920240 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:14.996591 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:14.996624 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:15.024423 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:15.024451 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:15.105848 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:15.105881 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:15.205091 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:15.205170 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:17.734682 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:17.745326 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:17.745391 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:17.773503 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:17.773525 59960 cri.go:89] found id: ""
I1126 20:13:17.773534 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:17.773621 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:17.777326 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:17.777400 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:17.805117 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:17.805139 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:17.805144 59960 cri.go:89] found id: ""
I1126 20:13:17.805151 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:17.805206 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:17.809065 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:17.812530 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:17.812601 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:17.841430 59960 cri.go:89] found id: ""
I1126 20:13:17.841456 59960 logs.go:282] 0 containers: []
W1126 20:13:17.841465 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:17.841472 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:17.841530 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:17.868985 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:17.869009 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:17.869014 59960 cri.go:89] found id: ""
I1126 20:13:17.869024 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:17.869081 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:17.882183 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:17.885701 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:17.885794 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:17.918849 59960 cri.go:89] found id: ""
I1126 20:13:17.918872 59960 logs.go:282] 0 containers: []
W1126 20:13:17.918880 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:17.918887 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:17.918947 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:17.949773 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:17.949849 59960 cri.go:89] found id: ""
I1126 20:13:17.949872 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:17.949996 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:17.953636 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:17.953705 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:17.980243 59960 cri.go:89] found id: ""
I1126 20:13:17.980266 59960 logs.go:282] 0 containers: []
W1126 20:13:17.980275 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:17.980284 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:17.980295 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:18.011301 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:18.011331 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:18.038493 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:18.038526 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:18.080613 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:18.080641 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:18.160950 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:18.160988 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:18.262170 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:18.262215 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:18.275569 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:18.275593 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:18.351781 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:18.343534 11661 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:18.344057 11661 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:18.345769 11661 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:18.346381 11661 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:18.347931 11661 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:18.343534 11661 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:18.344057 11661 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:18.345769 11661 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:18.346381 11661 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:18.347931 11661 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:18.351805 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:18.351817 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:18.389344 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:18.389375 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:18.434916 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:18.434949 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:18.527668 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:18.527702 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:21.058771 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:21.073274 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:21.073339 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:21.121326 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:21.121345 59960 cri.go:89] found id: ""
I1126 20:13:21.121356 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:21.121415 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:21.130434 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:21.130507 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:21.164100 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:21.164161 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:21.164191 59960 cri.go:89] found id: ""
I1126 20:13:21.164212 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:21.164289 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:21.168566 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:21.173217 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:21.173328 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:21.201882 59960 cri.go:89] found id: ""
I1126 20:13:21.202006 59960 logs.go:282] 0 containers: []
W1126 20:13:21.202036 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:21.202055 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:21.202157 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:21.230033 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:21.230099 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:21.230120 59960 cri.go:89] found id: ""
I1126 20:13:21.230144 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:21.230222 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:21.234188 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:21.238625 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:21.238709 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:21.266450 59960 cri.go:89] found id: ""
I1126 20:13:21.266476 59960 logs.go:282] 0 containers: []
W1126 20:13:21.266485 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:21.266492 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:21.266567 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:21.293192 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:21.293221 59960 cri.go:89] found id: ""
I1126 20:13:21.293229 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:21.293320 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:21.297074 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:21.297146 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:21.325608 59960 cri.go:89] found id: ""
I1126 20:13:21.325635 59960 logs.go:282] 0 containers: []
W1126 20:13:21.325644 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:21.325653 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:21.325665 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:21.365168 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:21.365201 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:21.407809 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:21.407841 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:21.490502 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:21.490538 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:21.593562 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:21.593598 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:21.620251 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:21.620280 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:21.696224 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:21.696260 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:21.724295 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:21.724324 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:21.754121 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:21.754146 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:21.785320 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:21.785347 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:21.797528 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:21.797556 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:21.871066 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:21.862248 11832 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:21.863127 11832 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:21.864832 11832 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:21.865449 11832 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:21.867089 11832 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:21.862248 11832 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:21.863127 11832 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:21.864832 11832 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:21.865449 11832 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:21.867089 11832 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:24.371542 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:24.382011 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:24.382074 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:24.413323 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:24.413351 59960 cri.go:89] found id: ""
I1126 20:13:24.413360 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:24.413418 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:24.417248 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:24.417327 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:24.443549 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:24.443571 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:24.443576 59960 cri.go:89] found id: ""
I1126 20:13:24.443583 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:24.443638 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:24.447448 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:24.450865 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:24.450933 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:24.481019 59960 cri.go:89] found id: ""
I1126 20:13:24.481043 59960 logs.go:282] 0 containers: []
W1126 20:13:24.481052 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:24.481059 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:24.481119 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:24.509327 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:24.509349 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:24.509354 59960 cri.go:89] found id: ""
I1126 20:13:24.509361 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:24.509416 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:24.512867 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:24.516116 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:24.516181 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:24.546284 59960 cri.go:89] found id: ""
I1126 20:13:24.546361 59960 logs.go:282] 0 containers: []
W1126 20:13:24.546390 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:24.546405 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:24.546464 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:24.571968 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:24.572032 59960 cri.go:89] found id: ""
I1126 20:13:24.572047 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:24.572113 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:24.575760 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:24.575830 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:24.603299 59960 cri.go:89] found id: ""
I1126 20:13:24.603325 59960 logs.go:282] 0 containers: []
W1126 20:13:24.603334 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:24.603373 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:24.603390 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:24.642562 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:24.642595 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:24.696607 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:24.696640 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:24.724494 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:24.724523 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:24.805443 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:24.805477 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:24.880673 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:24.872137 11925 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:24.872936 11925 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:24.874737 11925 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:24.875329 11925 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:24.876994 11925 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:24.872137 11925 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:24.872936 11925 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:24.874737 11925 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:24.875329 11925 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:24.876994 11925 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:24.880694 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:24.880708 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:24.912019 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:24.912047 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:24.998475 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:24.998511 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:25.027058 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:25.027084 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:25.060548 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:25.060577 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:25.167756 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:25.167795 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:27.682279 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:27.693116 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:27.693189 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:27.720687 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:27.720706 59960 cri.go:89] found id: ""
I1126 20:13:27.720713 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:27.720765 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:27.724317 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:27.724388 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:27.751345 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:27.751369 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:27.751375 59960 cri.go:89] found id: ""
I1126 20:13:27.751384 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:27.751445 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:27.755313 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:27.758668 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:27.758738 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:27.788496 59960 cri.go:89] found id: ""
I1126 20:13:27.788567 59960 logs.go:282] 0 containers: []
W1126 20:13:27.788592 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:27.788611 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:27.788703 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:27.815714 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:27.815743 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:27.815749 59960 cri.go:89] found id: ""
I1126 20:13:27.815757 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:27.815831 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:27.819360 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:27.822959 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:27.823038 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:27.853270 59960 cri.go:89] found id: ""
I1126 20:13:27.853316 59960 logs.go:282] 0 containers: []
W1126 20:13:27.853326 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:27.853333 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:27.853403 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:27.880677 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:27.880701 59960 cri.go:89] found id: ""
I1126 20:13:27.880710 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:27.880766 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:27.884425 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:27.884499 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:27.917060 59960 cri.go:89] found id: ""
I1126 20:13:27.917126 59960 logs.go:282] 0 containers: []
W1126 20:13:27.917150 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:27.917183 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:27.917213 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:27.929246 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:27.929321 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:28.005492 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:27.995998 12038 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:27.996970 12038 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:27.999116 12038 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:28.000043 12038 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:28.001867 12038 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:27.995998 12038 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:27.996970 12038 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:27.999116 12038 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:28.000043 12038 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:28.001867 12038 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:28.005554 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:28.005581 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:28.032388 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:28.032414 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:28.090244 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:28.090279 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:28.140049 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:28.140081 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:28.217015 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:28.217052 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:28.252634 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:28.252663 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:28.356298 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:28.356347 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:28.391198 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:28.391227 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:28.470669 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:28.470706 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:31.018712 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:31.029520 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:31.029594 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:31.067229 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:31.067249 59960 cri.go:89] found id: ""
I1126 20:13:31.067257 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:31.067315 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:31.071728 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:31.071796 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:31.100937 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:31.101015 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:31.101024 59960 cri.go:89] found id: ""
I1126 20:13:31.101032 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:31.101092 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:31.106006 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:31.109883 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:31.110020 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:31.140073 59960 cri.go:89] found id: ""
I1126 20:13:31.140098 59960 logs.go:282] 0 containers: []
W1126 20:13:31.140107 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:31.140114 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:31.140177 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:31.170126 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:31.170150 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:31.170155 59960 cri.go:89] found id: ""
I1126 20:13:31.170163 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:31.170220 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:31.175522 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:31.180015 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:31.180137 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:31.216744 59960 cri.go:89] found id: ""
I1126 20:13:31.216771 59960 logs.go:282] 0 containers: []
W1126 20:13:31.216781 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:31.216787 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:31.216847 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:31.244620 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:31.244653 59960 cri.go:89] found id: ""
I1126 20:13:31.244661 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:31.244727 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:31.248677 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:31.248770 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:31.275812 59960 cri.go:89] found id: ""
I1126 20:13:31.275890 59960 logs.go:282] 0 containers: []
W1126 20:13:31.275914 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:31.275936 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:31.275972 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:31.308954 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:31.308981 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:31.404058 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:31.404140 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:31.449144 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:31.449177 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:31.526538 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:31.526575 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:31.613358 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:31.613393 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:31.626272 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:31.626300 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:31.701051 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:31.692350 12209 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:31.693035 12209 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:31.694572 12209 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:31.695120 12209 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:31.696599 12209 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:31.692350 12209 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:31.693035 12209 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:31.694572 12209 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:31.695120 12209 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:31.696599 12209 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:31.701076 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:31.701089 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:31.726047 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:31.726075 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:31.770205 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:31.770246 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:31.800872 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:31.800898 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:34.331337 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:34.343013 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:34.343079 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:34.369127 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:34.369186 59960 cri.go:89] found id: ""
I1126 20:13:34.369220 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:34.369305 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:34.372919 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:34.372984 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:34.400785 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:34.400806 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:34.400811 59960 cri.go:89] found id: ""
I1126 20:13:34.400818 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:34.400871 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:34.404967 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:34.408568 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:34.408648 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:34.434956 59960 cri.go:89] found id: ""
I1126 20:13:34.434981 59960 logs.go:282] 0 containers: []
W1126 20:13:34.434990 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:34.434996 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:34.435051 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:34.472918 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:34.472943 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:34.472948 59960 cri.go:89] found id: ""
I1126 20:13:34.472956 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:34.473009 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:34.476556 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:34.480021 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:34.480097 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:34.506491 59960 cri.go:89] found id: ""
I1126 20:13:34.506513 59960 logs.go:282] 0 containers: []
W1126 20:13:34.506522 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:34.506528 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:34.506587 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:34.534595 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:34.534618 59960 cri.go:89] found id: ""
I1126 20:13:34.534627 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:34.534681 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:34.542373 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:34.542487 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:34.569404 59960 cri.go:89] found id: ""
I1126 20:13:34.569439 59960 logs.go:282] 0 containers: []
W1126 20:13:34.569449 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:34.569473 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:34.569491 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:34.594901 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:34.594926 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:34.661252 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:34.661357 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:34.736470 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:34.736504 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:34.767635 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:34.767659 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:34.849541 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:34.849578 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:34.890089 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:34.890122 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:34.918362 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:34.918390 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:34.955774 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:34.955800 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:35.056965 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:35.057001 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:35.078639 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:35.078668 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:35.151655 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:35.143337 12379 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:35.143918 12379 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:35.145438 12379 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:35.146046 12379 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:35.147630 12379 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:35.143337 12379 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:35.143918 12379 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:35.145438 12379 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:35.146046 12379 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:35.147630 12379 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:37.653306 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:37.665236 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:37.665306 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:37.692381 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:37.692404 59960 cri.go:89] found id: ""
I1126 20:13:37.692420 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:37.692475 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:37.696411 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:37.696485 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:37.733416 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:37.733447 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:37.733452 59960 cri.go:89] found id: ""
I1126 20:13:37.733459 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:37.733512 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:37.737487 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:37.740759 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:37.740827 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:37.770540 59960 cri.go:89] found id: ""
I1126 20:13:37.770563 59960 logs.go:282] 0 containers: []
W1126 20:13:37.770571 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:37.770578 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:37.770645 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:37.798542 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:37.798566 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:37.798572 59960 cri.go:89] found id: ""
I1126 20:13:37.798579 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:37.798632 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:37.802507 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:37.806007 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:37.806128 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:37.831752 59960 cri.go:89] found id: ""
I1126 20:13:37.831780 59960 logs.go:282] 0 containers: []
W1126 20:13:37.831789 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:37.831796 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:37.831911 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:37.859491 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:37.859516 59960 cri.go:89] found id: ""
I1126 20:13:37.859526 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:37.859608 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:37.863305 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:37.863407 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:37.890262 59960 cri.go:89] found id: ""
I1126 20:13:37.890324 59960 logs.go:282] 0 containers: []
W1126 20:13:37.890347 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:37.890370 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:37.890389 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:37.915303 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:37.915334 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:38.015981 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:38.016018 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:38.028479 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:38.028518 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:38.117235 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:38.107607 12465 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:38.108494 12465 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:38.110529 12465 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:38.111224 12465 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:38.112955 12465 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:38.107607 12465 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:38.108494 12465 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:38.110529 12465 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:38.111224 12465 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:38.112955 12465 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:38.117268 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:38.117293 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:38.146073 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:38.146106 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:38.223055 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:38.223091 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:38.256738 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:38.256769 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:38.284204 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:38.284234 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:38.322205 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:38.322237 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:38.365768 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:38.365800 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:40.946037 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:40.957084 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:40.957219 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:40.988160 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:40.988223 59960 cri.go:89] found id: ""
I1126 20:13:40.988247 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:40.988330 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:40.991862 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:40.991975 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:41.021645 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:41.021671 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:41.021676 59960 cri.go:89] found id: ""
I1126 20:13:41.021683 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:41.021776 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:41.025458 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:41.028751 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:41.028818 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:41.055272 59960 cri.go:89] found id: ""
I1126 20:13:41.055297 59960 logs.go:282] 0 containers: []
W1126 20:13:41.055306 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:41.055313 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:41.055373 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:41.083272 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:41.083293 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:41.083298 59960 cri.go:89] found id: ""
I1126 20:13:41.083306 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:41.083361 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:41.089116 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:41.092770 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:41.092882 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:41.119939 59960 cri.go:89] found id: ""
I1126 20:13:41.119969 59960 logs.go:282] 0 containers: []
W1126 20:13:41.119978 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:41.119985 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:41.120085 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:41.149635 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:41.149657 59960 cri.go:89] found id: ""
I1126 20:13:41.149666 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:41.149719 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:41.153346 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:41.153420 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:41.180294 59960 cri.go:89] found id: ""
I1126 20:13:41.180320 59960 logs.go:282] 0 containers: []
W1126 20:13:41.180329 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:41.180338 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:41.180350 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:41.207608 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:41.207638 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:41.250184 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:41.250217 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:41.280787 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:41.280815 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:41.350595 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:41.339246 12613 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:41.340025 12613 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:41.341777 12613 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:41.342622 12613 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:41.345147 12613 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:41.339246 12613 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:41.340025 12613 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:41.341777 12613 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:41.342622 12613 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:41.345147 12613 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:41.350618 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:41.350631 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:41.395571 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:41.395607 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:41.471537 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:41.471576 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:41.503158 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:41.503187 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:41.581612 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:41.581647 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:41.616210 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:41.616238 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:41.712278 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:41.712311 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:44.224835 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:44.235354 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:44.235427 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:44.262020 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:44.262040 59960 cri.go:89] found id: ""
I1126 20:13:44.262047 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:44.262100 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:44.266500 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:44.266621 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:44.293469 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:44.293492 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:44.293498 59960 cri.go:89] found id: ""
I1126 20:13:44.293515 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:44.293592 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:44.297513 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:44.301293 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:44.301379 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:44.331229 59960 cri.go:89] found id: ""
I1126 20:13:44.331252 59960 logs.go:282] 0 containers: []
W1126 20:13:44.331260 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:44.331266 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:44.331326 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:44.358510 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:44.358529 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:44.358534 59960 cri.go:89] found id: ""
I1126 20:13:44.358540 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:44.358597 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:44.362369 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:44.365719 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:44.365788 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:44.401237 59960 cri.go:89] found id: ""
I1126 20:13:44.401303 59960 logs.go:282] 0 containers: []
W1126 20:13:44.401326 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:44.401348 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:44.401437 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:44.428506 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:44.428524 59960 cri.go:89] found id: ""
I1126 20:13:44.428537 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:44.428592 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:44.432302 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:44.432379 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:44.461193 59960 cri.go:89] found id: ""
I1126 20:13:44.461216 59960 logs.go:282] 0 containers: []
W1126 20:13:44.461225 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:44.461234 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:44.461245 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:44.472842 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:44.472911 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:44.552602 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:44.536833 12725 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:44.537581 12725 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:44.546763 12725 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:44.547452 12725 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:44.548655 12725 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:44.536833 12725 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:44.537581 12725 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:44.546763 12725 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:44.547452 12725 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:44.548655 12725 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:44.552629 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:44.552642 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:44.579143 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:44.579171 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:44.608447 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:44.608472 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:44.634421 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:44.634447 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:44.669334 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:44.669362 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:44.770710 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:44.770785 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:44.815986 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:44.816016 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:44.860293 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:44.860327 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:44.936110 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:44.936144 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:47.514839 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:47.528244 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:47.528398 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:47.557240 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:47.557263 59960 cri.go:89] found id: ""
I1126 20:13:47.557271 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:47.557328 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:47.561044 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:47.561146 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:47.586866 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:47.586888 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:47.586894 59960 cri.go:89] found id: ""
I1126 20:13:47.586901 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:47.586956 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:47.591194 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:47.594829 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:47.594905 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:47.621081 59960 cri.go:89] found id: ""
I1126 20:13:47.621104 59960 logs.go:282] 0 containers: []
W1126 20:13:47.621113 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:47.621120 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:47.621182 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:47.649583 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:47.649605 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:47.649610 59960 cri.go:89] found id: ""
I1126 20:13:47.649618 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:47.649673 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:47.655090 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:47.659029 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:47.659096 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:47.685101 59960 cri.go:89] found id: ""
I1126 20:13:47.685125 59960 logs.go:282] 0 containers: []
W1126 20:13:47.685134 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:47.685141 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:47.685198 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:47.712581 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:47.712603 59960 cri.go:89] found id: ""
I1126 20:13:47.712612 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:47.712673 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:47.716384 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:47.716461 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:47.746287 59960 cri.go:89] found id: ""
I1126 20:13:47.746321 59960 logs.go:282] 0 containers: []
W1126 20:13:47.746330 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:47.746357 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:47.746375 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:47.776577 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:47.776607 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:47.810845 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:47.810874 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:47.851317 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:47.851350 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:47.897021 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:47.897054 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:47.925761 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:47.925792 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:47.953836 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:47.953863 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:48.054533 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:48.054569 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:48.074474 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:48.074505 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:48.148938 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:48.137331 12917 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:48.137950 12917 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:48.139682 12917 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:48.140242 12917 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:48.143726 12917 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:48.137331 12917 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:48.137950 12917 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:48.139682 12917 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:48.140242 12917 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:48.143726 12917 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:48.148963 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:48.148977 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:48.231199 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:48.231234 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:50.823233 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:50.833805 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:50.833878 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:50.862309 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:50.862333 59960 cri.go:89] found id: ""
I1126 20:13:50.862342 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:50.862396 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:50.865957 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:50.866034 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:50.892542 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:50.892565 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:50.892571 59960 cri.go:89] found id: ""
I1126 20:13:50.892578 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:50.892632 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:50.896328 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:50.899831 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:50.899905 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:50.931031 59960 cri.go:89] found id: ""
I1126 20:13:50.931098 59960 logs.go:282] 0 containers: []
W1126 20:13:50.931112 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:50.931119 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:50.931176 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:50.958547 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:50.958580 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:50.958586 59960 cri.go:89] found id: ""
I1126 20:13:50.958594 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:50.958649 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:50.962711 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:50.966380 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:50.966453 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:50.998188 59960 cri.go:89] found id: ""
I1126 20:13:50.998483 59960 logs.go:282] 0 containers: []
W1126 20:13:50.998498 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:50.998505 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:50.998592 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:51.031422 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:51.031447 59960 cri.go:89] found id: ""
I1126 20:13:51.031462 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:51.031519 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:51.035715 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:51.035788 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:51.077429 59960 cri.go:89] found id: ""
I1126 20:13:51.077452 59960 logs.go:282] 0 containers: []
W1126 20:13:51.077460 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:51.077469 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:51.077481 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:51.105578 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:51.105609 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:51.188473 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:51.188518 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:51.220853 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:51.220886 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:51.304811 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:51.304848 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:51.337094 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:51.337162 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:51.434145 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:51.434183 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:51.474781 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:51.474815 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:51.523360 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:51.523390 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:51.556210 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:51.556238 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:51.568960 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:51.568989 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:51.646125 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:51.637986 13063 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:51.638634 13063 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:51.640319 13063 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:51.640884 13063 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:51.642607 13063 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:51.637986 13063 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:51.638634 13063 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:51.640319 13063 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:51.640884 13063 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:51.642607 13063 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:54.147140 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:54.159570 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:54.159641 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:54.190129 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:54.190150 59960 cri.go:89] found id: ""
I1126 20:13:54.190158 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:54.190221 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:54.193723 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:54.193795 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:54.221859 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:54.221881 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:54.221886 59960 cri.go:89] found id: ""
I1126 20:13:54.221893 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:54.221986 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:54.225619 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:54.229615 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:54.229686 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:54.257427 59960 cri.go:89] found id: ""
I1126 20:13:54.257454 59960 logs.go:282] 0 containers: []
W1126 20:13:54.257464 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:54.257470 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:54.257528 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:54.283499 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:54.283522 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:54.283528 59960 cri.go:89] found id: ""
I1126 20:13:54.283535 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:54.283591 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:54.287279 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:54.291072 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:54.291164 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:54.320377 59960 cri.go:89] found id: ""
I1126 20:13:54.320409 59960 logs.go:282] 0 containers: []
W1126 20:13:54.320418 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:54.320424 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:54.320490 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:54.346357 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:54.346388 59960 cri.go:89] found id: ""
I1126 20:13:54.346397 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:54.346453 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:54.350217 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:54.350337 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:54.387000 59960 cri.go:89] found id: ""
I1126 20:13:54.387033 59960 logs.go:282] 0 containers: []
W1126 20:13:54.387042 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:54.387052 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:54.387064 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:54.398981 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:54.399006 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:54.424733 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:54.424761 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:54.464124 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:54.464199 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:54.516097 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:54.516149 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:54.597621 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:54.597656 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:54.626882 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:54.626916 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:54.706226 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:54.706262 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:54.777575 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:54.768229 13177 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:54.769042 13177 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:54.770705 13177 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:54.771452 13177 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:54.773075 13177 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:54.768229 13177 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:54.769042 13177 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:54.770705 13177 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:54.771452 13177 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:54.773075 13177 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:54.777599 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:54.777612 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:54.808526 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:54.808556 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:54.839385 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:54.839412 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:57.435357 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:13:57.446250 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:13:57.446321 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:13:57.476511 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:57.476531 59960 cri.go:89] found id: ""
I1126 20:13:57.476539 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:13:57.476595 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:57.480521 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:13:57.480599 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:13:57.508216 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:13:57.508239 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:57.508244 59960 cri.go:89] found id: ""
I1126 20:13:57.508251 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:13:57.508312 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:57.512264 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:57.515930 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:13:57.516007 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:13:57.546712 59960 cri.go:89] found id: ""
I1126 20:13:57.546737 59960 logs.go:282] 0 containers: []
W1126 20:13:57.546746 59960 logs.go:284] No container was found matching "coredns"
I1126 20:13:57.546753 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:13:57.546811 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:13:57.575286 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:57.575308 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:57.575314 59960 cri.go:89] found id: ""
I1126 20:13:57.575321 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:13:57.575403 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:57.579177 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:57.582844 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:13:57.582947 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:13:57.610240 59960 cri.go:89] found id: ""
I1126 20:13:57.610268 59960 logs.go:282] 0 containers: []
W1126 20:13:57.610276 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:13:57.610282 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:13:57.610366 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:13:57.637690 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:57.637715 59960 cri.go:89] found id: ""
I1126 20:13:57.637722 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:13:57.637804 59960 ssh_runner.go:195] Run: which crictl
I1126 20:13:57.641691 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:13:57.641816 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:13:57.673478 59960 cri.go:89] found id: ""
I1126 20:13:57.673512 59960 logs.go:282] 0 containers: []
W1126 20:13:57.673521 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:13:57.673546 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:13:57.673565 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:13:57.724644 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:13:57.724677 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:13:57.801587 59960 logs.go:123] Gathering logs for container status ...
I1126 20:13:57.801622 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:13:57.846990 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:13:57.847020 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:13:57.948301 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:13:57.948336 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:13:57.960477 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:13:57.960510 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:13:58.036195 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:13:58.028003 13301 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:58.028530 13301 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:58.030166 13301 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:58.030875 13301 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:58.032666 13301 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:13:58.028003 13301 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:58.028530 13301 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:58.030166 13301 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:58.030875 13301 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:13:58.032666 13301 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:13:58.036262 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:13:58.036289 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:13:58.071247 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:13:58.071284 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:13:58.102552 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:13:58.102582 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:13:58.131358 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:13:58.131450 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:13:58.207844 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:13:58.207883 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:14:00.754664 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:14:00.765702 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:14:00.765771 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:14:00.806554 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:14:00.806579 59960 cri.go:89] found id: ""
I1126 20:14:00.806587 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:14:00.806641 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:00.810501 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:14:00.810586 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:14:00.838112 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:14:00.838139 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:14:00.838144 59960 cri.go:89] found id: ""
I1126 20:14:00.838152 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:14:00.838207 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:00.842001 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:00.845613 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:14:00.845684 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:14:00.874701 59960 cri.go:89] found id: ""
I1126 20:14:00.874726 59960 logs.go:282] 0 containers: []
W1126 20:14:00.874735 59960 logs.go:284] No container was found matching "coredns"
I1126 20:14:00.874742 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:14:00.874821 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:14:00.903003 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:14:00.903027 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:14:00.903032 59960 cri.go:89] found id: ""
I1126 20:14:00.903039 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:14:00.903097 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:00.907398 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:00.911095 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:14:00.911169 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:14:00.937717 59960 cri.go:89] found id: ""
I1126 20:14:00.937741 59960 logs.go:282] 0 containers: []
W1126 20:14:00.937750 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:14:00.937757 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:14:00.937815 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:14:00.964659 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:14:00.964683 59960 cri.go:89] found id: ""
I1126 20:14:00.964692 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:14:00.964761 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:00.969052 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:14:00.969128 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:14:00.996896 59960 cri.go:89] found id: ""
I1126 20:14:00.996921 59960 logs.go:282] 0 containers: []
W1126 20:14:00.996930 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:14:00.996940 59960 logs.go:123] Gathering logs for container status ...
I1126 20:14:00.996968 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:14:01.052982 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:14:01.053013 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:14:01.164358 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:14:01.164396 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:14:01.245847 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:14:01.237260 13418 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:01.238200 13418 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:01.239244 13418 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:01.240970 13418 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:01.241435 13418 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:14:01.237260 13418 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:01.238200 13418 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:01.239244 13418 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:01.240970 13418 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:01.241435 13418 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:14:01.245874 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:14:01.245888 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:14:01.278036 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:14:01.278066 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:14:01.321761 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:14:01.321798 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:14:01.349850 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:14:01.349877 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:14:01.362087 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:14:01.362115 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:14:01.406110 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:14:01.406143 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:14:01.488538 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:14:01.488580 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:14:01.524108 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:14:01.524314 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:14:04.107171 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:14:04.119134 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:14:04.119206 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:14:04.150892 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:14:04.150913 59960 cri.go:89] found id: ""
I1126 20:14:04.150920 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:14:04.150993 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:04.154614 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:14:04.154713 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:14:04.181842 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:14:04.181866 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:14:04.181870 59960 cri.go:89] found id: ""
I1126 20:14:04.181878 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:14:04.181958 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:04.185706 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:04.189884 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:14:04.190033 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:14:04.217117 59960 cri.go:89] found id: ""
I1126 20:14:04.217143 59960 logs.go:282] 0 containers: []
W1126 20:14:04.217152 59960 logs.go:284] No container was found matching "coredns"
I1126 20:14:04.217159 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:14:04.217218 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:14:04.244873 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:14:04.244893 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:14:04.244897 59960 cri.go:89] found id: ""
I1126 20:14:04.244904 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:14:04.244962 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:04.248633 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:04.252113 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:14:04.252223 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:14:04.281381 59960 cri.go:89] found id: ""
I1126 20:14:04.281410 59960 logs.go:282] 0 containers: []
W1126 20:14:04.281420 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:14:04.281426 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:14:04.281484 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:14:04.309793 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:14:04.309817 59960 cri.go:89] found id: ""
I1126 20:14:04.309825 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:14:04.309881 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:04.313555 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:14:04.313625 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:14:04.341073 59960 cri.go:89] found id: ""
I1126 20:14:04.341100 59960 logs.go:282] 0 containers: []
W1126 20:14:04.341109 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:14:04.341117 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:14:04.341129 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:14:04.436704 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:14:04.436741 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:14:04.511848 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:14:04.500099 13544 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:04.500700 13544 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:04.506376 13544 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:04.506925 13544 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:04.508357 13544 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:14:04.500099 13544 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:04.500700 13544 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:04.506376 13544 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:04.506925 13544 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:04.508357 13544 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:14:04.511872 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:14:04.511887 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:14:04.572587 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:14:04.572662 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:14:04.622150 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:14:04.622182 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:14:04.648129 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:14:04.648200 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:14:04.736436 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:14:04.736472 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:14:04.748750 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:14:04.748783 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:14:04.784731 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:14:04.784756 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:14:04.861032 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:14:04.861067 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:14:04.888273 59960 logs.go:123] Gathering logs for container status ...
I1126 20:14:04.888306 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:14:07.422077 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:14:07.432698 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:14:07.432776 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:14:07.463525 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:14:07.463545 59960 cri.go:89] found id: ""
I1126 20:14:07.463553 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:14:07.463605 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:07.467175 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:14:07.467243 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:14:07.497801 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:14:07.497821 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:14:07.497826 59960 cri.go:89] found id: ""
I1126 20:14:07.497833 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:14:07.497888 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:07.501759 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:07.505120 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:14:07.505198 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:14:07.539084 59960 cri.go:89] found id: ""
I1126 20:14:07.539112 59960 logs.go:282] 0 containers: []
W1126 20:14:07.539121 59960 logs.go:284] No container was found matching "coredns"
I1126 20:14:07.539127 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:14:07.539189 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:14:07.567688 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:14:07.567713 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:14:07.567720 59960 cri.go:89] found id: ""
I1126 20:14:07.567727 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:14:07.567788 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:07.571445 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:07.575895 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:14:07.575973 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:14:07.603679 59960 cri.go:89] found id: ""
I1126 20:14:07.603704 59960 logs.go:282] 0 containers: []
W1126 20:14:07.603713 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:14:07.603720 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:14:07.603801 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:14:07.633845 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:14:07.633869 59960 cri.go:89] found id: ""
I1126 20:14:07.633877 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:14:07.633982 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:07.638439 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:14:07.638510 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:14:07.669305 59960 cri.go:89] found id: ""
I1126 20:14:07.669329 59960 logs.go:282] 0 containers: []
W1126 20:14:07.669338 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:14:07.669348 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:14:07.669361 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:14:07.746001 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:14:07.746039 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:14:07.773829 59960 logs.go:123] Gathering logs for container status ...
I1126 20:14:07.773859 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:14:07.806673 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:14:07.806705 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:14:07.847992 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:14:07.848029 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:14:07.876479 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:14:07.876507 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:14:07.952982 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:14:07.953018 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:14:08.054195 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:14:08.054235 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:14:08.071790 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:14:08.071819 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:14:08.158168 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:14:08.148798 13732 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:08.150262 13732 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:08.151831 13732 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:08.152401 13732 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:08.154098 13732 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:14:08.148798 13732 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:08.150262 13732 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:08.151831 13732 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:08.152401 13732 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:08.154098 13732 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:14:08.158237 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:14:08.158266 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:14:08.185227 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:14:08.185257 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:14:10.730401 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:14:10.741460 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:14:10.741529 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:14:10.774241 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:14:10.774263 59960 cri.go:89] found id: ""
I1126 20:14:10.774270 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:14:10.774327 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:10.778033 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:14:10.778103 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:14:10.806991 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:14:10.807015 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:14:10.807021 59960 cri.go:89] found id: ""
I1126 20:14:10.807028 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:14:10.807083 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:10.810846 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:10.814441 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:14:10.814513 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:14:10.843200 59960 cri.go:89] found id: ""
I1126 20:14:10.843226 59960 logs.go:282] 0 containers: []
W1126 20:14:10.843236 59960 logs.go:284] No container was found matching "coredns"
I1126 20:14:10.843242 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:14:10.843301 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:14:10.871039 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:14:10.871062 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:14:10.871068 59960 cri.go:89] found id: ""
I1126 20:14:10.871075 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:14:10.871129 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:10.874747 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:10.878577 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:14:10.878661 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:14:10.907317 59960 cri.go:89] found id: ""
I1126 20:14:10.907343 59960 logs.go:282] 0 containers: []
W1126 20:14:10.907352 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:14:10.907359 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:14:10.907414 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:14:10.936274 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:14:10.936297 59960 cri.go:89] found id: ""
I1126 20:14:10.936306 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:14:10.936385 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:10.939976 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:14:10.940048 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:14:10.969776 59960 cri.go:89] found id: ""
I1126 20:14:10.969848 59960 logs.go:282] 0 containers: []
W1126 20:14:10.969884 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:14:10.969911 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:14:10.969997 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:14:11.067923 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:14:11.067964 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:14:11.082749 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:14:11.082781 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:14:11.124244 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:14:11.124281 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:14:11.173196 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:14:11.173232 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:14:11.200233 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:14:11.200268 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:14:11.284292 59960 logs.go:123] Gathering logs for container status ...
I1126 20:14:11.284327 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:14:11.317517 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:14:11.317545 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:14:11.395020 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:14:11.386165 13861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:11.387087 13861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:11.388651 13861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:11.388979 13861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:11.390832 13861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:14:11.386165 13861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:11.387087 13861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:11.388651 13861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:11.388979 13861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:11.390832 13861 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:14:11.395043 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:14:11.395056 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:14:11.422025 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:14:11.422059 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:14:11.500554 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:14:11.500588 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:14:14.028990 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:14:14.043196 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}
I1126 20:14:14.043275 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver
I1126 20:14:14.078393 59960 cri.go:89] found id: "11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:14:14.078418 59960 cri.go:89] found id: ""
I1126 20:14:14.078426 59960 logs.go:282] 1 containers: [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb]
I1126 20:14:14.078485 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:14.082581 59960 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}
I1126 20:14:14.082679 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd
I1126 20:14:14.113586 59960 cri.go:89] found id: "217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:14:14.113611 59960 cri.go:89] found id: "cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:14:14.113616 59960 cri.go:89] found id: ""
I1126 20:14:14.113623 59960 logs.go:282] 2 containers: [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5]
I1126 20:14:14.113677 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:14.117367 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:14.120847 59960 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}
I1126 20:14:14.120921 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns
I1126 20:14:14.147191 59960 cri.go:89] found id: ""
I1126 20:14:14.147214 59960 logs.go:282] 0 containers: []
W1126 20:14:14.147222 59960 logs.go:284] No container was found matching "coredns"
I1126 20:14:14.147229 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}
I1126 20:14:14.147287 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler
I1126 20:14:14.173461 59960 cri.go:89] found id: "b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:14:14.173483 59960 cri.go:89] found id: "37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:14:14.173489 59960 cri.go:89] found id: ""
I1126 20:14:14.173496 59960 logs.go:282] 2 containers: [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa]
I1126 20:14:14.173560 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:14.177359 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:14.180846 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}
I1126 20:14:14.180926 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy
I1126 20:14:14.211699 59960 cri.go:89] found id: ""
I1126 20:14:14.211731 59960 logs.go:282] 0 containers: []
W1126 20:14:14.211740 59960 logs.go:284] No container was found matching "kube-proxy"
I1126 20:14:14.211747 59960 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}
I1126 20:14:14.211815 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager
I1126 20:14:14.245320 59960 cri.go:89] found id: "8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:14:14.245343 59960 cri.go:89] found id: ""
I1126 20:14:14.245352 59960 logs.go:282] 1 containers: [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529]
I1126 20:14:14.245422 59960 ssh_runner.go:195] Run: which crictl
I1126 20:14:14.249066 59960 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}
I1126 20:14:14.249133 59960 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet
I1126 20:14:14.277385 59960 cri.go:89] found id: ""
I1126 20:14:14.277407 59960 logs.go:282] 0 containers: []
W1126 20:14:14.277415 59960 logs.go:284] No container was found matching "kindnet"
I1126 20:14:14.277424 59960 logs.go:123] Gathering logs for dmesg ...
I1126 20:14:14.277436 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"
I1126 20:14:14.289839 59960 logs.go:123] Gathering logs for describe nodes ...
I1126 20:14:14.289866 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"
W1126 20:14:14.361142 59960 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.1/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
stdout:
stderr:
E1126 20:14:14.352896 13960 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:14.353542 13960 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:14.355081 13960 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:14.355655 13960 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:14.357173 13960 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
output:
** stderr **
E1126 20:14:14.352896 13960 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:14.353542 13960 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:14.355081 13960 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:14.355655 13960 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
E1126 20:14:14.357173 13960 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://localhost:8443/api?timeout=32s\": dial tcp [::1]:8443: connect: connection refused"
The connection to the server localhost:8443 was refused - did you specify the right host or port?
** /stderr **
I1126 20:14:14.361165 59960 logs.go:123] Gathering logs for etcd [217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46] ...
I1126 20:14:14.361179 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 217f78028ea5b55a340a7295a694be6b7d2e91348860b3cf0757cbdb412d3a46"
I1126 20:14:14.419666 59960 logs.go:123] Gathering logs for etcd [cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5] ...
I1126 20:14:14.419762 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 cff5f7e1c320f7a9af634d2d2805f659484d8e18bfb07991086e6e2c809a8bd5"
I1126 20:14:14.468633 59960 logs.go:123] Gathering logs for kube-scheduler [b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1] ...
I1126 20:14:14.468667 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 b205532732084e6fcf6d1990ed8217297cd7f85a7827315dd5604d36164b03a1"
I1126 20:14:14.557664 59960 logs.go:123] Gathering logs for kube-apiserver [11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb] ...
I1126 20:14:14.557696 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 11026e7694e916598880b5c1784266b37a37f90c4f5d421a66f873249442f8bb"
I1126 20:14:14.583538 59960 logs.go:123] Gathering logs for kube-scheduler [37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa] ...
I1126 20:14:14.583567 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 37530bc45e0390fa882b999b2bbdffaef014fd68485194633fdf1722180fb2fa"
I1126 20:14:14.612806 59960 logs.go:123] Gathering logs for kube-controller-manager [8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529] ...
I1126 20:14:14.612834 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/local/bin/crictl logs --tail 400 8d8f6896e7e1335f939a13393503138ccebf919b758ad0984c41e1cb0e9ae529"
I1126 20:14:14.638272 59960 logs.go:123] Gathering logs for CRI-O ...
I1126 20:14:14.638300 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"
I1126 20:14:14.721230 59960 logs.go:123] Gathering logs for container status ...
I1126 20:14:14.721268 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"
I1126 20:14:14.755109 59960 logs.go:123] Gathering logs for kubelet ...
I1126 20:14:14.755142 59960 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"
I1126 20:14:17.358125 59960 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1126 20:14:17.371898 59960 out.go:203]
W1126 20:14:17.375212 59960 out.go:285] X Exiting due to K8S_APISERVER_MISSING: adding node: wait 6m0s for node: wait for apiserver proc: apiserver process never appeared
W1126 20:14:17.375248 59960 out.go:285] * Suggestion: Check that the provided apiserver flags are valid, and that SELinux is disabled
W1126 20:14:17.375258 59960 out.go:285] * Related issues:
W1126 20:14:17.375279 59960 out.go:285] - https://github.com/kubernetes/minikube/issues/4536
W1126 20:14:17.375299 59960 out.go:285] - https://github.com/kubernetes/minikube/issues/6014
I1126 20:14:17.378409 59960 out.go:203]
==> CRI-O <==
Nov 26 20:07:27 ha-278127 crio[667]: time="2025-11-26T20:07:27.974719211Z" level=info msg="Started container" PID=1450 containerID=0e221d151c3ca52563688e2194b1c01d8b4614a29869607958f68b96125603ee description=kube-system/kube-controller-manager-ha-278127/kube-controller-manager id=87dec93c-7b21-4bf6-943c-261f225c113f name=/runtime.v1.RuntimeService/StartContainer sandboxID=aaf24b4012ae22573565b29a9c87fa6c77cadf206a779d5e6c1de76d289f128f
Nov 26 20:07:28 ha-278127 crio[667]: time="2025-11-26T20:07:28.929319714Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=ec2c398f-23e5-463c-bbb1-09030f312307 name=/runtime.v1.ImageService/ImageStatus
Nov 26 20:07:28 ha-278127 crio[667]: time="2025-11-26T20:07:28.930440903Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=8fc66d00-8c37-4d25-84c6-7d7ac1c54ce3 name=/runtime.v1.ImageService/ImageStatus
Nov 26 20:07:28 ha-278127 crio[667]: time="2025-11-26T20:07:28.932121756Z" level=info msg="Creating container: kube-system/storage-provisioner/storage-provisioner" id=5c15308b-e98f-4109-8cbc-9192ac697f01 name=/runtime.v1.RuntimeService/CreateContainer
Nov 26 20:07:28 ha-278127 crio[667]: time="2025-11-26T20:07:28.932226698Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 26 20:07:28 ha-278127 crio[667]: time="2025-11-26T20:07:28.940571173Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 26 20:07:28 ha-278127 crio[667]: time="2025-11-26T20:07:28.940960238Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/8f34edad928de60e13d64480bf036aa1cf6b11ecfb7c751ef02ef81267e506bc/merged/etc/passwd: no such file or directory"
Nov 26 20:07:28 ha-278127 crio[667]: time="2025-11-26T20:07:28.941066542Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/8f34edad928de60e13d64480bf036aa1cf6b11ecfb7c751ef02ef81267e506bc/merged/etc/group: no such file or directory"
Nov 26 20:07:28 ha-278127 crio[667]: time="2025-11-26T20:07:28.941381721Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 26 20:07:28 ha-278127 crio[667]: time="2025-11-26T20:07:28.959928416Z" level=info msg="Created container 1de9ee4cdf6523ba82be553073f7f95b567b3080cf0b35a8910ac6dcf51abbd5: kube-system/storage-provisioner/storage-provisioner" id=5c15308b-e98f-4109-8cbc-9192ac697f01 name=/runtime.v1.RuntimeService/CreateContainer
Nov 26 20:07:28 ha-278127 crio[667]: time="2025-11-26T20:07:28.960936581Z" level=info msg="Starting container: 1de9ee4cdf6523ba82be553073f7f95b567b3080cf0b35a8910ac6dcf51abbd5" id=51eb399f-be44-48a0-a1b4-1c62267c418c name=/runtime.v1.RuntimeService/StartContainer
Nov 26 20:07:28 ha-278127 crio[667]: time="2025-11-26T20:07:28.967526563Z" level=info msg="Started container" PID=1462 containerID=1de9ee4cdf6523ba82be553073f7f95b567b3080cf0b35a8910ac6dcf51abbd5 description=kube-system/storage-provisioner/storage-provisioner id=51eb399f-be44-48a0-a1b4-1c62267c418c name=/runtime.v1.RuntimeService/StartContainer sandboxID=21dd814126bdbbb8dab349806b778ddb306dc5100a35c1bd2fe40c8004bcd523
Nov 26 20:07:44 ha-278127 conmon[1447]: conmon 0e221d151c3ca5256368 <ninfo>: container 1450 exited with status 1
Nov 26 20:07:45 ha-278127 crio[667]: time="2025-11-26T20:07:45.240819859Z" level=info msg="Removing container: c5680f84cd871450e3f95050160c6bc383cefc96eca8fe13ef831453bb2fe8a9" id=6f335103-7e48-492e-b33a-d6d488e111fb name=/runtime.v1.RuntimeService/RemoveContainer
Nov 26 20:07:45 ha-278127 crio[667]: time="2025-11-26T20:07:45.256615675Z" level=info msg="Error loading conmon cgroup of container c5680f84cd871450e3f95050160c6bc383cefc96eca8fe13ef831453bb2fe8a9: cgroup deleted" id=6f335103-7e48-492e-b33a-d6d488e111fb name=/runtime.v1.RuntimeService/RemoveContainer
Nov 26 20:07:45 ha-278127 crio[667]: time="2025-11-26T20:07:45.261280075Z" level=info msg="Removed container c5680f84cd871450e3f95050160c6bc383cefc96eca8fe13ef831453bb2fe8a9: kube-system/kube-controller-manager-ha-278127/kube-controller-manager" id=6f335103-7e48-492e-b33a-d6d488e111fb name=/runtime.v1.RuntimeService/RemoveContainer
Nov 26 20:08:12 ha-278127 crio[667]: time="2025-11-26T20:08:12.929977452Z" level=info msg="Checking image status: registry.k8s.io/kube-controller-manager:v1.34.1" id=c9fc5566-53be-4e3a-ad5b-047dfe5df6f7 name=/runtime.v1.ImageService/ImageStatus
Nov 26 20:08:12 ha-278127 crio[667]: time="2025-11-26T20:08:12.931894512Z" level=info msg="Checking image status: registry.k8s.io/kube-controller-manager:v1.34.1" id=c6b73409-e91d-4450-8804-870ca6e0b63d name=/runtime.v1.ImageService/ImageStatus
Nov 26 20:08:12 ha-278127 crio[667]: time="2025-11-26T20:08:12.933188155Z" level=info msg="Creating container: kube-system/kube-controller-manager-ha-278127/kube-controller-manager" id=b5b42e4a-b813-4466-87cd-d441eaaf849b name=/runtime.v1.RuntimeService/CreateContainer
Nov 26 20:08:12 ha-278127 crio[667]: time="2025-11-26T20:08:12.933308096Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 26 20:08:12 ha-278127 crio[667]: time="2025-11-26T20:08:12.94134128Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 26 20:08:12 ha-278127 crio[667]: time="2025-11-26T20:08:12.942037763Z" level=info msg="Allowed annotations are specified for workload [io.containers.trace-syscall]"
Nov 26 20:08:12 ha-278127 crio[667]: time="2025-11-26T20:08:12.965749324Z" level=info msg="Created container b3d2b3bea3b9f0d42f5ec9c992ad87cad16307afa6489e152b85bea61806ecca: kube-system/kube-controller-manager-ha-278127/kube-controller-manager" id=b5b42e4a-b813-4466-87cd-d441eaaf849b name=/runtime.v1.RuntimeService/CreateContainer
Nov 26 20:08:12 ha-278127 crio[667]: time="2025-11-26T20:08:12.966758303Z" level=info msg="Starting container: b3d2b3bea3b9f0d42f5ec9c992ad87cad16307afa6489e152b85bea61806ecca" id=d8573d49-5a20-4657-b169-a7727449cf6d name=/runtime.v1.RuntimeService/StartContainer
Nov 26 20:08:12 ha-278127 crio[667]: time="2025-11-26T20:08:12.975098568Z" level=info msg="Started container" PID=1498 containerID=b3d2b3bea3b9f0d42f5ec9c992ad87cad16307afa6489e152b85bea61806ecca description=kube-system/kube-controller-manager-ha-278127/kube-controller-manager id=d8573d49-5a20-4657-b169-a7727449cf6d name=/runtime.v1.RuntimeService/StartContainer sandboxID=aaf24b4012ae22573565b29a9c87fa6c77cadf206a779d5e6c1de76d289f128f
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD NAMESPACE
b3d2b3bea3b9f 7eb2c6ff0c5a768fd309321bc2ade0e4e11afcf4f2017ef1d0ff00d91fdf992a 6 minutes ago Running kube-controller-manager 6 aaf24b4012ae2 kube-controller-manager-ha-278127 kube-system
1de9ee4cdf652 ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6 6 minutes ago Running storage-provisioner 5 21dd814126bdb storage-provisioner kube-system
0e221d151c3ca 7eb2c6ff0c5a768fd309321bc2ade0e4e11afcf4f2017ef1d0ff00d91fdf992a 6 minutes ago Exited kube-controller-manager 5 aaf24b4012ae2 kube-controller-manager-ha-278127 kube-system
1a9b5dae15334 ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6 7 minutes ago Exited storage-provisioner 4 21dd814126bdb storage-provisioner kube-system
1622dad7c067a 369db9dfa6fa96c1f4a0f3c827dbe864b5ded1802c8b4810b5ff9fcc5f5f2c70 7 minutes ago Running kube-vip 3 d4cb99de55854 kube-vip-ha-278127 kube-system
822876229de0f 138784d87c9c50f8e59412544da4cf4928d61ccbaf93b9f5898a3ba406871bfc 7 minutes ago Running coredns 2 dfdbe4360041c coredns-66bc5c9577-ndh8k kube-system
aef907239d286 89a35e2ebb6b938201966889b5e8c85b931db6432c5643966116cd1c28bf45cd 7 minutes ago Running busybox 2 78d3fb27335b4 busybox-7b57f96db7-vwpd8 default
787754735cfed 138784d87c9c50f8e59412544da4cf4928d61ccbaf93b9f5898a3ba406871bfc 7 minutes ago Running coredns 2 89e2c226e09e6 coredns-66bc5c9577-bbpk7 kube-system
d140d1950675e b1a8c6f707935fd5f346ce5846d21ff8dd65e14c15406a14dbd16b9b897b9b4c 7 minutes ago Running kindnet-cni 2 b9a376ab09c3c kindnet-gp24m kube-system
7b45294efb449 05baa95f5142d87797a2bc1d3d11edfb0bf0a9236d436243d15061fae8b58cb9 7 minutes ago Running kube-proxy 2 55fa9dab05c0d kube-proxy-5fndw kube-system
f5647f1652cc1 43911e833d64d4f30460862fc0c54bb61999d60bc7d063feca71e9fc610d5196 7 minutes ago Running kube-apiserver 3 c932fd4498a66 kube-apiserver-ha-278127 kube-system
040a854900180 b5f57ec6b98676d815366685a0422bd164ecf0732540b79ac51b1186cef97ff0 7 minutes ago Running kube-scheduler 2 773a6356cec93 kube-scheduler-ha-278127 kube-system
106da3c0ad4fa 369db9dfa6fa96c1f4a0f3c827dbe864b5ded1802c8b4810b5ff9fcc5f5f2c70 7 minutes ago Exited kube-vip 2 d4cb99de55854 kube-vip-ha-278127 kube-system
cdc1651fea8f1 a1894772a478e07c67a56e8bf32335fdbe1dd4ec96976a5987083164bd00bc0e 7 minutes ago Running etcd 2 11d5891e684b3 etcd-ha-278127 kube-system
==> coredns [787754735cfed2e99ff1e0336a870da9b5e17eaed8d9d79b97dbfa75dd83059c] <==
[INFO] plugin/reload: Running configuration SHA512 = 9e2996f8cb67ac53e0259ab1f8d615d07d1beb0bd07e6a1e39769c3bf486a905bb991cc47f8d2f14d0d3a90a87dfc625a0b4c524fed169d8158c40657c0694b1
CoreDNS-1.12.1
linux/arm64, go1.24.1, 707c7c1
[INFO] 127.0.0.1:45898 - 29384 "HINFO IN 3170256484025904488.3791759156995599050. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.014293297s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
==> coredns [822876229de0f6cb25db3449774153712b72a0c129090a61a1aeadc760c6cad4] <==
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
.:53
[INFO] plugin/reload: Running configuration SHA512 = 9e2996f8cb67ac53e0259ab1f8d615d07d1beb0bd07e6a1e39769c3bf486a905bb991cc47f8d2f14d0d3a90a87dfc625a0b4c524fed169d8158c40657c0694b1
CoreDNS-1.12.1
linux/arm64, go1.24.1, 707c7c1
[INFO] 127.0.0.1:53615 - 2115 "HINFO IN 6991506871979899616.8642824612935885209. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.017055518s
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/ready: Still waiting on: "kubernetes"
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: Unhandled Error
[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
[ERROR] plugin/kubernetes: Unhandled Error
==> describe nodes <==
Name: ha-278127
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=ha-278127
kubernetes.io/os=linux
minikube.k8s.io/commit=1f9f533a52cbc43a7fc74d1e77b7e9da93c5d970
minikube.k8s.io/name=ha-278127
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2025_11_26T19_58_19_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 26 Nov 2025 19:58:13 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: ha-278127
AcquireTime: <unset>
RenewTime: Wed, 26 Nov 2025 20:14:22 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Wed, 26 Nov 2025 20:13:01 +0000 Wed, 26 Nov 2025 19:58:09 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Wed, 26 Nov 2025 20:13:01 +0000 Wed, 26 Nov 2025 19:58:09 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Wed, 26 Nov 2025 20:13:01 +0000 Wed, 26 Nov 2025 19:58:09 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Wed, 26 Nov 2025 20:13:01 +0000 Wed, 26 Nov 2025 19:59:02 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: ha-278127
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
System Info:
Machine ID: cd56ca808394105f594af1d1692718f7
System UUID: 370e19a1-8269-418f-82ce-e7791d2f9cc5
Boot ID: 486ac1e4-7398-4de0-aac9-858aafe3bfc5
Kernel Version: 5.15.0-1084-aws
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: arm64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-7b57f96db7-vwpd8 0 (0%) 0 (0%) 0 (0%) 0 (0%) 13m
kube-system coredns-66bc5c9577-bbpk7 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 16m
kube-system coredns-66bc5c9577-ndh8k 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 16m
kube-system etcd-ha-278127 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 16m
kube-system kindnet-gp24m 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 16m
kube-system kube-apiserver-ha-278127 250m (12%) 0 (0%) 0 (0%) 0 (0%) 16m
kube-system kube-controller-manager-ha-278127 200m (10%) 0 (0%) 0 (0%) 0 (0%) 16m
kube-system kube-proxy-5fndw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 16m
kube-system kube-scheduler-ha-278127 100m (5%) 0 (0%) 0 (0%) 0 (0%) 16m
kube-system kube-vip-ha-278127 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9m40s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 16m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%) 100m (5%)
memory 290Mi (3%) 390Mi (4%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 7m44s kube-proxy
Normal Starting 9m36s kube-proxy
Normal Starting 16m kube-proxy
Normal NodeHasSufficientMemory 16m (x8 over 16m) kubelet Node ha-278127 status is now: NodeHasSufficientMemory
Normal NodeHasSufficientPID 16m (x8 over 16m) kubelet Node ha-278127 status is now: NodeHasSufficientPID
Normal NodeHasNoDiskPressure 16m (x8 over 16m) kubelet Node ha-278127 status is now: NodeHasNoDiskPressure
Normal Starting 16m kubelet Starting kubelet.
Warning CgroupV1 16m kubelet cgroup v1 support is in maintenance mode, please migrate to cgroup v2
Warning CgroupV1 16m kubelet cgroup v1 support is in maintenance mode, please migrate to cgroup v2
Normal Starting 16m kubelet Starting kubelet.
Normal NodeHasNoDiskPressure 16m kubelet Node ha-278127 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientMemory 16m kubelet Node ha-278127 status is now: NodeHasSufficientMemory
Normal NodeHasSufficientPID 16m kubelet Node ha-278127 status is now: NodeHasSufficientPID
Normal RegisteredNode 16m node-controller Node ha-278127 event: Registered Node ha-278127 in Controller
Normal RegisteredNode 15m node-controller Node ha-278127 event: Registered Node ha-278127 in Controller
Normal NodeReady 15m kubelet Node ha-278127 status is now: NodeReady
Normal RegisteredNode 14m node-controller Node ha-278127 event: Registered Node ha-278127 in Controller
Normal RegisteredNode 10m node-controller Node ha-278127 event: Registered Node ha-278127 in Controller
Warning CgroupV1 10m kubelet cgroup v1 support is in maintenance mode, please migrate to cgroup v2
Normal NodeHasSufficientPID 10m (x8 over 10m) kubelet Node ha-278127 status is now: NodeHasSufficientPID
Normal Starting 10m kubelet Starting kubelet.
Normal NodeHasSufficientMemory 10m (x8 over 10m) kubelet Node ha-278127 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 10m (x8 over 10m) kubelet Node ha-278127 status is now: NodeHasNoDiskPressure
Normal RegisteredNode 9m33s node-controller Node ha-278127 event: Registered Node ha-278127 in Controller
Normal RegisteredNode 9m32s node-controller Node ha-278127 event: Registered Node ha-278127 in Controller
Normal RegisteredNode 9m2s node-controller Node ha-278127 event: Registered Node ha-278127 in Controller
Normal Starting 7m55s kubelet Starting kubelet.
Warning CgroupV1 7m55s kubelet cgroup v1 support is in maintenance mode, please migrate to cgroup v2
Normal NodeHasSufficientMemory 7m54s (x8 over 7m55s) kubelet Node ha-278127 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 7m54s (x8 over 7m55s) kubelet Node ha-278127 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 7m54s (x8 over 7m55s) kubelet Node ha-278127 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m7s node-controller Node ha-278127 event: Registered Node ha-278127 in Controller
Name: ha-278127-m02
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=ha-278127-m02
kubernetes.io/os=linux
minikube.k8s.io/commit=1f9f533a52cbc43a7fc74d1e77b7e9da93c5d970
minikube.k8s.io/name=ha-278127
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2025_11_26T19_58_54_0700
minikube.k8s.io/version=v1.37.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 26 Nov 2025 19:58:53 +0000
Taints: node.kubernetes.io/unreachable:NoExecute
node.kubernetes.io/unreachable:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: ha-278127-m02
AcquireTime: <unset>
RenewTime: Wed, 26 Nov 2025 20:05:51 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure Unknown Wed, 26 Nov 2025 20:05:41 +0000 Wed, 26 Nov 2025 20:09:09 +0000 NodeStatusUnknown Kubelet stopped posting node status.
DiskPressure Unknown Wed, 26 Nov 2025 20:05:41 +0000 Wed, 26 Nov 2025 20:09:09 +0000 NodeStatusUnknown Kubelet stopped posting node status.
PIDPressure Unknown Wed, 26 Nov 2025 20:05:41 +0000 Wed, 26 Nov 2025 20:09:09 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Ready Unknown Wed, 26 Nov 2025 20:05:41 +0000 Wed, 26 Nov 2025 20:09:09 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Addresses:
InternalIP: 192.168.49.3
Hostname: ha-278127-m02
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
System Info:
Machine ID: cd56ca808394105f594af1d1692718f7
System UUID: 77d88c20-b1f3-431d-ace6-24a69c640dde
Boot ID: 486ac1e4-7398-4de0-aac9-858aafe3bfc5
Kernel Version: 5.15.0-1084-aws
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: arm64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.1.0/24
PodCIDRs: 10.244.1.0/24
Non-terminated Pods: (8 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-7b57f96db7-72bpv 0 (0%) 0 (0%) 0 (0%) 0 (0%) 13m
kube-system etcd-ha-278127-m02 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 15m
kube-system kindnet-x82cz 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 15m
kube-system kube-apiserver-ha-278127-m02 250m (12%) 0 (0%) 0 (0%) 0 (0%) 15m
kube-system kube-controller-manager-ha-278127-m02 200m (10%) 0 (0%) 0 (0%) 0 (0%) 15m
kube-system kube-proxy-p4455 0 (0%) 0 (0%) 0 (0%) 0 (0%) 15m
kube-system kube-scheduler-ha-278127-m02 100m (5%) 0 (0%) 0 (0%) 0 (0%) 15m
kube-system kube-vip-ha-278127-m02 0 (0%) 0 (0%) 0 (0%) 0 (0%) 15m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (37%) 100m (5%)
memory 150Mi (1%) 50Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 15m kube-proxy
Normal Starting 9m17s kube-proxy
Normal Starting 10m kube-proxy
Normal RegisteredNode 15m node-controller Node ha-278127-m02 event: Registered Node ha-278127-m02 in Controller
Normal RegisteredNode 15m node-controller Node ha-278127-m02 event: Registered Node ha-278127-m02 in Controller
Normal RegisteredNode 14m node-controller Node ha-278127-m02 event: Registered Node ha-278127-m02 in Controller
Warning CgroupV1 11m kubelet cgroup v1 support is in maintenance mode, please migrate to cgroup v2
Normal Starting 11m kubelet Starting kubelet.
Normal NodeHasSufficientPID 11m (x8 over 11m) kubelet Node ha-278127-m02 status is now: NodeHasSufficientPID
Normal NodeHasSufficientMemory 11m (x8 over 11m) kubelet Node ha-278127-m02 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 11m (x8 over 11m) kubelet Node ha-278127-m02 status is now: NodeHasNoDiskPressure
Normal NodeNotReady 11m node-controller Node ha-278127-m02 status is now: NodeNotReady
Normal RegisteredNode 10m node-controller Node ha-278127-m02 event: Registered Node ha-278127-m02 in Controller
Warning CgroupV1 10m kubelet cgroup v1 support is in maintenance mode, please migrate to cgroup v2
Normal NodeHasSufficientPID 10m (x8 over 10m) kubelet Node ha-278127-m02 status is now: NodeHasSufficientPID
Normal NodeHasNoDiskPressure 10m (x8 over 10m) kubelet Node ha-278127-m02 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientMemory 10m (x8 over 10m) kubelet Node ha-278127-m02 status is now: NodeHasSufficientMemory
Normal Starting 10m kubelet Starting kubelet.
Normal RegisteredNode 9m33s node-controller Node ha-278127-m02 event: Registered Node ha-278127-m02 in Controller
Normal RegisteredNode 9m32s node-controller Node ha-278127-m02 event: Registered Node ha-278127-m02 in Controller
Normal RegisteredNode 9m2s node-controller Node ha-278127-m02 event: Registered Node ha-278127-m02 in Controller
Normal RegisteredNode 6m7s node-controller Node ha-278127-m02 event: Registered Node ha-278127-m02 in Controller
Normal NodeNotReady 5m17s node-controller Node ha-278127-m02 status is now: NodeNotReady
Name: ha-278127-m04
Roles: <none>
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=ha-278127-m04
kubernetes.io/os=linux
minikube.k8s.io/commit=1f9f533a52cbc43a7fc74d1e77b7e9da93c5d970
minikube.k8s.io/name=ha-278127
minikube.k8s.io/primary=false
minikube.k8s.io/updated_at=2025_11_26T20_01_35_0700
minikube.k8s.io/version=v1.37.0
Annotations: node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Wed, 26 Nov 2025 20:01:34 +0000
Taints: node.kubernetes.io/unreachable:NoExecute
node.kubernetes.io/unreachable:NoSchedule
Unschedulable: false
Lease:
HolderIdentity: ha-278127-m04
AcquireTime: <unset>
RenewTime: Wed, 26 Nov 2025 20:05:48 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure Unknown Wed, 26 Nov 2025 20:05:38 +0000 Wed, 26 Nov 2025 20:09:09 +0000 NodeStatusUnknown Kubelet stopped posting node status.
DiskPressure Unknown Wed, 26 Nov 2025 20:05:38 +0000 Wed, 26 Nov 2025 20:09:09 +0000 NodeStatusUnknown Kubelet stopped posting node status.
PIDPressure Unknown Wed, 26 Nov 2025 20:05:38 +0000 Wed, 26 Nov 2025 20:09:09 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Ready Unknown Wed, 26 Nov 2025 20:05:38 +0000 Wed, 26 Nov 2025 20:09:09 +0000 NodeStatusUnknown Kubelet stopped posting node status.
Addresses:
InternalIP: 192.168.49.5
Hostname: ha-278127-m04
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
System Info:
Machine ID: cd56ca808394105f594af1d1692718f7
System UUID: 4949defc-dfd6-4bc6-9c78-3cb968da2b3e
Boot ID: 486ac1e4-7398-4de0-aac9-858aafe3bfc5
Kernel Version: 5.15.0-1084-aws
OS Image: Debian GNU/Linux 12 (bookworm)
Operating System: linux
Architecture: arm64
Container Runtime Version: cri-o://1.34.2
Kubelet Version: v1.34.1
Kube-Proxy Version:
PodCIDR: 10.244.3.0/24
PodCIDRs: 10.244.3.0/24
Non-terminated Pods: (3 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox-7b57f96db7-hqq6q 0 (0%) 0 (0%) 0 (0%) 0 (0%) 8m50s
kube-system kindnet-qbd6w 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 12m
kube-system kube-proxy-d4p99 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 100m (5%) 100m (5%)
memory 50Mi (0%) 50Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 8m48s kube-proxy
Normal Starting 12m kube-proxy
Warning CgroupV1 12m kubelet cgroup v1 support is in maintenance mode, please migrate to cgroup v2
Normal NodeHasSufficientPID 12m (x3 over 12m) kubelet Node ha-278127-m04 status is now: NodeHasSufficientPID
Normal NodeHasNoDiskPressure 12m (x3 over 12m) kubelet Node ha-278127-m04 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientMemory 12m (x3 over 12m) kubelet Node ha-278127-m04 status is now: NodeHasSufficientMemory
Normal Starting 12m kubelet Starting kubelet.
Normal RegisteredNode 12m node-controller Node ha-278127-m04 event: Registered Node ha-278127-m04 in Controller
Normal RegisteredNode 12m node-controller Node ha-278127-m04 event: Registered Node ha-278127-m04 in Controller
Normal RegisteredNode 12m node-controller Node ha-278127-m04 event: Registered Node ha-278127-m04 in Controller
Normal NodeReady 12m kubelet Node ha-278127-m04 status is now: NodeReady
Normal RegisteredNode 10m node-controller Node ha-278127-m04 event: Registered Node ha-278127-m04 in Controller
Normal RegisteredNode 9m33s node-controller Node ha-278127-m04 event: Registered Node ha-278127-m04 in Controller
Normal RegisteredNode 9m32s node-controller Node ha-278127-m04 event: Registered Node ha-278127-m04 in Controller
Normal Starting 9m11s kubelet Starting kubelet.
Warning CgroupV1 9m11s kubelet cgroup v1 support is in maintenance mode, please migrate to cgroup v2
Normal NodeHasSufficientMemory 9m8s (x8 over 9m11s) kubelet Node ha-278127-m04 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 9m8s (x8 over 9m11s) kubelet Node ha-278127-m04 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 9m8s (x8 over 9m11s) kubelet Node ha-278127-m04 status is now: NodeHasSufficientPID
Normal RegisteredNode 9m2s node-controller Node ha-278127-m04 event: Registered Node ha-278127-m04 in Controller
Normal RegisteredNode 6m7s node-controller Node ha-278127-m04 event: Registered Node ha-278127-m04 in Controller
Normal NodeNotReady 5m17s node-controller Node ha-278127-m04 status is now: NodeNotReady
==> dmesg <==
[Nov26 19:17] ACPI: SRAT not present
[ +0.000000] ACPI: SRAT not present
[ +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
[ +0.014220] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ +0.507172] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.032749] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
[ +0.773464] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
[ +6.697672] kauditd_printk_skb: 36 callbacks suppressed
[Nov26 19:37] overlayfs: idmapped layers are currently not supported
[ +0.074077] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
[Nov26 19:39] hrtimer: interrupt took 16123050 ns
[Nov26 19:43] overlayfs: idmapped layers are currently not supported
[Nov26 19:44] overlayfs: idmapped layers are currently not supported
[Nov26 19:58] overlayfs: idmapped layers are currently not supported
[ +33.942210] overlayfs: idmapped layers are currently not supported
[Nov26 19:59] overlayfs: idmapped layers are currently not supported
[Nov26 20:01] overlayfs: idmapped layers are currently not supported
[Nov26 20:02] overlayfs: idmapped layers are currently not supported
[Nov26 20:04] overlayfs: idmapped layers are currently not supported
[ +3.105496] overlayfs: idmapped layers are currently not supported
[ +37.228314] overlayfs: idmapped layers are currently not supported
[Nov26 20:05] overlayfs: idmapped layers are currently not supported
[Nov26 20:06] overlayfs: idmapped layers are currently not supported
[ +3.713866] overlayfs: idmapped layers are currently not supported
==> etcd [cdc1651fea8f10bd665928dcc7bb174b74385eb06e911da9629df17c0d9d29e8] <==
{"level":"info","ts":"2025-11-26T20:08:15.335606Z","caller":"traceutil/trace.go:172","msg":"trace[1383728067] range","detail":"{range_begin:/registry/priorityclasses/; range_end:/registry/priorityclasses0; response_count:2; response_revision:2566; }","duration":"123.275763ms","start":"2025-11-26T20:08:15.212323Z","end":"2025-11-26T20:08:15.335599Z","steps":["trace[1383728067] 'agreement among raft nodes before linearized reading' (duration: 123.198694ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.351724Z","caller":"traceutil/trace.go:172","msg":"trace[1874297602] range","detail":"{range_begin:; range_end:; response_count:0; response_revision:2567; }","duration":"115.025762ms","start":"2025-11-26T20:08:15.236689Z","end":"2025-11-26T20:08:15.351715Z","steps":["trace[1874297602] 'agreement among raft nodes before linearized reading' (duration: 114.988281ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.353572Z","caller":"traceutil/trace.go:172","msg":"trace[590005640] range","detail":"{range_begin:/registry/cronjobs; range_end:; response_count:0; response_revision:2567; }","duration":"117.001923ms","start":"2025-11-26T20:08:15.236561Z","end":"2025-11-26T20:08:15.353563Z","steps":["trace[590005640] 'agreement among raft nodes before linearized reading' (duration: 116.956164ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.353840Z","caller":"traceutil/trace.go:172","msg":"trace[1252963882] range","detail":"{range_begin:/registry/csidrivers/; range_end:/registry/csidrivers0; response_count:0; response_revision:2567; }","duration":"117.289377ms","start":"2025-11-26T20:08:15.236544Z","end":"2025-11-26T20:08:15.353834Z","steps":["trace[1252963882] 'agreement among raft nodes before linearized reading' (duration: 117.256032ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.353913Z","caller":"traceutil/trace.go:172","msg":"trace[297213381] range","detail":"{range_begin:/registry/roles; range_end:; response_count:0; response_revision:2567; }","duration":"117.437904ms","start":"2025-11-26T20:08:15.236470Z","end":"2025-11-26T20:08:15.353908Z","steps":["trace[297213381] 'agreement among raft nodes before linearized reading' (duration: 117.416234ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.364849Z","caller":"traceutil/trace.go:172","msg":"trace[1421861513] range","detail":"{range_begin:/registry/clusterrolebindings/; range_end:/registry/clusterrolebindings0; response_count:59; response_revision:2567; }","duration":"128.412849ms","start":"2025-11-26T20:08:15.236425Z","end":"2025-11-26T20:08:15.364838Z","steps":["trace[1421861513] 'agreement among raft nodes before linearized reading' (duration: 128.131786ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.364893Z","caller":"traceutil/trace.go:172","msg":"trace[1461250281] range","detail":"{range_begin:/registry/serviceaccounts; range_end:; response_count:0; response_revision:2567; }","duration":"128.480491ms","start":"2025-11-26T20:08:15.236409Z","end":"2025-11-26T20:08:15.364889Z","steps":["trace[1461250281] 'agreement among raft nodes before linearized reading' (duration: 128.461948ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.364921Z","caller":"traceutil/trace.go:172","msg":"trace[502786890] range","detail":"{range_begin:/registry/secrets; range_end:; response_count:0; response_revision:2567; }","duration":"128.524388ms","start":"2025-11-26T20:08:15.236393Z","end":"2025-11-26T20:08:15.364917Z","steps":["trace[502786890] 'agreement among raft nodes before linearized reading' (duration: 128.51112ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.364974Z","caller":"traceutil/trace.go:172","msg":"trace[1598355909] range","detail":"{range_begin:/registry/ipaddresses/; range_end:/registry/ipaddresses0; response_count:2; response_revision:2567; }","duration":"128.579657ms","start":"2025-11-26T20:08:15.236389Z","end":"2025-11-26T20:08:15.364969Z","steps":["trace[1598355909] 'agreement among raft nodes before linearized reading' (duration: 128.540937ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365001Z","caller":"traceutil/trace.go:172","msg":"trace[640320053] range","detail":"{range_begin:/registry/daemonsets; range_end:; response_count:0; response_revision:2567; }","duration":"128.6531ms","start":"2025-11-26T20:08:15.236344Z","end":"2025-11-26T20:08:15.364998Z","steps":["trace[640320053] 'agreement among raft nodes before linearized reading' (duration: 128.639283ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365081Z","caller":"traceutil/trace.go:172","msg":"trace[703339521] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:1; response_revision:2567; }","duration":"128.762571ms","start":"2025-11-26T20:08:15.236311Z","end":"2025-11-26T20:08:15.365074Z","steps":["trace[703339521] 'agreement among raft nodes before linearized reading' (duration: 128.697349ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365157Z","caller":"traceutil/trace.go:172","msg":"trace[879094705] range","detail":"{range_begin:/registry/certificatesigningrequests/; range_end:/registry/certificatesigningrequests0; response_count:4; response_revision:2567; }","duration":"128.947693ms","start":"2025-11-26T20:08:15.236204Z","end":"2025-11-26T20:08:15.365152Z","steps":["trace[879094705] 'agreement among raft nodes before linearized reading' (duration: 128.887427ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365183Z","caller":"traceutil/trace.go:172","msg":"trace[1712061630] range","detail":"{range_begin:/registry/ingress; range_end:; response_count:0; response_revision:2567; }","duration":"129.057033ms","start":"2025-11-26T20:08:15.236122Z","end":"2025-11-26T20:08:15.365179Z","steps":["trace[1712061630] 'agreement among raft nodes before linearized reading' (duration: 129.044151ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365210Z","caller":"traceutil/trace.go:172","msg":"trace[884725043] range","detail":"{range_begin:/registry/mutatingwebhookconfigurations; range_end:; response_count:0; response_revision:2567; }","duration":"130.176311ms","start":"2025-11-26T20:08:15.235029Z","end":"2025-11-26T20:08:15.365206Z","steps":["trace[884725043] 'agreement among raft nodes before linearized reading' (duration: 130.162199ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365235Z","caller":"traceutil/trace.go:172","msg":"trace[1960126933] range","detail":"{range_begin:/registry/namespaces; range_end:; response_count:0; response_revision:2567; }","duration":"138.218251ms","start":"2025-11-26T20:08:15.227012Z","end":"2025-11-26T20:08:15.365231Z","steps":["trace[1960126933] 'agreement among raft nodes before linearized reading' (duration: 138.206222ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365306Z","caller":"traceutil/trace.go:172","msg":"trace[700774855] range","detail":"{range_begin:/registry/roles/; range_end:/registry/roles0; response_count:12; response_revision:2567; }","duration":"138.316595ms","start":"2025-11-26T20:08:15.226986Z","end":"2025-11-26T20:08:15.365302Z","steps":["trace[700774855] 'agreement among raft nodes before linearized reading' (duration: 138.256756ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365332Z","caller":"traceutil/trace.go:172","msg":"trace[1878756393] range","detail":"{range_begin:/registry/resourceclaims/; range_end:/registry/resourceclaims0; response_count:0; response_revision:2567; }","duration":"138.360049ms","start":"2025-11-26T20:08:15.226968Z","end":"2025-11-26T20:08:15.365328Z","steps":["trace[1878756393] 'agreement among raft nodes before linearized reading' (duration: 138.347619ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365357Z","caller":"traceutil/trace.go:172","msg":"trace[2116024509] range","detail":"{range_begin:/registry/limitranges; range_end:; response_count:0; response_revision:2567; }","duration":"138.462432ms","start":"2025-11-26T20:08:15.226891Z","end":"2025-11-26T20:08:15.365354Z","steps":["trace[2116024509] 'agreement among raft nodes before linearized reading' (duration: 138.449927ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365434Z","caller":"traceutil/trace.go:172","msg":"trace[1377873000] range","detail":"{range_begin:/registry/configmaps/; range_end:/registry/configmaps0; response_count:11; response_revision:2567; }","duration":"138.557683ms","start":"2025-11-26T20:08:15.226872Z","end":"2025-11-26T20:08:15.365429Z","steps":["trace[1377873000] 'agreement among raft nodes before linearized reading' (duration: 138.494029ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365486Z","caller":"traceutil/trace.go:172","msg":"trace[251490351] range","detail":"{range_begin:/registry/secrets/; range_end:/registry/secrets0; response_count:4; response_revision:2567; }","duration":"138.671406ms","start":"2025-11-26T20:08:15.226810Z","end":"2025-11-26T20:08:15.365482Z","steps":["trace[251490351] 'agreement among raft nodes before linearized reading' (duration: 138.633211ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365537Z","caller":"traceutil/trace.go:172","msg":"trace[570012177] range","detail":"{range_begin:/registry/daemonsets/; range_end:/registry/daemonsets0; response_count:2; response_revision:2567; }","duration":"138.744439ms","start":"2025-11-26T20:08:15.226789Z","end":"2025-11-26T20:08:15.365533Z","steps":["trace[570012177] 'agreement among raft nodes before linearized reading' (duration: 138.706334ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365586Z","caller":"traceutil/trace.go:172","msg":"trace[1618327843] range","detail":"{range_begin:/registry/services/endpoints/; range_end:/registry/services/endpoints0; response_count:3; response_revision:2567; }","duration":"138.820441ms","start":"2025-11-26T20:08:15.226762Z","end":"2025-11-26T20:08:15.365583Z","steps":["trace[1618327843] 'agreement among raft nodes before linearized reading' (duration: 138.784002ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365726Z","caller":"traceutil/trace.go:172","msg":"trace[1190967021] range","detail":"{range_begin:/registry/serviceaccounts/; range_end:/registry/serviceaccounts0; response_count:44; response_revision:2567; }","duration":"138.982458ms","start":"2025-11-26T20:08:15.226740Z","end":"2025-11-26T20:08:15.365722Z","steps":["trace[1190967021] 'agreement among raft nodes before linearized reading' (duration: 138.855731ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365752Z","caller":"traceutil/trace.go:172","msg":"trace[191199000] range","detail":"{range_begin:/registry/ipaddresses; range_end:; response_count:0; response_revision:2567; }","duration":"139.0245ms","start":"2025-11-26T20:08:15.226723Z","end":"2025-11-26T20:08:15.365747Z","steps":["trace[191199000] 'agreement among raft nodes before linearized reading' (duration: 139.012775ms)"],"step_count":1}
{"level":"info","ts":"2025-11-26T20:08:15.365777Z","caller":"traceutil/trace.go:172","msg":"trace[338323478] range","detail":"{range_begin:/registry/deviceclasses/; range_end:/registry/deviceclasses0; response_count:0; response_revision:2567; }","duration":"139.071482ms","start":"2025-11-26T20:08:15.226701Z","end":"2025-11-26T20:08:15.365773Z","steps":["trace[338323478] 'agreement among raft nodes before linearized reading' (duration: 139.05988ms)"],"step_count":1}
==> kernel <==
20:14:26 up 56 min, 0 user, load average: 1.10, 1.13, 1.23
Linux ha-278127 5.15.0-1084-aws #91~20.04.1-Ubuntu SMP Fri May 2 07:00:04 UTC 2025 aarch64 GNU/Linux
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
==> kindnet [d140d1950675ee8ccd9c84ef7a5a7da1b1e44300cc3e3a958c71e1138816061f] <==
I1126 20:13:42.226790 1 main.go:324] Node ha-278127-m04 has CIDR [10.244.3.0/24]
I1126 20:13:52.226003 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1126 20:13:52.226037 1 main.go:301] handling current node
I1126 20:13:52.226054 1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
I1126 20:13:52.226060 1 main.go:324] Node ha-278127-m02 has CIDR [10.244.1.0/24]
I1126 20:13:52.226201 1 main.go:297] Handling node with IPs: map[192.168.49.5:{}]
I1126 20:13:52.226262 1 main.go:324] Node ha-278127-m04 has CIDR [10.244.3.0/24]
I1126 20:14:02.232091 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1126 20:14:02.232128 1 main.go:301] handling current node
I1126 20:14:02.232146 1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
I1126 20:14:02.232153 1 main.go:324] Node ha-278127-m02 has CIDR [10.244.1.0/24]
I1126 20:14:02.232327 1 main.go:297] Handling node with IPs: map[192.168.49.5:{}]
I1126 20:14:02.232341 1 main.go:324] Node ha-278127-m04 has CIDR [10.244.3.0/24]
I1126 20:14:12.226411 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1126 20:14:12.226443 1 main.go:301] handling current node
I1126 20:14:12.226460 1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
I1126 20:14:12.226467 1 main.go:324] Node ha-278127-m02 has CIDR [10.244.1.0/24]
I1126 20:14:12.226646 1 main.go:297] Handling node with IPs: map[192.168.49.5:{}]
I1126 20:14:12.226661 1 main.go:324] Node ha-278127-m04 has CIDR [10.244.3.0/24]
I1126 20:14:22.226927 1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
I1126 20:14:22.227048 1 main.go:301] handling current node
I1126 20:14:22.227109 1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
I1126 20:14:22.227140 1 main.go:324] Node ha-278127-m02 has CIDR [10.244.1.0/24]
I1126 20:14:22.227311 1 main.go:297] Handling node with IPs: map[192.168.49.5:{}]
I1126 20:14:22.227350 1 main.go:324] Node ha-278127-m04 has CIDR [10.244.3.0/24]
==> kube-apiserver [f5647f1652cc11a195a49a98906391e791c3136916a5e3c249907585088fad42] <==
{"level":"warn","ts":"2025-11-26T20:08:15.185150Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x40019681e0/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":4,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.185302Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x400264b2c0/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":1,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.185460Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x4001969860/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":2,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.185569Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x40023790e0/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":2,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.185752Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x4001a24960/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":4,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.185791Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x4002218000/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":4,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.188111Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x400089eb40/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":1,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.188335Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x4002471680/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":4,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.190353Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x400264b2c0/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":4,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.190396Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x4000f503c0/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":4,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.190413Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x40029423c0/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":4,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.190430Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x4001969860/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":2,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.190463Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x4002a3b860/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":4,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.190481Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x4002378000/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":2,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.190499Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x400203d2c0/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":4,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.190513Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x4000f51a40/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":0,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.190529Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x4001a24960/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":0,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
{"level":"warn","ts":"2025-11-26T20:08:15.190727Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0x400089e000/127.0.0.1:2379","method":"/etcdserverpb.KV/Range","attempt":2,"error":"rpc error: code = Unavailable desc = etcdserver: leader changed"}
W1126 20:08:17.152713 1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.49.2]
I1126 20:08:17.154506 1 controller.go:667] quota admission added evaluator for: endpoints
I1126 20:08:17.162706 1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
I1126 20:08:19.148616 1 controller.go:667] quota admission added evaluator for: daemonsets.apps
I1126 20:08:22.296241 1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
I1126 20:09:09.201336 1 controller.go:667] quota admission added evaluator for: replicasets.apps
I1126 20:09:09.262823 1 controller.go:667] quota admission added evaluator for: deployments.apps
==> kube-controller-manager [0e221d151c3ca52563688e2194b1c01d8b4614a29869607958f68b96125603ee] <==
I1126 20:07:29.733675 1 serving.go:386] Generated self-signed cert in-memory
I1126 20:07:30.451982 1 controllermanager.go:191] "Starting" version="v1.34.1"
I1126 20:07:30.452014 1 controllermanager.go:193] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1126 20:07:30.453426 1 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt"
I1126 20:07:30.453688 1 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"
I1126 20:07:30.453871 1 secure_serving.go:211] Serving securely on 127.0.0.1:10257
I1126 20:07:30.453945 1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
E1126 20:07:44.473711 1 controllermanager.go:245] "Error building controller context" err="failed to wait for apiserver being healthy: timed out waiting for the condition: failed to get apiserver /healthz status: an error on the server (\"[+]ping ok\\n[+]log ok\\n[-]etcd failed: reason withheld\\n[+]poststarthook/start-apiserver-admission-initializer ok\\n[+]poststarthook/generic-apiserver-start-informers ok\\n[+]poststarthook/priority-and-fairness-config-consumer ok\\n[+]poststarthook/priority-and-fairness-filter ok\\n[+]poststarthook/storage-object-count-tracker-hook ok\\n[+]poststarthook/start-apiextensions-informers ok\\n[+]poststarthook/start-apiextensions-controllers ok\\n[+]poststarthook/crd-informer-synced ok\\n[+]poststarthook/start-system-namespaces-controller ok\\n[+]poststarthook/start-cluster-authentication-info-controller ok\\n[+]poststarthook/start-kube-apiserver-identity-lease-controller ok\\n[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok\\n[+]poststar
thook/start-legacy-token-tracking-controller ok\\n[+]poststarthook/start-service-ip-repair-controllers ok\\n[-]poststarthook/rbac/bootstrap-roles failed: reason withheld\\n[+]poststarthook/scheduling/bootstrap-system-priority-classes ok\\n[+]poststarthook/priority-and-fairness-config-producer ok\\n[+]poststarthook/bootstrap-controller ok\\n[+]poststarthook/start-kubernetes-service-cidr-controller ok\\n[+]poststarthook/aggregator-reload-proxy-client-cert ok\\n[+]poststarthook/start-kube-aggregator-informers ok\\n[+]poststarthook/apiservice-status-local-available-controller ok\\n[+]poststarthook/apiservice-status-remote-available-controller ok\\n[+]poststarthook/apiservice-registration-controller ok\\n[+]poststarthook/apiservice-discovery-controller ok\\n[+]poststarthook/kube-apiserver-autoregistration ok\\n[+]autoregister-completion ok\\n[+]poststarthook/apiservice-openapi-controller ok\\n[+]poststarthook/apiservice-openapiv3-controller ok\\nhealthz check failed\") has prevented the request from succeeding"
==> kube-controller-manager [b3d2b3bea3b9f0d42f5ec9c992ad87cad16307afa6489e152b85bea61806ecca] <==
E1126 20:08:39.054180 1 gc_controller.go:151] "Failed to get node" err="node \"ha-278127-m03\" not found" logger="pod-garbage-collector-controller" node="ha-278127-m03"
E1126 20:08:39.054188 1 gc_controller.go:151] "Failed to get node" err="node \"ha-278127-m03\" not found" logger="pod-garbage-collector-controller" node="ha-278127-m03"
E1126 20:08:39.054196 1 gc_controller.go:151] "Failed to get node" err="node \"ha-278127-m03\" not found" logger="pod-garbage-collector-controller" node="ha-278127-m03"
E1126 20:08:39.054201 1 gc_controller.go:151] "Failed to get node" err="node \"ha-278127-m03\" not found" logger="pod-garbage-collector-controller" node="ha-278127-m03"
E1126 20:08:59.054573 1 gc_controller.go:151] "Failed to get node" err="node \"ha-278127-m03\" not found" logger="pod-garbage-collector-controller" node="ha-278127-m03"
E1126 20:08:59.054603 1 gc_controller.go:151] "Failed to get node" err="node \"ha-278127-m03\" not found" logger="pod-garbage-collector-controller" node="ha-278127-m03"
E1126 20:08:59.054612 1 gc_controller.go:151] "Failed to get node" err="node \"ha-278127-m03\" not found" logger="pod-garbage-collector-controller" node="ha-278127-m03"
E1126 20:08:59.054617 1 gc_controller.go:151] "Failed to get node" err="node \"ha-278127-m03\" not found" logger="pod-garbage-collector-controller" node="ha-278127-m03"
E1126 20:08:59.054623 1 gc_controller.go:151] "Failed to get node" err="node \"ha-278127-m03\" not found" logger="pod-garbage-collector-controller" node="ha-278127-m03"
I1126 20:08:59.075009 1 gc_controller.go:343] "PodGC is force deleting Pod" logger="pod-garbage-collector-controller" pod="kube-system/kube-proxy-mttpp"
I1126 20:08:59.108301 1 gc_controller.go:259] "Forced deletion of orphaned Pod succeeded" logger="pod-garbage-collector-controller" pod="kube-system/kube-proxy-mttpp"
I1126 20:08:59.108397 1 gc_controller.go:343] "PodGC is force deleting Pod" logger="pod-garbage-collector-controller" pod="kube-system/kube-scheduler-ha-278127-m03"
I1126 20:08:59.137341 1 gc_controller.go:259] "Forced deletion of orphaned Pod succeeded" logger="pod-garbage-collector-controller" pod="kube-system/kube-scheduler-ha-278127-m03"
I1126 20:08:59.137379 1 gc_controller.go:343] "PodGC is force deleting Pod" logger="pod-garbage-collector-controller" pod="kube-system/kindnet-cjs7r"
I1126 20:08:59.170242 1 gc_controller.go:259] "Forced deletion of orphaned Pod succeeded" logger="pod-garbage-collector-controller" pod="kube-system/kindnet-cjs7r"
I1126 20:08:59.170364 1 gc_controller.go:343] "PodGC is force deleting Pod" logger="pod-garbage-collector-controller" pod="kube-system/kube-vip-ha-278127-m03"
I1126 20:08:59.200927 1 gc_controller.go:259] "Forced deletion of orphaned Pod succeeded" logger="pod-garbage-collector-controller" pod="kube-system/kube-vip-ha-278127-m03"
I1126 20:08:59.201053 1 gc_controller.go:343] "PodGC is force deleting Pod" logger="pod-garbage-collector-controller" pod="kube-system/kube-apiserver-ha-278127-m03"
I1126 20:08:59.231029 1 gc_controller.go:259] "Forced deletion of orphaned Pod succeeded" logger="pod-garbage-collector-controller" pod="kube-system/kube-apiserver-ha-278127-m03"
I1126 20:08:59.231129 1 gc_controller.go:343] "PodGC is force deleting Pod" logger="pod-garbage-collector-controller" pod="kube-system/kube-controller-manager-ha-278127-m03"
I1126 20:08:59.266325 1 gc_controller.go:259] "Forced deletion of orphaned Pod succeeded" logger="pod-garbage-collector-controller" pod="kube-system/kube-controller-manager-ha-278127-m03"
I1126 20:08:59.266427 1 gc_controller.go:343] "PodGC is force deleting Pod" logger="pod-garbage-collector-controller" pod="kube-system/etcd-ha-278127-m03"
I1126 20:08:59.307467 1 gc_controller.go:259] "Forced deletion of orphaned Pod succeeded" logger="pod-garbage-collector-controller" pod="kube-system/etcd-ha-278127-m03"
I1126 20:14:09.243470 1 taint_eviction.go:111] "Deleting pod" logger="taint-eviction-controller" controller="taint-eviction-controller" pod="default/busybox-7b57f96db7-hqq6q"
I1126 20:14:19.320009 1 taint_eviction.go:111] "Deleting pod" logger="taint-eviction-controller" controller="taint-eviction-controller" pod="default/busybox-7b57f96db7-72bpv"
==> kube-proxy [7b45294efb44968b6b5d7d6994b3f6f118094d33ccfb9aa9a125e9d6110f41b3] <==
I1126 20:07:27.549779 1 reflector.go:568] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
I1126 20:07:27.549805 1 reflector.go:568] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.EndpointSlice" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
I1126 20:07:27.549666 1 reflector.go:568] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
E1126 20:07:31.630334 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ServiceCIDR: Get \"https://control-plane.minikube.internal:8443/apis/networking.k8s.io/v1/servicecidrs?labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=2530\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ServiceCIDR"
E1126 20:07:31.630336 1 reflector.go:205] "Failed to watch" err="failed to list *v1.EndpointSlice: Get \"https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=2530\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.EndpointSlice"
E1126 20:07:31.630470 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: Get \"https://control-plane.minikube.internal:8443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=2531\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1126 20:07:31.630581 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%3Dha-278127&resourceVersion=2538\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1126 20:07:34.702391 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: Get \"https://control-plane.minikube.internal:8443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=2531\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1126 20:07:34.702403 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%3Dha-278127&resourceVersion=2538\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1126 20:07:34.702509 1 reflector.go:205] "Failed to watch" err="failed to list *v1.EndpointSlice: Get \"https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=2530\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.EndpointSlice"
E1126 20:07:34.702664 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ServiceCIDR: Get \"https://control-plane.minikube.internal:8443/apis/networking.k8s.io/v1/servicecidrs?labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=2530\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ServiceCIDR"
E1126 20:07:41.518262 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ServiceCIDR: Get \"https://control-plane.minikube.internal:8443/apis/networking.k8s.io/v1/servicecidrs?labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=2530\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ServiceCIDR"
E1126 20:07:41.518267 1 reflector.go:205] "Failed to watch" err="failed to list *v1.EndpointSlice: Get \"https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=2530\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.EndpointSlice"
E1126 20:07:41.518397 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: Get \"https://control-plane.minikube.internal:8443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=2531\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1126 20:07:41.518465 1 event_broadcaster.go:279] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/apis/events.k8s.io/v1/namespaces/default/events\": dial tcp 192.168.49.254:8443: connect: no route to host"
E1126 20:07:41.518496 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%3Dha-278127&resourceVersion=2538\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1126 20:07:52.462253 1 event_broadcaster.go:279] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/apis/events.k8s.io/v1/namespaces/default/events\": dial tcp 192.168.49.254:8443: connect: no route to host"
E1126 20:07:52.462312 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ServiceCIDR: Get \"https://control-plane.minikube.internal:8443/apis/networking.k8s.io/v1/servicecidrs?labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=2530\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ServiceCIDR"
E1126 20:07:52.462400 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: Get \"https://control-plane.minikube.internal:8443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=2531\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1126 20:07:55.534388 1 reflector.go:205] "Failed to watch" err="failed to list *v1.EndpointSlice: Get \"https://control-plane.minikube.internal:8443/apis/discovery.k8s.io/v1/endpointslices?labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=2530\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.EndpointSlice"
E1126 20:07:55.534401 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%3Dha-278127&resourceVersion=2538\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
E1126 20:08:05.710253 1 event_broadcaster.go:279] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/apis/events.k8s.io/v1/namespaces/default/events\": dial tcp 192.168.49.254:8443: connect: no route to host"
E1126 20:08:08.782267 1 reflector.go:205] "Failed to watch" err="failed to list *v1.ServiceCIDR: Get \"https://control-plane.minikube.internal:8443/apis/networking.k8s.io/v1/servicecidrs?labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=2530\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ServiceCIDR"
E1126 20:08:11.854307 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: Get \"https://control-plane.minikube.internal:8443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=2531\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
E1126 20:08:14.930219 1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%3Dha-278127&resourceVersion=2538\": dial tcp 192.168.49.254:8443: connect: no route to host" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
==> kube-scheduler [040a8549001808f2d3fce3d4cf9f8dff272706173960c5e8004af8b1ea042e80] <==
I1126 20:06:34.800738 1 serving.go:386] Generated self-signed cert in-memory
W1126 20:06:39.572983 1 requestheader_controller.go:204] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
W1126 20:06:39.573028 1 authentication.go:397] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
W1126 20:06:39.573039 1 authentication.go:398] Continuing without authentication configuration. This may treat all requests as anonymous.
W1126 20:06:39.573046 1 authentication.go:399] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
I1126 20:06:39.693522 1 server.go:175] "Starting Kubernetes Scheduler" version="v1.34.1"
I1126 20:06:39.693624 1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I1126 20:06:39.703802 1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
I1126 20:06:39.704071 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1126 20:06:39.715887 1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I1126 20:06:39.704092 1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
I1126 20:06:39.816440 1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
==> kubelet <==
Nov 26 20:07:21 ha-278127 kubelet[805]: E1126 20:07:21.263300 805 kubelet_node_status.go:486] "Error updating node status, will retry" err="error getting node \"ha-278127\": Get \"https://192.168.49.2:8443/api/v1/nodes/ha-278127?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 26 20:07:23 ha-278127 kubelet[805]: E1126 20:07:23.240740 805 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{ha-278127.187ba7448d330dec default 2559 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ha-278127,UID:ha-278127,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ha-278127 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ha-278127,},FirstTimestamp:2025-11-26 20:06:31 +0000 UTC,LastTimestamp:2025-11-26 20:06:32.032348366 +0000 UTC m=+0.308576049,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ha-278127,}"
Nov 26 20:07:27 ha-278127 kubelet[805]: I1126 20:07:27.929241 805 scope.go:117] "RemoveContainer" containerID="c5680f84cd871450e3f95050160c6bc383cefc96eca8fe13ef831453bb2fe8a9"
Nov 26 20:07:28 ha-278127 kubelet[805]: I1126 20:07:28.928664 805 scope.go:117] "RemoveContainer" containerID="1a9b5dae1533404a7bf684e278d137906a4f310cb5682e61046be41540e6f32b"
Nov 26 20:07:31 ha-278127 kubelet[805]: E1126 20:07:31.162433 805 controller.go:195] "Failed to update lease" err="Put \"https://192.168.49.2:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ha-278127?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 26 20:07:31 ha-278127 kubelet[805]: E1126 20:07:31.265440 805 kubelet_node_status.go:486] "Error updating node status, will retry" err="error getting node \"ha-278127\": the server was unable to return a response in the time allotted, but may still be processing the request (get nodes ha-278127)"
Nov 26 20:07:41 ha-278127 kubelet[805]: E1126 20:07:41.163428 805 controller.go:195] "Failed to update lease" err="Put \"https://192.168.49.2:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ha-278127?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 26 20:07:41 ha-278127 kubelet[805]: I1126 20:07:41.163974 805 controller.go:115] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease"
Nov 26 20:07:41 ha-278127 kubelet[805]: E1126 20:07:41.266735 805 kubelet_node_status.go:486] "Error updating node status, will retry" err="error getting node \"ha-278127\": Get \"https://192.168.49.2:8443/api/v1/nodes/ha-278127?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 26 20:07:41 ha-278127 kubelet[805]: E1126 20:07:41.266930 805 kubelet_node_status.go:473] "Unable to update node status" err="update node status exceeds retry count"
Nov 26 20:07:45 ha-278127 kubelet[805]: I1126 20:07:45.237637 805 scope.go:117] "RemoveContainer" containerID="c5680f84cd871450e3f95050160c6bc383cefc96eca8fe13ef831453bb2fe8a9"
Nov 26 20:07:45 ha-278127 kubelet[805]: I1126 20:07:45.238084 805 scope.go:117] "RemoveContainer" containerID="0e221d151c3ca52563688e2194b1c01d8b4614a29869607958f68b96125603ee"
Nov 26 20:07:45 ha-278127 kubelet[805]: E1126 20:07:45.238254 805 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-ha-278127_kube-system(5eb8d26456c3b783869be39bb80c3519)\"" pod="kube-system/kube-controller-manager-ha-278127" podUID="5eb8d26456c3b783869be39bb80c3519"
Nov 26 20:07:47 ha-278127 kubelet[805]: I1126 20:07:47.402612 805 scope.go:117] "RemoveContainer" containerID="0e221d151c3ca52563688e2194b1c01d8b4614a29869607958f68b96125603ee"
Nov 26 20:07:47 ha-278127 kubelet[805]: E1126 20:07:47.402814 805 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-ha-278127_kube-system(5eb8d26456c3b783869be39bb80c3519)\"" pod="kube-system/kube-controller-manager-ha-278127" podUID="5eb8d26456c3b783869be39bb80c3519"
Nov 26 20:07:49 ha-278127 kubelet[805]: E1126 20:07:49.241093 805 status_manager.go:1018] "Failed to get status for pod" err="the server was unable to return a response in the time allotted, but may still be processing the request (get pods kindnet-gp24m)" podUID="4d3597e4-de22-4f29-8c58-1aaabd4a8a56" pod="kube-system/kindnet-gp24m"
Nov 26 20:07:51 ha-278127 kubelet[805]: E1126 20:07:51.165080 805 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://192.168.49.2:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ha-278127?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="200ms"
Nov 26 20:07:57 ha-278127 kubelet[805]: E1126 20:07:57.243812 805 event.go:359] "Server rejected event (will not retry!)" err="Timeout: request did not complete within requested timeout - context deadline exceeded" event="&Event{ObjectMeta:{ha-278127.187ba7448d32cbe5 default 2561 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ha-278127,UID:ha-278127,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ha-278127 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ha-278127,},FirstTimestamp:2025-11-26 20:06:31 +0000 UTC,LastTimestamp:2025-11-26 20:06:32.033252015 +0000 UTC m=+0.309479698,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ha-278127,}"
Nov 26 20:08:00 ha-278127 kubelet[805]: I1126 20:08:00.928844 805 scope.go:117] "RemoveContainer" containerID="0e221d151c3ca52563688e2194b1c01d8b4614a29869607958f68b96125603ee"
Nov 26 20:08:00 ha-278127 kubelet[805]: E1126 20:08:00.929077 805 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-ha-278127_kube-system(5eb8d26456c3b783869be39bb80c3519)\"" pod="kube-system/kube-controller-manager-ha-278127" podUID="5eb8d26456c3b783869be39bb80c3519"
Nov 26 20:08:01 ha-278127 kubelet[805]: E1126 20:08:01.366584 805 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://192.168.49.2:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ha-278127?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" interval="400ms"
Nov 26 20:08:01 ha-278127 kubelet[805]: E1126 20:08:01.649883 805 kubelet_node_status.go:486] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2025-11-26T20:07:51Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-11-26T20:07:51Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-11-26T20:07:51Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2025-11-26T20:07:51Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"},{\\\"features\\\":{\\\"recurs
iveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"}]}}\" for node \"ha-278127\": Patch \"https://192.168.49.2:8443/api/v1/nodes/ha-278127/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 26 20:08:11 ha-278127 kubelet[805]: E1126 20:08:11.650209 805 kubelet_node_status.go:486] "Error updating node status, will retry" err="error getting node \"ha-278127\": Get \"https://192.168.49.2:8443/api/v1/nodes/ha-278127?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 26 20:08:11 ha-278127 kubelet[805]: E1126 20:08:11.768381 805 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://192.168.49.2:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ha-278127?timeout=10s\": context deadline exceeded" interval="800ms"
Nov 26 20:08:12 ha-278127 kubelet[805]: I1126 20:08:12.929036 805 scope.go:117] "RemoveContainer" containerID="0e221d151c3ca52563688e2194b1c01d8b4614a29869607958f68b96125603ee"
-- /stdout --
helpers_test.go:262: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p ha-278127 -n ha-278127
helpers_test.go:269: (dbg) Run: kubectl --context ha-278127 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:280: non-running pods: busybox-7b57f96db7-l9p24 busybox-7b57f96db7-rcsd2
helpers_test.go:282: ======> post-mortem[TestMultiControlPlane/serial/DegradedAfterClusterRestart]: describe non-running pods <======
helpers_test.go:285: (dbg) Run: kubectl --context ha-278127 describe pod busybox-7b57f96db7-l9p24 busybox-7b57f96db7-rcsd2
helpers_test.go:290: (dbg) kubectl --context ha-278127 describe pod busybox-7b57f96db7-l9p24 busybox-7b57f96db7-rcsd2:
-- stdout --
Name: busybox-7b57f96db7-l9p24
Namespace: default
Priority: 0
Service Account: default
Node: <none>
Labels: app=busybox
pod-template-hash=7b57f96db7
Annotations: <none>
Status: Pending
IP:
IPs: <none>
Controlled By: ReplicaSet/busybox-7b57f96db7
Containers:
busybox:
Image: gcr.io/k8s-minikube/busybox:1.28
Port: <none>
Host Port: <none>
Command:
sleep
3600
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-jltdj (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-jltdj:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
Optional: false
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 20s default-scheduler 0/3 nodes are available: 1 node(s) didn't match pod anti-affinity rules, 2 node(s) had untolerated taint {node.kubernetes.io/unreachable: }. no new claims to deallocate, preemption: 0/3 nodes are available: 1 No preemption victims found for incoming pod, 2 Preemption is not helpful for scheduling.
Name: busybox-7b57f96db7-rcsd2
Namespace: default
Priority: 0
Service Account: default
Node: <none>
Labels: app=busybox
pod-template-hash=7b57f96db7
Annotations: <none>
Status: Pending
IP:
IPs: <none>
Controlled By: ReplicaSet/busybox-7b57f96db7
Containers:
busybox:
Image: gcr.io/k8s-minikube/busybox:1.28
Port: <none>
Host Port: <none>
Command:
sleep
3600
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-zn4mp (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-zn4mp:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
Optional: false
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 9s default-scheduler 0/3 nodes are available: 1 node(s) didn't match pod anti-affinity rules, 2 node(s) had untolerated taint {node.kubernetes.io/unreachable: }. no new claims to deallocate, preemption: 0/3 nodes are available: 1 No preemption victims found for incoming pod, 2 Preemption is not helpful for scheduling.
-- /stdout --
helpers_test.go:293: <<< TestMultiControlPlane/serial/DegradedAfterClusterRestart FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiControlPlane/serial/DegradedAfterClusterRestart (5.82s)